KEEL Tool for Statistical Analysis

Statistical procedures

This module allows to perform several non-parametric statistical test over a given set of results.Further information about them can be found in the SCI2S thematic Web Site of Statistical Inference in Computational Intelligence and Data Mining: http://sci2s.ugr.es/sicidm/

In this version, the available procedures are the following:

They can be selected through the Statistical procedures box:




Post hoc methods

In order to characterize the differences detected by the statistical test, this module also provides a set of well-known post hoc methods.

For Friedman, Quade and Friedman alligned tests, it is possible to employ the following post hoc tests:



For Multiple tests, it is possible to employ the following post hoc tests:



Performance measure

Depending on the charasteristics of the problem considered, it is posible to perform the statiscal test for maximization and minimization problems.

This feature, avalaible only for Friedman, Quade and Friedman alligned tests, allows to determine if the results have been obtained from a maximization problem (e.g. using accuracy in supervised classification problems) or from a minimization problem (e.g. using MS Error in regression problems).





Working with data

Data table

The data table stores the average results achieved by each algorithm in each data set (problem):





It is possible to input the values directly on the cells of the table, updating both results and the names of the data sets (however, algorithms' names can only be updated through reading a CSV results file, see the next section).





Table controls

The following operations are defined to manage the data table:





Generation of analysis

Finally, when the data table has been filled with the results to analyze, and all the relevant options have been selected, the analysis can be performed through the Perform Analysis button:





The name for a .tex (a LaTeX file) will be needed to store the results of the analysis. Then, if the data introduced is correct, the analysis will be performed.





This .tex file contains all the information offered by the tests. To revise it, just compile the file with your favourite LaTeX processor, in order to obtain a PDF/PS/DVI file containing the results.