main main
KEEL - dataset     Imbalanced data sets

Imbalanced data sets are a special case for classification problem where the class distribution is not uniform among the classes. Typically, they are composed by two classes: The majority (negative) class and the minority (positive) class.

These type of sets suppose a new challenging problem for Data Mining, since standard classification algorithms usually consider a balanced training set and this supposes a bias towards the majority class.

Each data file has the following structure:

  • @relation: Name of the data set
  • @attribute: Description of an attribute (one for each attribute)
  • @inputs: List with the names of the input attributes
  • @output: Name of the output attribute
  • @data: Starting tag of the data

The rest of the file contains all the examples belonging to the data set, expressed in comma sepparated values format.

KEEL - dataset

We offer information about experimental studies using these data sets (result files, papers and more) in the Experimental studies with imbalanced data sets section of the repository.


All the Imbalanced data sets presented in this web-page are partitioned using a 5-folds stratified cross validation. Note that dividing the dataset into 5 folds is considered in order to dispose of a sufficient quantity of minority class examples in the test partitions. In this way, test partition examples are more representative of the underlying knowledge.

We divide our Imbalanced data sets into the following sections:

 -    Imbalance ratio between 1.5 and 9
 -    Imbalance ratio higher than 9 - Part I
 -    Imbalance ratio higher than 9 - Part II
 -    Imbalance ratio higher than 9 - Part III
 -    Multiple class imbalanced problems
 -    Noisy and Borderline Examples


Main Imbalance ratio between 1.5 and 9

From Fernández, A., García, S., del Jesus, M. J., and Herrera, F. 2008. A study of the behaviour of linguistic fuzzy rule based classification systems in the framework of imbalanced data-sets. Fuzzy Sets and Systems 159, 18 (Sep. 2008), 2378-2398.

Pdf

Below you can find all the Imbalanced data sets available with imbalance ratio between 1.5 and 9. For each data set, it is shown its name and its number of instances, attributes (Real/Integer/Nominal valued) and imbalance ratio value.

The table allows to download each data set in KEEL format (inside a ZIP file). Additionally, it is possible to obtain the data set already partitioned, by means of a 5-folds cross validation procedure.

By clicking in the column headers, you can order the table by names (alphabetically), by the number of examples, attributes or IR. Clicking again will sort the rows in reverse order.

Namedownarrow.png#Attributes (R/I/N)downarrow.png#Examplesdownarrow.pngIRuparrow.png Data set 5-fcv Header
glass19        (9/0/0)2141.82zip.gifzip.giftxt.png
ecoli-0_vs_17        (7/0/0)2201.86zip.gifzip.giftxt.png
wisconsin9        (0/9/0)6831.86zip.gifzip.giftxt.png
pima8        (8/0/0)7681.87zip.gifzip.giftxt.png
iris04        (4/0/0)1502zip.gifzip.giftxt.png
glass09        (9/0/0)2142.06zip.gifzip.giftxt.png
yeast18        (8/0/0)14842.46zip.gifzip.giftxt.png
haberman3        (0/3/0)3062.78zip.gifzip.giftxt.png
vehicle218        (0/18/0)8462.88zip.gifzip.giftxt.png
vehicle118        (0/18/0)8462.9zip.gifzip.giftxt.png
vehicle318        (0/18/0)8462.99zip.gifzip.giftxt.png
glass-0-1-2-3_vs_4-5-69        (9/0/0)2143.2zip.gifzip.giftxt.png
vehicle018        (0/18/0)8463.25zip.gifzip.giftxt.png
ecoli17        (7/0/0)3363.36zip.gifzip.giftxt.png
new-thyroid15        (4/1/0)2155.14zip.gifzip.giftxt.png
new-thyroid25        (4/1/0)2155.14zip.gifzip.giftxt.png
ecoli27        (7/0/0)3365.46zip.gifzip.giftxt.png
segment019        (19/0/0)23086.02zip.gifzip.giftxt.png
glass69        (9/0/0)2146.38zip.gifzip.giftxt.png
yeast38        (8/0/0)14848.1zip.gifzip.giftxt.png
ecoli37        (7/0/0)3368.6zip.gifzip.giftxt.png
page-blocks010        (4/6/0)54728.79zip.gifzip.giftxt.png
All data setszip.gif

Main Imbalance ratio higher than 9 - Part I

From Fernández, A., García, S., del Jesus, M. J., and Herrera, F. 2008. A study of the behaviour of linguistic fuzzy rule based classification systems in the framework of imbalanced data-sets. Fuzzy Sets and Systems 159, 18 (Sep. 2008), 2378-2398.

Pdf

From Fernández, A., del Jesus, M. J., and Herrera, F. 2009. Hierarchical fuzzy rule based classification systems with genetic rule selection for imbalanced data-sets. Int. J. Approx. Reasoning 50, 3 (Mar. 2009), 561-577.

Pdf

Below you can find the first block of the Imbalanced data sets available with imbalance ratio higher than 9. For each data set, it is shown its name and its number of instances, attributes (Real/Integer/Nominal valued) and imbalance ratio value.

The table allows to download each data set in KEEL format (inside a ZIP file). Additionally, it is possible to obtain the data set already partitioned, by means of a 5-folds cross validation procedure.

By clicking in the column headers, you can order the table by names (alphabetically), by the number of examples, attributes or IR. Clicking again will sort the rows in reverse order.

Namedownarrow.png#Attributes (R/I/N)downarrow.png#Examplesdownarrow.pngIRuparrow.png Data set 5-fcv Header
yeast-2_vs_48        (8/0/0)5149.08zip.gifzip.giftxt.png
yeast-0-5-6-7-9_vs_48        (8/0/0)5289.35zip.gifzip.giftxt.png
vowel013        (10/3/0)9889.98zip.gifzip.giftxt.png
glass-0-1-6_vs_29        (9/0/0)19210.29zip.gifzip.giftxt.png
glass29        (9/0/0)21411.59zip.gifzip.giftxt.png
shuttle-c0-vs-c49        (0/9/0)182913.87zip.gifzip.giftxt.png
yeast-1_vs_77        (7/0/0)45914.3zip.gifzip.giftxt.png
glass49        (9/0/0)21415.47zip.gifzip.giftxt.png
ecoli47        (7/0/0)33615.8zip.gifzip.giftxt.png
page-blocks-1-3_vs_410        (4/6/0)47215.86zip.gifzip.giftxt.png
abalone9-188        (7/0/1)73116.4zip.gifzip.giftxt.png
glass-0-1-6_vs_59        (9/0/0)18419.44zip.gifzip.giftxt.png
shuttle-c2-vs-c49        (0/9/0)12920.5zip.gifzip.giftxt.png
yeast-1-4-5-8_vs_78        (8/0/0)69322.1zip.gifzip.giftxt.png
glass59        (9/0/0)21422.78zip.gifzip.giftxt.png
yeast-2_vs_88        (8/0/0)48223.1zip.gifzip.giftxt.png
yeast48        (8/0/0)148428.1zip.gifzip.giftxt.png
yeast-1-2-8-9_vs_78        (8/0/0)94730.57zip.gifzip.giftxt.png
yeast58        (8/0/0)148432.73zip.gifzip.giftxt.png
ecoli-0-1-3-7_vs_2-67        (7/0/0)28139.14zip.gifzip.giftxt.png
yeast68        (8/0/0)148441.4zip.gifzip.giftxt.png
abalone198        (7/0/1)4174129.44zip.gifzip.giftxt.png
All data setszip.gif

Below you can find the second block of the Imbalanced data sets available with imbalance ratio higher than 9. For each data set, it is shown its name and its number of instances, attributes (Real/Integer/Nominal valued) and imbalance ratio value.

The table allows to download each data set in KEEL format (inside a ZIP file). Additionally, it is possible to obtain the data set already partitioned, by means of a 5-folds cross validation procedure.

By clicking in the column headers, you can order the table by names (alphabetically), by the number of examples, attributes or IR. Clicking again will sort the rows in reverse order.

Namedownarrow.png#Attributes (R/I/N)downarrow.png#Examplesdownarrow.pngIRuparrow.png Data set 5-fcv Header
ecoli-0-3-4_vs_57        (7/0/0)2009zip.gifzip.giftxt.png
ecoli-0-6-7_vs_3-57        (7/0/0)2229.09zip.gifzip.giftxt.png
ecoli-0-2-3-4_vs_57        (7/0/0)2029.1zip.gifzip.giftxt.png
glass-0-1-5_vs_29        (9/0/0)1729.12zip.gifzip.giftxt.png
yeast-0-3-5-9_vs_7-88        (8/0/0)5069.12zip.gifzip.giftxt.png
yeast-0-2-5-7-9_vs_3-6-88        (8/0/0)10049.14zip.gifzip.giftxt.png
yeast-0-2-5-6_vs_3-7-8-98        (8/0/0)10049.14zip.gifzip.giftxt.png
ecoli-0-4-6_vs_56        (6/0/0)2039.15zip.gifzip.giftxt.png
ecoli-0-1_vs_2-3-57        (7/0/0)2449.17zip.gifzip.giftxt.png
ecoli-0-2-6-7_vs_3-57        (7/0/0)2249.18zip.gifzip.giftxt.png
glass-0-4_vs_59        (9/0/0)929.22zip.gifzip.giftxt.png
ecoli-0-3-4-6_vs_57        (7/0/0)2059.25zip.gifzip.giftxt.png
ecoli-0-3-4-7_vs_5-67        (7/0/0)2579.28zip.gifzip.giftxt.png
ecoli-0-6-7_vs_56        (6/0/0)22010zip.gifzip.giftxt.png
ecoli-0-1-4-7_vs_2-3-5-67        (7/0/0)33610.59zip.gifzip.giftxt.png
led7digit-0-2-4-5-6-7-8-9_vs_17        (7/0/0)44310.97zip.gifzip.giftxt.png
glass-0-6_vs_59        (9/0/0)10811zip.gifzip.giftxt.png
ecoli-0-1_vs_56        (6/0/0)24011zip.gifzip.giftxt.png
glass-0-1-4-6_vs_29        (9/0/0)20511.06zip.gifzip.giftxt.png
ecoli-0-1-4-7_vs_5-66        (6/0/0)33212.28zip.gifzip.giftxt.png
cleveland-0_vs_413        (13/0/0)17712.62zip.gifzip.giftxt.png
ecoli-0-1-4-6_vs_56        (6/0/0)28013zip.gifzip.giftxt.png
All data setszip.gif

Below you can find the third block of the Imbalanced data sets available with imbalance ratio higher than 9. For each data set, it is shown its name and its number of instances, attributes (Real/Integer/Nominal valued) and imbalance ratio value.

The table allows to download each data set in KEEL format (inside a ZIP file). Additionally, it is possible to obtain the data set already partitioned, by means of a 5-folds cross validation procedure.

By clicking in the column headers, you can order the table by names (alphabetically), by the number of examples, attributes or IR. Clicking again will sort the rows in reverse order.

Namedownarrow.png#Attributes (R/I/N)downarrow.png#Examplesdownarrow.pngIRuparrow.png Data set 5-fcv Header
dermatology-634        (0/34/0)35816.9zip.gifzip.giftxt.png
zoo-316        (0/0/16)10119.2zip.gifzip.giftxt.png
shuttle-6_vs_2-39        (0/9/0)23022zip.gifzip.giftxt.png
lymphography-normal-fibrosis18        (0/3/15)14823.67zip.gifzip.giftxt.png
flare-F11        (0/0/11)106623.79zip.gifzip.giftxt.png
car-good6        (0/0/6)172824.04zip.gifzip.giftxt.png
car-vgood6        (0/0/6)172825.58zip.gifzip.giftxt.png
kr-vs-k-zero-one_vs_draw6        (0/0/6)290126.63zip.gifzip.giftxt.png
kr-vs-k-one_vs_fifteen6        (0/0/6)224427.77zip.gifzip.giftxt.png
winequality-red-411        (11/0/0)159929.17zip.gifzip.giftxt.png
poker-9_vs_710        (0/10/0)24429.5zip.gifzip.giftxt.png
kddcup-guess_passwd_vs_satan41        (26/0/15)164229.98zip.gifzip.giftxt.png
abalone-3_vs_118        (7/0/1)50232.47zip.gifzip.giftxt.png
winequality-white-9_vs_411        (11/0/0)16832.6zip.gifzip.giftxt.png
kr-vs-k-three_vs_eleven6        (0/0/6)293535.23zip.gifzip.giftxt.png
winequality-red-8_vs_611        (11/0/0)65635.44zip.gifzip.giftxt.png
abalone-17_vs_7-8-9-108        (7/0/1)233839.31zip.gifzip.giftxt.png
abalone-21_vs_88        (7/0/1)58140.5zip.gifzip.giftxt.png
winequality-white-3_vs_711        (11/0/0)90044zip.gifzip.giftxt.png
winequality-red-8_vs_6-711        (11/0/0)85546.5zip.gifzip.giftxt.png
kddcup-land_vs_portsweep41        (26/0/15)106149.52zip.gifzip.giftxt.png
abalone-19_vs_10-11-12-138        (7/0/1)162249.69zip.gifzip.giftxt.png
kr-vs-k-zero_vs_eight6        (0/0/6)146053.07zip.gifzip.giftxt.png
winequality-white-3-9_vs_511        (11/0/0)148258.28zip.gifzip.giftxt.png
poker-8-9_vs_610        (0/10/0)148558.4zip.gifzip.giftxt.png
shuttle-2_vs_59        (0/9/0)331666.67zip.gifzip.giftxt.png
winequality-red-3_vs_511        (11/0/0)69168.1zip.gifzip.giftxt.png
abalone-20_vs_8-9-108        (7/0/1)191672.69zip.gifzip.giftxt.png
kddcup-buffer_overflow_vs_back41        (26/0/15)223373.43zip.gifzip.giftxt.png
kddcup-land_vs_satan41        (26/0/15)161075.67zip.gifzip.giftxt.png
kr-vs-k-zero_vs_fifteen6        (0/0/6)219380.22zip.gifzip.giftxt.png
poker-8-9_vs_510        (0/10/0)207582zip.gifzip.giftxt.png
poker-8_vs_610        (0/10/0)147785.88zip.gifzip.giftxt.png
kddcup-rootkit-imap_vs_back41        (26/0/15)2225100.14zip.gifzip.giftxt.png
All data setszip.gif

Below you can find all the Multi-class Imbalanced data sets available. For each data set, it is shown its name and its number of instances, attributes (Real/Integer/Nominal valued) and imbalance ratio value.

The table allows to download each data set in KEEL format (inside a ZIP file). Additionally, it is possible to obtain the data set already partitioned, by means of a 5-folds cross validation procedure.

By clicking in the column headers, you can order the table by names (alphabetically), by the number of examples, attributes or IR. Clicking again will sort the rows in reverse order.

Namedownarrow.png#Attributes (R/I/N)downarrow.png#Examplesdownarrow.pngIRuparrow.png Data set 5-fcv Header
wine13        (13/0/0)1781.5zip.gifzip.giftxt.png
hayes-roth4        (0/4/0)1321.7zip.gifzip.giftxt.png
contraceptive9        (6/0/3)14731.89zip.gifzip.giftxt.png
penbased16        (16/0/0)11001.95zip.gifzip.giftxt.png
new-thyroid5        (4/1/0)2154.84zip.gifzip.giftxt.png
dermatology34        (0/34/0)3665.55zip.gifzip.giftxt.png
balance4        (4/0/0)6255.88zip.gifzip.giftxt.png
glass9        (9/0/0)2148.44zip.gifzip.giftxt.png
autos25        (15/0/10)15916zip.gifzip.giftxt.png
yeast8        (8/0/0)148423.15zip.gifzip.giftxt.png
thyroid21        (6/0/15)72036.94zip.gifzip.giftxt.png
lymphography18        (3/0/15)14840.5zip.gifzip.giftxt.png
ecoli7        (7/0/0)33671.5zip.gifzip.giftxt.png
pageblocks10        (10/0/0)548164zip.gifzip.giftxt.png
shuttle9        (0/9/0)2175853zip.gifzip.giftxt.png
All data setszip.gif

Main Noisy and Borderline Examples

From K. Napierala, J. Stefanowski, S. Wilk. Learning from Imbalanced Data in Presence of Noisy and Borderline Examples. 7th International Conference on Rough Sets and Current Trends in Computing (RSCTC2010). LNCS 6086, Springer 2010, Warsaw (Poland, 2010) 158-167.

Pdf

Below you can find several synthetic Imbalanced data sets used in the above paper and whose examples are divided into 3 categories by the authors: safe, borderline and noisy examples.

   - Borderline examples are located in the area surrounding class boundaries, where the minority and majority classes overlap.
   - Safe examples are placed in relatively homogeneous areas with respect to the class label.
   - Noisy examples are individuals from one class occurring in safe areas of the other class.

For each data set, it is shown its name and its number of instances, attributes (Real/Integer/Nominal valued) and imbalance ratio value.

The table allows to download each data set in KEEL format (inside a ZIP file). Additionally, it is possible to obtain the data set already partitioned, by means of a 5-folds cross validation procedure.

By clicking in the column headers, you can order the table by names (alphabetically), by the number of examples, attributes or IR. Clicking again will sort the rows in reverse order.

Namedownarrow.png#Attributes (R/I/N)downarrow.png#Examplesdownarrow.pngIRuparrow.png Data set 5-fcv Header
paw02a-600-5-70-BI2        (2/0/0)6005zip.gifzip.giftxt.png
paw02a-600-5-60-BI2        (2/0/0)6005zip.gifzip.giftxt.png
paw02a-600-5-50-BI2        (2/0/0)6005zip.gifzip.giftxt.png
paw02a-600-5-30-BI2        (2/0/0)6005zip.gifzip.giftxt.png
paw02a-600-5-0-BI2        (2/0/0)6005zip.gifzip.giftxt.png
04clover5z-600-5-70-BI2        (2/0/0)6005zip.gifzip.giftxt.png
04clover5z-600-5-60-BI2        (2/0/0)6005zip.gifzip.giftxt.png
04clover5z-600-5-50-BI2        (2/0/0)6005zip.gifzip.giftxt.png
04clover5z-600-5-30-BI2        (2/0/0)6005zip.gifzip.giftxt.png
04clover5z-600-5-0-BI2        (2/0/0)6005zip.gifzip.giftxt.png
03subcl5-600-5-70-BI2        (2/0/0)6005zip.gifzip.giftxt.png
03subcl5-600-5-60-BI2        (2/0/0)6005zip.gifzip.giftxt.png
03subcl5-600-5-50-BI2        (2/0/0)6005zip.gifzip.giftxt.png
03subcl5-600-5-0-BI2        (2/0/0)6005zip.gifzip.giftxt.png
03subcl5-600-5-30-BI2        (2/0/0)6005zip.gifzip.giftxt.png
paw02a-800-7-60-BI2        (2/0/0)8007zip.gifzip.giftxt.png
paw02a-800-7-50-BI2        (2/0/0)8007zip.gifzip.giftxt.png
paw02a-800-7-30-BI2        (2/0/0)8007zip.gifzip.giftxt.png
paw02a-800-7-0-BI2        (2/0/0)8007zip.gifzip.giftxt.png
04clover5z-800-7-70-BI2        (2/0/0)8007zip.gifzip.giftxt.png
04clover5z-800-7-60-BI2        (2/0/0)8007zip.gifzip.giftxt.png
04clover5z-800-7-50-BI2        (2/0/0)8007zip.gifzip.giftxt.png
04clover5z-800-7-30-BI2        (2/0/0)8007zip.gifzip.giftxt.png
04clover5z-800-7-0-BI2        (2/0/0)8007zip.gifzip.giftxt.png
03subcl5-800-7-70-BI2        (2/0/0)8007zip.gifzip.giftxt.png
03subcl5-800-7-60-BI2        (2/0/0)8007zip.gifzip.giftxt.png
03subcl5-800-7-50-BI2        (2/0/0)8007zip.gifzip.giftxt.png
03subcl5-800-7-30-BI2        (2/0/0)8007zip.gifzip.giftxt.png
03subcl5-800-7-0-BI2        (2/0/0)8007zip.gifzip.giftxt.png
paw02a-800-7-70-BI2        (2/0/0)8007zip.gifzip.giftxt.png
All data setszip.gif

This subsection contains a collection of some of the previous data sets already preprocessed by several oversampling techniques. For each technique, a ZIP file containing 5-folds cross validation partitions for each of the data sets of this page is provided. Moreover, a brief description and references about each method can be found below:

Imbalance ratio between 1.5 and 9

Type of preprocessingData sets
SMOTEzip.gif
SMOTE+ENNzip.gif
SMOTE+Tomek Linkszip.gif

Imbalance ratio higher than 9 - Part I

Type of preprocessingData sets
SMOTEzip.gif
SMOTE+ENNzip.gif
SMOTE+Tomek Linkszip.gif
SMOTE-RSB*zip.gif

Imbalance ratio higher than 9 - Part II

Type of preprocessingData sets
SMOTEzip.gif
SMOTE+ENNzip.gif
SMOTE+Tomek Linkszip.gif
Bordeline 1zip.gif
Bordeline 2zip.gif
SafeLevelszip.gif
SMOTE-RSB*zip.gif

  • SMOTE: The Synthetic Minority Over-sampling Technique (Chawla et al, 2002) is an oversampling technique of the minority class. It works by taking each minority class sample and introducing synthetic examples along the line segments joining any/all of the k minority class nearest neighbours.
  • SMOTE+ENN: This method consists of the application of the Edited Nearest Neighbor rule (ENN, Wilson, 1972) as cleaning method over the data set obtained by the application of SMOTE. It was proposed by Batista et al, 2004, where the use of 3 neighbors for ENN is suggested.
  • SMOTE+Tomek Links: This method consists of the application of Tomek Links (Tomek, 1976) as cleaning method over the data set obtained by the application of SMOTE. It was proposed by Batista et al, 2004.
  • Bordeline: This methods only oversample or strengthen the borderline minority examples (Han et al, 2005). First, it finds out the borderline minority examples P; then, synthetic examples are generated from them and are added to the original training set. This method, for every minority examples (pi) calculate its m nearest neighbors from the whole training set. The number of majority examples among the m nearest neighbors is n. If all the m nearest neighbors are majority examples, pi is considered to be noise and is not operated in the following step. If m/2 <= n < m, namely the number of pi's majority nearest neighbors is larger than the number of its minority ones, pi is considered to be easily misclassified and put into a set called DANGER. If 0 <= n < m/2, pi is safe and does not need to participate in the following steps. The examples in the DANGER set are the borderline data of the minority class P. For each example in DANGER, we calculate its k nearest neighbors from P and we operate similarly to SMOTE.
  • SafeLevels: This method (Bunkhumpornpat et al, 2009) computes for each positive instance its safe level before generating synthetic instances. Each synthetic instance is positioned closer to the largest safe level, so all synthetic instances are generated only in safe regions.
  • SMOTE-RSB*: This method (Ramentol et al, 2011) first applies the SMOTE algorithm, and then, it only selects the minority synthetic examples that belong to the lower approximation using Rough Set Theory (Pawlak, 1982). This process is repeated until the training set is balanced.

Collecting Data Sets

If you have some example data sets and you would like to share them with the rest of the research community by means of this page, please be so kind as to send your data to the Webmaster Team with the following information:

  • People answerable for the data (full name, affiliation, e-mail, web page, ...).
  • training and test data sets considered, preferably in ASCII format.
  • A brief description of the application.
  • References where it is used.
  • Results obtained by the methods proposed by the authors or used for comparison.
  • Type of experiment developed.
  • Any additional useful information.

Collecting Results

If you have applied your methods to some of the problems presented here we will be glad of showing your results in this page. Please be so kind as to send the following information to Webmaster Team:

  • Name of the application considered and type of experiment developed.
  • Results obtained by the methods proposed by the authors or used for comparison.
  • References where the results are shown.
  • Any additional useful information.

Contact Us

If you are interested on being informed of each update made in this page or you would like to comment on it, please contact with the Webmaster Team.



 
 Copyright 2004-2018, KEEL (Knowledge Extraction based on Evolutionary Learning)
About the Webmaster Team
Valid XHTML 1.1   Valid CSS!