Mutual Information-based Multi-label Feature Selection using Interaction Information

Multi-label feature selection is regarded as one of the most promising techniques that can be used to maximize the efficacy and efficiency of multi-label classification. However, because multi-label feature selection algorithms must consider multiple labels concurrently, the task is more difficult than singlelabel feature selection tasks. In this paper, we propose the Mutual Information-based multi-label feature selection method using interaction information. This method is naturally able to measure dependencies among multiple variables. To develop an efficient multi-label feature selection method, we derive theoretical bounds for the interaction information. Empirical studies indicate that our proposed multi-label feature selection method discovers effective feature subsets for multi-label classification problems.
Information Title Page
This program is designed to perform the feature selection for multi-label data set. This method deals with standard multi-label data set, in which the number of given label is larger than one.

The main technical ideas behind how this program works appear in this paper:
Jaesung Lee and Dae-Won Kim, "Mutual Information-based Multi-label Feature Selection using Interaction Information," Expert System with Applications, 42, 2015.

This software is a Matlab implementation of proposed method, highy specialized on problems of categorical data set classification. The original version of this program was written by Jaesung Lee.
Bibtex Code
@article{lee2015mutual,
  title={Mutual Information-based multi-label feature selection using interaction information},
  author={Lee, Jaesung and Kim, Dae-Won},
  journal={Expert Systems with Applications},
  volume={42},
  number={4},
  pages={2013--2025},
  year={2015},
  publisher={Elsevier}
}
Terms and Usage
This program is available for download for non-commercial use, licensed under the GNU General Public License, which is allows its use for research purposes or other free software projects but does not allow its incorporation into any type of commerical software.

Download Feature Selection Program for Discretized Multi-label Data (2017-06-08)

The zipped package includes componenets for source files and a sample input file.
Sample Input and Output
It will return the index of input features in orders of approximated conditional dependency, named for user-specified variable. This code can executed under Matlab command window.

[Usage]:
   >> idx = d2f( features, labels, f_nums );

[Description]
   features - a matrix that is composed of features
   labels - a matrix represents labels of each pattern is assigned to
   f_nums - the number of features to be selected

By convention in the input features matrix, rows represent data (e.g. patterns) and columns represent features.