Feature Selection for Density Level-Sets

Marius Kloft, Machine Learning Group, Technical University of Berlin, Germany
Shinichi Nakajima, Optical Research Laboratory, Nikon Corporation, Tokyo, Japan
Ulf Brefeld, Machine Learning Group, Technical University of Berlin, Germany

Links

Session:
Springer Link:

Abstract

A frequent problem in density level-set estimation is the choice of the right features that give rise to compact and concise representations of the observed data. We present an efficient feature selection method for density level-set estimation where optimal kernel mixing coefficients and model parameters are determined simultaneously. Our approach generalizes one-class support vector machines and can be equivalently expressed as a semi-infinite linear program that can be solved with interleaved cutting plane algorithms. The experimental evaluation of the new method on network intrusion detection and object recognition tasks demonstrate that our approach not only attains competitive performance but also spares practitioners from a priori decisions on feature sets to be used.