Decomposition Algorithms for Training Large-scale Semiparametric Support Vector Machines

Sangkyun Lee, Computer Sciences Department, University of Wisconsin-Madison, USA
Stephen Wright, Computer Sciences Department, University of Wisconsin-Madison, USA

Links

Session:
Springer Link:

Abstract

We describe a method for solving large-scale semiparametric support vector machines (SVMs) for regression problems. Most of the approaches proposed to date for large-scale SVMs cannot accommodate the multiple equality constraints that appear in semiparametric problems. Our approach uses a decomposition framework, with a primal-dual algorithm to find an approximate saddle point for the min-max formulation of each subproblem. We compare our method with algorithms previously proposed for semiparametric SVMs, and show that it scales well as the number of training examples grows.