On the use of the Spectral Projected Gradient method for Support Vector Machines

AUTOR(ES)

Cores, Debora, Escalante, René, González-Lima, María, Jimenez, Oswaldo

FONTE

Computational & Applied Mathematics

DATA DE PUBLICAÇÃO

2009

RESUMO

In this work we study how to solve the SVM optimization problem by using the Spectral Projected Gradient (SPG) method with three different strategies for computing the projection onto the constrained set. One of the strategies is based on Dykstra's alternating projection algorithm since there is not a mathematical equation for the projection onto the whole constrained set but the projection on each restriction is easy to compute with exact formulations. We present another strategy based on the Karush-Kunh-Tucker optimality conditions, we call it the Projected-KKT algorithm. We compare these strategies with a third one proposed by Dai and Fletcher. The three schemes are low computational cost and their use within the SPG algorithm leads to a solution of the SVM problem. We study the computational performance of the three strategies when solving randomly generated as well as real life SVM problems. The numerical results show that Projected-KKT is competitive in general with the Dai and Fletcher algorithm, and it is more efficient for some specific problems. They both outperform Dykstra's algorithm in all the tests.

Documentos Relacionados

• Spectral projected gradient method for the procrustes problem
• On the convergence properties of the projected gradient method for convex optimization
• Support Vector Machines for predicting protein structural class
• Support vector machines na classificação de imagens hiperespectrais
• Profiled support vector machines for antisense oligonucleotide efficacy prediction