To access the full text documents, please follow this link: http://hdl.handle.net/2117/16872

Comparing error minimized extreme learning machines and support vector sequential feed-forward neural networks
Romero Merino, Enrique; Alquézar Mancho, René
Universitat Politècnica de Catalunya. Departament de Llenguatges i Sistemes Informàtics; Universitat Politècnica de Catalunya. SOCO - Soft Computing
Recently, error minimized extreme learning machines (EM-ELMs) have been proposed as a simple and efficient approach to build single-hidden-layer feed-forward networks (SLFNs) sequentially. They add random hidden nodes one by one (or group by group) and update the output weights incrementally to minimize the sum-of-squares error in the training set. Other very similar methods that also construct SLFNs sequentially had been reported earlier with the main difference that their hidden-layer weights are a subset of the data instead of being random. These approaches are referred to as support vector sequential feed-forward neural networks (SV-SFNNs), and they are a particular case of the sequential approximation with optimal coefficients and interacting frequencies (SAOCIF) method. In this paper, it is firstly shown that EM-ELMs can also be cast as a particular case of SAOCIF. In particular, EM-ELMs can easily be extended to test some number of random candidates at each step and select the best of them, as SAOCIF does. Moreover, it is demonstrated that the cost of the computation of the optimal outputlayer weights in the originally proposed EM-ELMs can be improved if it is replaced by the one included in SAOCIF. Secondly, we present the results of an experimental study on 10 benchmark classification and 10 benchmark regression data sets, comparing EM-ELMs and SV-SFNNs, that was carried out under the same conditions for the two models. Although both models have the same (efficient) computational cost, a statistically significant improvement in generalization performance of SV-SFNNs vs. EM-ELMs was found in 12 out of the 20 benchmark problems.
Peer Reviewed
Àrees temàtiques de la UPC::Informàtica::Informàtica teòrica
Machine learning
Approximation theory
Regression analysis
Support vector machines
Error minimized extreme learning machines
Sequential approximations
Support vector sequential feed-forward neural networks
Aprenentatge automàtic
Aproximació, Teoria de l'
Anàlisi de regressió
info:eu-repo/semantics/publishedVersion
Article
         

Show full item record

Related documents

Other documents of the same author

Arizmendi Pereira, Carlos Julio; Romero Merino, Enrique; Alquézar Mancho, René; Caminal Magrans, Pere; Díaz, Ivan; Benito, Salvador; Giraldo Giraldo, Beatriz
Paz Ortiz, Iván; Nebot Castells, M. Àngela; Múgica Álvarez, Francisco; Romero Merino, Enrique
Ribas Ripoll, Vicent; Wojdel, Anna; Ramos, Pablo; Romero Merino, Enrique; Brugada Terradellas, Josep
Buchaca, David; Romero Merino, Enrique; Mazzanti Castrillejo, Fernando Pablo; Delgado Pin, Jordi
 

Coordination

 

Supporters