MPCA META-HEURISTICS FOR AUTOMATIC ARCHITECTURE OPTIMIZATION OF A SUPERVISED ARTIFICIAL NEURAL NETWORK

MPCA META-HEURISTICS FOR AUTOMATIC ARCHITECTURE OPTIMIZATION OF A SUPERVISED ARTIFICIAL NEURAL NETWORK

Sambatti, S. B. M.; Anochi, J. A.; Luz, E. F. Pacheco da; Carvalho, A. R.; Shiguemori, E.; Velho, H. F. Campos

Full Article:

Artificial neural networks (ANN) has been studied intensively, but there still are many unresolved issues. The search and definition of an optimal architecture remains a very relevant ANN research topic. The search space of neural network topology, each point rep- resents a possible architecture. Associating each point to a performance level relies on the a priori establishment of some optimality criterion. Here, a new meta-heuristics, multi-particle collision algorithm (MPCA) was applied to design an optimum architecture for a supervised ANN. The MPCA optimization algorithm emulates a collision process of multiple particles inspired in processes of a neutron traveling in a nuclear reactor. The multilayer perceptron (MLP) was the neural network adopted here, and backpropagation strategy was used for calculating of the weight of connections to the MLP-NN. The MLP-NN configured by this op- timal or inverse designs was applied to predict the seasonal mesoscale climate. The dataset for trainning is obtained from NCEP-NOAA reanalysis and from a metherological model. In order to reduce the dimension of the search space to find the optimized ANN, it is considered the following: three activation functions, up to three hidden layers, and up to 32 neurons per hidden layer. The comparison is performed between the ANN configuration obtained by automatic process and another configuration proposed by a human specialist.

Artificial neural networks (ANN) has been studied intensively, but there still are many unresolved issues. The search and definition of an optimal architecture remains a very relevant ANN research topic. The search space of neural network topology, each point rep- resents a possible architecture. Associating each point to a performance level relies on the a priori establishment of some optimality criterion. Here, a new meta-heuristics, multi-particle collision algorithm (MPCA) was applied to design an optimum architecture for a supervised ANN. The MPCA optimization algorithm emulates a collision process of multiple particles inspired in processes of a neutron traveling in a nuclear reactor. The multilayer perceptron (MLP) was the neural network adopted here, and backpropagation strategy was used for calculating of the weight of connections to the MLP-NN. The MLP-NN configured by this op- timal or inverse designs was applied to predict the seasonal mesoscale climate. The dataset for trainning is obtained from NCEP-NOAA reanalysis and from a metherological model. In order to reduce the dimension of the search space to find the optimized ANN, it is considered the following: three activation functions, up to three hidden layers, and up to 32 neurons per hidden layer. The comparison is performed between the ANN configuration obtained by automatic process and another configuration proposed by a human specialist.

Palavras-chave:

DOI: 10.5151/meceng-wccm2012-19075

Como citar:

Sambatti, S. B. M.; Anochi, J. A.; Luz, E. F. Pacheco da; Carvalho, A. R.; Shiguemori, E.; Velho, H. F. Campos; "MPCA META-HEURISTICS FOR AUTOMATIC ARCHITECTURE OPTIMIZATION OF A SUPERVISED ARTIFICIAL NEURAL NETWORK", p-2930-2939. In: In Proceedings of the 10th World Congress on Computational Mechanics [= Blucher Mechanical Engineering Proceedings, v. 1, n. 1]. São Paulo: Blucher, 2014.
ISSN 23580828, DOI 10.5151/meceng-wccm2012-19075