Open Access Open Access  Restricted Access Subscription Access
Open Access Open Access Open Access  Restricted Access Restricted Access Subscription Access

Optimum Parameters Selection Using Bacterial Foraging Optimization for Weighted Extreme Learning Machine


Affiliations
1 Department of Computer Applications, Arignar Anna Government Arts College, India
     

   Subscribe/Renew Journal


Extreme Learning Machine (ELM) is a Single Layer Feed Forward Network (SLFN) model with extremely learning capacity and good generalization capabilities. Generally, the performance of ELM for classification task highly based on three factors such as the input weight matrix, the value of bias and the number of hidden neurons presented. ELM randomly chooses the input weights and biases and determines analytically the weights as output. The random selection of biases and the input weight produce an unforeseen result which causes training error and also produces lesser prediction accuracy. Bacterial Foraging Optimization algorithm (BFOA) was used to find the optimum input weight and hidden bias values for ELM. With the unequal distribution of classes in imbalanced data sets, ELM algorithms tussle to find good accuracy. So, ELM algorithm doesn’t get the necessary information about the minority class to make an accurate classification. To deal the issues associated with ELM, in this paper the hybrid algorithms Weighted ELM and Weighted ELM with BFO are proposed. Weighted ELM is proposed to handle the classification data that has imbalanced nature of class distribution. The main objective of weighted ELM is that the related weight value is computed and assigned for each training sample to increase the classification rate. Bacterial Foraging Optimization method is also integrated with the weighted ELM to find the optimum input weight and bias to maximize the classification accuracy. The comparative analysis has been performed over Hepatitis dataset. Further, the experimental results clearly revealed that one of the proposed methods Weighted ELM with BFO performs quite well when compared to others.

Keywords

ELM, Weighted ELM, Bacterial Foraging Optimization, Initial Weight, Bias.
Subscription Login to verify subscription
User
Notifications
Font Size

  • Richard O. Duda, Peter E. Hart and David G. Stork, “Pattern Classification”, 2nd Edition, Wiley-Interscience, 2001.
  • C. Bishop, “Neural Networks for Pattern Recognition”, Oxford: University Press, 1995.
  • L. Fausett, “Fundamentals of Neural Networks”, Prentice Hall, 1994.
  • G. Huang, Q. Zhu and C. Siew, “Extreme Learning Machine: Theory and Applications”, Neurocomputing, Vol. 70, No. 1-3, pp. 489-501, 2006.
  • G. Huang, Q. Zhu and C. Siew, “Extreme Learning Machine: A New Learning Scheme of Feedforward Neural Networks”, Neural Networks, Vol. 2, pp. 985-990, 2004.
  • Omer Faruk Ertugrul and Yılmaz Kaya, “A Detailed Analysis on Extreme Learning Machine and Novel Approaches Based on ELM”, American Journal of Computer Science, Vol. 1, No. 5, pp. 43-50, 2014.
  • G. Huang, Q. Zhu and C. Siew, “Extreme Learning Machine: Theory and Applications”, Neurocomputing, Vol. 70, No. 1-3, pp. 489-501, 2006.
  • H.J. Bremermann, “Chemotaxis and Optimization”, Journal of the Franklin Institute, Vol. 297, pp. 397-404, 1974.
  • K.M. Passino, “Biomimicry of Bacterial Foraging for Distributed Optimization and Control”, IEEE Control Systems, Vol. 22, No. 3, pp. 52-67, 2001.
  • Jae Hoon Cho and Dae-Jong Lee, “Parameter Optimization of Extreme Learning Machine using Bacterial Foraging Algorithm”, Journal of Korean Institute of Intelligent Systems, Vol. 17, No. 2, pp. 807-812, 2007.
  • Sunday Olusanya Olatunji, “Sensitivity-Based Linear Learning Method And Extreme Learning Machines Compared For Software Maintainability Prediction of Object-Oriented Software Systems”, ICTACT Journal on Soft Computing, Vol. 3, No. 3, pp. 514-523, 2013.
  • Sunday Olusanya Olatunji and Hossain Arif, “Identification of Skin Diseases using Extreme Learning Machine and Artificial Neural Network”, ICTACT Journal on Soft Computing, Vol. 4, No. 1, pp. 627-632, 2013.
  • R. Vijay, “Intelligent Bacterial Foraging Optimization Technique to Economic Load Dispatch Problem”, International Journal of Soft Computing and Engineering, Vol. 2, No. 2, pp. 55-59 , 2012.
  • Hanning Chen, Yunlong Zhu and Kunyuan Hu, “Adaptive Bacterial Foraging Optimization”, Abstract and Applied Sciences, Vol. 2011, pp. 1-27, 2011.
  • Swagatam Dass, Arijit Biswas et al., “Bacterial Foraging Optimization Algorithm: Theoretical Foundations, Analysis and Applications”, Foundation of Computer Intelligence, Vol. 3, pp. 23-55, 2009.
  • Vipul Sharma, S.S. Pattnaik and T. Garg, “A Review of Bacterial Foraging Optimization and its Application”, Proceedings of National Conference on Future Aspects of Artificial intelligence in Industrial Automation, pp. 9-12, 2012.
  • W. Zong, G.B. Huang and Y. Chen, “Weighted Extreme Learning Machine for Imbalance Learning”, Neurocomputing, Vol. 101, pp. 229-242, 2013.
  • Kai Hu et al., “An Optimization Strategy for Weighted Extreme Learning Machine based on PSO”, International Journal of Pattern Recognition and Artificial Intelligence, Vol. 31, No. 1, pp. 1-16, 2017.
  • Hepatitis, Available at https://archive.ics.uci.edu/ml/datasets/hepatitis

Abstract Views: 176

PDF Views: 3




  • Optimum Parameters Selection Using Bacterial Foraging Optimization for Weighted Extreme Learning Machine

Abstract Views: 176  |  PDF Views: 3

Authors

S. Priya
Department of Computer Applications, Arignar Anna Government Arts College, India
R. Manavalan
Department of Computer Applications, Arignar Anna Government Arts College, India

Abstract


Extreme Learning Machine (ELM) is a Single Layer Feed Forward Network (SLFN) model with extremely learning capacity and good generalization capabilities. Generally, the performance of ELM for classification task highly based on three factors such as the input weight matrix, the value of bias and the number of hidden neurons presented. ELM randomly chooses the input weights and biases and determines analytically the weights as output. The random selection of biases and the input weight produce an unforeseen result which causes training error and also produces lesser prediction accuracy. Bacterial Foraging Optimization algorithm (BFOA) was used to find the optimum input weight and hidden bias values for ELM. With the unequal distribution of classes in imbalanced data sets, ELM algorithms tussle to find good accuracy. So, ELM algorithm doesn’t get the necessary information about the minority class to make an accurate classification. To deal the issues associated with ELM, in this paper the hybrid algorithms Weighted ELM and Weighted ELM with BFO are proposed. Weighted ELM is proposed to handle the classification data that has imbalanced nature of class distribution. The main objective of weighted ELM is that the related weight value is computed and assigned for each training sample to increase the classification rate. Bacterial Foraging Optimization method is also integrated with the weighted ELM to find the optimum input weight and bias to maximize the classification accuracy. The comparative analysis has been performed over Hepatitis dataset. Further, the experimental results clearly revealed that one of the proposed methods Weighted ELM with BFO performs quite well when compared to others.

Keywords


ELM, Weighted ELM, Bacterial Foraging Optimization, Initial Weight, Bias.

References