Semi-supervised GSOM integrated with extreme learning machine

Abstract

Semi-supervised learning with a growing self-organizing map (GSOM) is commonly used to cope with the machine learning problems. The performance of semi-supervised GSOM is associated with the structure of clustering layer, the activation level, and the weights of a classifier. Current methods have been advocated to calibrate the GSOM parameters based on local point approach. The local point approach is associated with structure of dataset. On the other hand, the semi-supervised GSOM output is so closely intertwined with problem inputs. This paper present an analytical semi-supervised learning method based on GSOM and extreme learning machine. Extreme learning machine was used to exploit the substantial classification response. However, the learning of GSOM parameters was eliminated with use of the extreme learning machine. Furthermore, the sequential extreme learning machine was implemented to achieve an online semi-supervised GSOM for streaming dataset. This study showed the proposed method converges to optimum response regardless to structure of dataset. The proposed method was applied on the online and partially labeled dataset. Online semi-supervised GSOM integrated with extreme learning machine achievement implies that the F-measure of proposed method is more precise than the conventional semi-supervised GSOM.

Keywords

Semi-supervised learning GSOM extreme learning machine online learning

References

Zhu

and Goldberg

A.B.

, Introduction to semi-supervised learning, Synthesis Lectures on Artificial Intelligence and Machine Learning 3(1) (2009), 1-130.

Macario

and de Carvalho

F.d.A.

, An adaptive semi-supervised fuzzy clustering algorithm based on objective function optimization, in: Fuzzy Systems (FUZZ-IEEE), 2012 IEEE International Conference on, IEEE, (2012).

Leite

, Costa

and Gomide

, Evolving granular neural network for semi-supervised data stream classification, in: Neural Networks (IJCNN), The 2010 International Joint Conference on, IEEE, (2010).

Halkidi

, Spiliopoulou

and Pavlou

, A semi-supervised incremental clustering algorithm for streaming data, in: Advances in Knowledge Discovery and Data Mining, Springer, (2012), 578-590.

Cong

et al., Self-supervised online metric learning with low rank constraint for scene categorization, (2013).

Farid

D.M.

et al., An adaptive ensemble classifier for mining concept drifting data streams, Expert Syst Appl 40(15) (2013), 5895-5906.

et al., A semi-supervised extreme learning machine method based on co-training? Journal of Computational Information Systems 9(1) (2013), 207-214.

Zhang

et al., Semi-supervised learning combining co-training with active learning, Expert Systems with Applications 41(5) (2014), 2372-2378.

Dornaika

and El Traboulsi

, Learning flexible graph-based semi-supervised embedding (2015).

10.

Jia

et al., A semi-supervised online sequential extreme learning machine method, in: Proceedings of ELM-2014, Springer 1 (2015), 301-310.

11.

Hsu

and Halgamuge

S.K.

, Class structure visualization with semi-supervised growing self-organizing maps, Neurocomputing 71(16) (2008), 3124-3130.

12.

Huang

G.-B.

, Zhu

Q.-Y.

and Siew

C.-K.

, Extreme learning machine: S new learning scheme of feedforward neural networks, in: Neural Networks, 2004 Proceedings 2004 IEEE International Joint Conference on, IEEE, (2004).

13.

Huang

G.-B.

et al., Incremental extreme learning machine with fully complex hidden nodes, Neurocomputing 71(4) (2008), 576-583.

14.

Guo

, Hao

J.-H.

and Liu

, An incremental extreme learning machine for online sequential learning problems, Neurocomputing (2013).

15.

Grira

, Crucianu

and Boujemaa

, Active semi-supervised fuzzy clustering, Pattern Recognition 41(5) (2008), 1834-1844.

16.

Geng

, Zhan

D.-C.

and Zhou

Z.-H.

, Supervised nonlinear dimensionality reduction for visualization and classification, Systems, Man and Cybernetics, Part B: Cybernetics, IEEE Transactions on 35(6) (2005), 1098-1107.