A stacking-based ensemble learning model for kneading paste quality intelligent prediction: A real case study

Abstract

Paste kneading is a vital process of prebaked carbon anode production, and the quality of the paste has a great impact on the quality of the final product. However, it is difficult to inspect the paste quality in line. Because the inspection of the paste quality in the laboratory is not real-time, the paste has already entered the next process after the results are obtained. And the manual quality inspection is labor-intensive and unsafe. Therefore, a stacking-based ensemble learning model for kneading paste quality prediction is proposed in this paper. The gradient boosting decision tree, random forest, k-nearest neighbors, and support vector machine are used as base learners, and logistic regression is used as meta-learner. Kneading production data of 572 paste pots are collected for quality prediction, where each pot of paste data contains 44 signals. The correlation coefficient-based feature engineering method was applied, and 10 features with the greatest correlation with paste quality were identified to construct the dataset. The up-sampling and under-sampling methods are used to solve the problem of sample imbalance. Parallel comparison is applied to verify the advantage of the stacking-based ensemble learning model, and the results indicate that the model performs better than every single classifier and has higher accuracy and generalization ability, especially for imbalanced samples.

Keywords

Quality prediction ensemble learning stacking imbalance sample

Get full access to this article

View all access options for this article.

References

Dasarathy

Sheela

. A composite classifier system design: concepts and methodology. Proc IEEE 1979; 67: 708–713.

Dietterich

. Ensemble methods in machine learning. In: Kittler

Roli

(eds.), Multiple classifier systems MCS. Berlin, Heidelberg: Springer, 2000, pp.1–15.

Freund

Schapire

. A decision-theoretic generalization of on-line learning and an application to boosting. J Comput Syst Sci 1997; 55: 119–139.

Breiman

. Bagging predictors. Mach Learn 1996; 24: 123–140.

Wolpert

. Stacked generalization. Neural Netw 1992; 5: 241–259.

Dong

Cao

, et al. A survey on ensemble learning. Front Comput Sci Chi 2020; 14: 241–258.

Lazzarini

Tianfield

Charissis

. A stacking ensemble of deep learning models for IoT intrusion detection. Knowl Based Syst 2023; 279: 110941.

Cao

Zhang

, et al. A homogeneous stacking ensemble learning model for fault diagnosis of rotating machinery with small samples. IEEE Sens J 2022; 22: 8944–8959.

Ribeiro

MHDM

Da Silva

Moreno

, et al. Efficient bootstrap stacking ensemble learning model applied to wind power generation forecasting. Int J Elec Power 2022; 136: 107712.

10.

Wei

. Material removal rate prediction in chemical mechanical planarization with conditional probabilistic autoencoder and stacking ensemble learning. J Intell Manuf 2022; 35: 115–127.

11.

Tao

Dong

, et al. Stacking-based multi-features fusion ensemble learning for product quality prediction. In: 2022 IEEE international conference on e-business engineering (ICEBE), Bournemouth, United Kingdom, 2022, pp.58–65. New York: IEEE.

12.

Ganaie

Malik

, et al. Ensemble deep learning: a review. Eng Appl Artif Intel 2022; 115: 105151.

13.

Jebamalar

Kamalakannan

. Enhanced stacking ensemble model in predictive analytics of environmental sensor data. In: 2021 international conference on artificial intelligence and smart systems (ICAIS), Coimbatore, India, 2021, pp. 482–486. New York: IEEE.

14.

Hou

Liu

Yang

. Real-time prediction of rock mass classification based on TBM operation big data and stacking technique of ensemble learning. J Rock Mech Geotech 2022; 14: 123–143.

15.

Huang

Cai

Pacheco

, et al. Applications of support vector machine (SVM) learning in cancer genomics. Cancer Genom Proteom 2018; 15: 41–51.

16.

Zhang

Zong

, et al. Efficient kNN classification with different numbers of nearest neighbors. IEEE Trans Neural Netw Learn Syst 2017; 29: 1774–1785.

17.

Meng

Finley

, et al. LightGBM: a highly efficient gradient boosting decision tree. Adv Neural Inf Process 2017; 30: 3149–3157.

18.

Breiman

. Random forests. Mach Learn 2001; 45: 5–32.

19.

Azari

Alamdari

Aryanpour

, et al. Mixing variables for prebaked anodes used in aluminum production. Powder Technol 2013; 235: 341–348.

20.

Belitskus

. Effects of mixing variables and mold temperature on prebaked anode quality. In: Tomsett

Johnson

(eds.), Essential readings in light metals. Cham: Springer, 2016, pp.328–332.

21.

Huai

Shanhong

, et al. Comparison of mixing process methods in prebaked anode production. In: Sadler

(ed.) Light metals 2013. The minerals, metals & materials series. Cham: Springer, 2016, pp.1127–1130.

22.

Abanda

Mori

Lozano

. A review on distance based time series classification. Data Min Knowl Discov 2019; 33: 378–412.

23.

Ruiz

Flynn

Large

, et al. The great multivariate time series classification bake off: a review and experimental evaluation of recent algorithmic advances. Data Min Knowl Discov 2021; 35: 401–449.

24.

Johnston

Arnold

, et al. Protein sequence design with deep generative models. Curr Opin Chem Biol 2021; 65: 18–27.

25.

Ismail Fawaz

Forestier

Weber

, et al. Deep learning for time series classification: a review. Data Min Knowl Discov 2019; 33: 917–963.

26.

Langkvist

Karlsson

Loutfi

. A review of unsupervised feature learning and deep learning for time-series modeling. Pattern Recognit Lett 2014; 42: 11–24.

27.

Meyers

Fabian

Brown

. De novo molecular design and generative models. Drug Discov Today 2021; 26: 2707–2715.

28.

Luo

Lei

Guo

, et al. Learning scene-specific object detectors based on a generative-discriminative model with minimal supervision. Pattern Recognit Lett 2022; 159: 108–115.

29.

Wan

Dong

Xue

, et al. Polarization-based probabilistic discriminative model for quantitative characterization of cancer cells. Biomed Opt Express 2022; 13: 3339–3354.

30.

Bagnall

Lines

Bostrom

, et al. The great time series classification bake off: a review and experimental evaluation of recent algorithmic advances. Data Min Knowl Discov 2017; 31: 606–660.

31.

Le Nguyen

Gsponer

Ifrim

. Time series classification by sequence learning in all-subsequence space. In: 2017 IEEE 33rd international conference on data engineering (ICDE), San Diego, CA, 2017, pp.947–958. New York: IEEE.

32.

Wang

Oates

. Spatially encoding temporal correlations to classify temporal data using convolutional neural networks. 2015; arXiv:1509.07481.

33.

Wang

Oates

. Encoding time series as images for visual inspection and classification using tiled convolutional neural networks. In: Workshops at the twenty-ninth AAAI conference on artificial intelligence, Menlo Park, CA, 2015, pp. 40–46. Washington: AAAI.

34.

Nanopoulos

Alcock

Manolopoulos

. Feature-based classification of time-series data. Int J Comput Res 2001; 10: 49–61.

35.

Wang

Wirth

Wang

. Structure-based statistical features and multivariate time series clustering. In: Seventh IEEE international conference on data mining (ICDM 2007), Omaha, NE, 2007, pp.351–360. New York: IEEE.