A data-driven near infrared calibration process including near infrared spectral thumbprints

Abstract

Near infrared spectra are highly correlated, complex and noisy, and potentially have many more predictor variables than are required to estimate a parsimonious calibration equation. It is difficult to appreciate the implication of pre-processing choices that are made during calibration, especially in connection with the relationship between the transformed data and the reference values. Graphical methods can be used to understand these relationships better and decisions made during the calibration process can be based on the data alone. In this paper, new graphical tools are introduced to help the researcher better understand these complex relationships in the data. When combined with the proposed algorithm to explore spectra in relation to calibration, these tools enable a parsimonious calibration model to be formed. The results from two different (diesel and wheat) near infrared spectra show that it is possible to form successful calibration equations based on the proposed algorithm, which includes the two new graphical tools. There is a high level of correlation between the results of the different transformations considered, suggesting that in terms of parsimony, developing a calibration using the raw spectra could provide the most judicious outcome.

Keywords

Near infrared spectra calibration

Get full access to this article

View all access options for this article.

References

Kutner

Nachtsheim

Neter

et al.

Applied linear statistical models, New York: McGraw-Hill, 2005.

Mead

Curnow

Hasted

. Statistical methods in agriculture and experimental biology, Boca Raton, FL: CRC Press, 2003.

Quinn

Keough

. Experimental design and data analysis for biologists, New York: Cambridge University Press, 2002.

Candolfi

De Maesschalck

Jouan-Rimbaud

et al.

The influence of data pre-processing in the pattern recognition of excipients near-infrared spectra. J Pharm Biomed Anal 1999; 21: 115–132.

Varmuza

Filzmoser

. Introduction to multivariate statistical analysis in chemometrics, Hoboken, NJ: CRC Press, 2009.

Rinnan

Berg

Fvd

Engelsen

. Review of the most common pre-processing techniques for near-infrared spectra. TrAC 2009; 28: 1201–1222.

Burns

Ciurczak

. Handbook of near-infrared analysis, New York: CRC Press, 2007.

Bax

Lerner

. Two-dimensional nuclear magnetic resonance spectroscopy. Science 1986; 232: 960–967.

Park

Noda

Jung

. Novel developments and applications of two-dimensional correlation spectroscopy. J Mol Struct 2016; 1124: 11–28.

10.

Noda

Dowrey

Marcott

et al.

Generalized two-dimensional correlation spectroscopy. Appl Spectrosc 2000; 54: 236–248.

11.

R Core Team. R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria, https://www.R-project.org/ (2018).

12.

Murrell

. R graphics, London: CRC Press, 2005.

13.

Heckbert

Nice numbers for graph labels. In: Glassner

(ed). Graphics gems, Cambridge: Academic Press, Inc., 1990, pp. 86–88.

14.

Eigenvector Research. Near infrared spectra of diesel fuels. Wenatchee, http://eigenvector.com/data/SWRI/index.html (accessed 25 March 2015).

15.

Subhash

. Applied multivariate techniques, New York: John Wiley & Sons Inc, 1996.

16.

Sánchez

Ortiz

Sarabia

. A useful tool for computation and interpretation of trading-off solutions through pareto-optimal front in the field of experimental designs for mixtures. Chemometr Intell Lab Syst 2016; 158: 210–217.

17.

Opach

Rød

. Cartographic visualization of vulnerability to natural hazards. Cartographica 2013; 48: 113–125.

18.

Dinov

Lozev

Petrosyan

et al.

Neuroimaging study designs, computational analyses and data provenance using the LONI pipeline. PLoS One 2010; 5: e13070.

19.

Zhao

Kaufman

. Structure revealing techniques based on parallel coordinates plot. Vis Comput 2012; 28: 541–551.

20.

Wegman

. Hyperdimensional data analysis using parallel coordinates. J Am Stat Assoc 1990; 85: 664–675.

21.

Harald

. Reliable and relevant modelling of real world data: a personal account of the development of PLS Regression. Chemometr Intell Lab Syst 2001; 58: 85–95.

22.

Bro R. Chemometrics world. John Wiley & Sons, Ltd., http://www.wiley.com/legacy/wileychi/chemometrics/datasets.html (accessed 26 August 2017).

23.

Barnes

Dhanoa

Lister

. Standard normal variate transformation and de-trending of near-infrared diffuse reflectance spectra. Appl Spectrosc 1989; 43: 772–777.

24.

Geladi

MacDougall

Martens

. Linearization and scatter-correction for near-infrared reflectance spectra of meat. Appl Spectrosc 1985; 39: 491–500.

25.

Savitzky

Golay

MJE

. Smoothing and differentiation of data by simplified least squares procedures. Anal Chem 1964; 36: 1627–1639.

26.

Zimmermann

Kohler

. Optimizing Savitzky–Golay parameters for improving spectral resolution and quantification in infrared spectroscopy. Appl Spectrosc 2013; 67: 892–902.

27.

Cui

Fearn

. Comparison of partial least squares regression, least squares support vector machines, and Gaussian process regression for a near infrared calibration. J Near Infrared Spectrosc 2017; 25: 5–14.

28.

Krepelka

Hynstova

Pytel

et al.

Curve fitting in Fourier transform near infrared spectroscopy used for the analysis of bacterial cells. J Near Infrared Spectrosc 2017; 25: 151–164.

29.

Mevik

B-H

Wehrens

. The pls package: principal component and partial least squares regression in R. J Stat Softw 2007; 18: 1–24.

30.

Ahmad

Khan

Zafar

et al.

Practical handbook on biodiesel production and properties, Boca Raton, FL: CRC Press, 2012.

31.

Batten

. Plant analysis using near infrared reflectance spectroscopy: the potential and the limitations. Aust J Exp Agric 1998; 38: 697.

32.

Pripp AH. Statistics in food science and nutrition. Dordrecht: Springer, http://CSUAU.eblib.com/patron/FullRecord.aspx?p=1030817 (accessed 6 February 2015).

33.

Team

. R: A language and environment for statistical computing, Vienna: R Foundation for Statistical Computing, 2017.

34.

MATLAB. version 9.4 (R2018a). Natick, MA: The MathWorks Inc., 2018.

35.

Ergon

. Informative PLS score-loading plots for process understanding and monitoring. J Process Control 2004; 14: 889–897.

36.

Murrell

. R graphics. Wiley Interdiscip Rev Comput Stat 2009; 1: 216–220.