Computer-based automated analysis of X-ray and thermal imaging of knee region in evaluation of rheumatoid arthritis

Abstract

The aim and objectives of the study are as follows: (1) to perform automated segmentation of knee X-ray images using fast greedy snake algorithm and feature extraction using gray level co-occurrence matrix method, (2) to implement automated segmentation of knee thermal image using RGB segmentation method and (3) to compare the features extracted from the segmented knee region of X-ray and thermal images in rheumatoid arthritis patients using a biochemical method as standard. In all, 30 rheumatoid arthritis patients and 30 age- and sex-matched healthy volunteers were included in the study. X-ray and thermography images of knee regions were acquired, and biochemical tests were carried out subsequently. The X-ray images were segmented using fast greedy snake algorithm, and feature extractions were performed using gray level co-occurrence matrix method. The thermal image was segmented using RGB-based segmentation method and statistical features were extracted. Statistical features extracted after segmentation from X-ray and thermal imaging of knee region were correlated with the standard biochemical parameters. The erythrocyte sedimentation rate shows statistically significant correlations (p < 0.01) with the X-ray parameters such as joint space width and % combined cortical thickness. The skin surface temperature measured from knee region of thermal imaging was highly correlated with erythrocyte sedimentation rate. Among all the extracted features namely mean, variance, energy, homogeneity and difference entropy depict statistically significant percentage differences between the rheumatoid arthritis and healthy subjects. From this study, it was observed that thermal infrared imaging technique serves as a potential tool in the evaluation of rheumatoid arthritis at an earlier stage compared to radiography. Hence, it was predicted that thermal imaging method has a competency in the diagnosis of rheumatoid arthritis by automated segmentation methods.

Keywords

Fast greedy snake algorithm RGB-based segmentation rheumatoid arthritis gray level co-occurrence matrix parameters

Get full access to this article

View all access options for this article.

References

Scott

Wolfe

Huizinga

. Rheumatoid arthritis. Lancet 2010; 376(9746): 1094–1108.

Carmona

Cross

Williams

et al . Rheumatoid arthritis. Best Pract Res Clin Rheumatol 2010; 24: 733–745.

Handa

Rao

URK

Lewis

JFM

et al . Literature review of rheumatoid arthritis in India. Int J Rheum Dis 2016; 19(5): 440–451.

Van der Heijde

. Radiographic imaging: the “gold standard” for assessment of disease progression in rheumatoid arthritis. Rheumatology 2000; 39(suppl. 1): 9–16.

Poleskic

Musikic

Zdravkovic

et al . MRI evaluation of the knee in rheumatoid arthritis. Br J Rheumatol 1996; 35(suppl. 3): 36–39.

Yucesoy

Genc

Bal

et al . Ultrasonographic assessment of knee in patients with rheumatoid arthritis: is it an effective imaging method for initial evaluation? Arch Rheumatol 2011; 26(2): 120–126.

Patil

Dasgupta

. Role of diagnostic ultrasound in the assessment of musculoskeletal diseases. Ther Adv Musculoskelet Dis 2012; 4(5): 341–355.

Kim

Choi

Kim

et al . Bone scintigraphy in the diagnosis of rheumatoid arthritis: is there additional value of bone scintigraphy with blood pool phase over conventional bone scintigraphy? J Korean Med Sci 2016; 31(4): 502–509.

Polster

Winalski

Sundaram

et al . Rheumatoid arthritis: evaluation with contrast-enhanced CT with digital bone masking. Radiology 2009; 252(1): 225–231.

10.

Varju

Pieper

Renner

et al . Assessment of hand osteoarthritis: correlation between thermographic and radiographic methods. Rheumatology 2004; 43(7): 915–919.

11.

Warashina

Hasegawa

Tsuchiya

et al . Clinical, radiographic, and thermographic assessment of osteoarthritis in the knee joints. Ann Rheum Dis 2002; 61(9): 852–854.

12.

Denoble

Hall

Pieper

et al . Patellar skin surface temperature by thermography reflects knee osteoarthritis severity. Clin Med Insights Arthritis Musculoskelet Disord 2010; 3: 69–75.

13.

Devereaux

Parr

Lachmann

et al . Thermographic diagnosis in athletes with patellofemoral arthralgia. J Bone Joint Surg Br 1986; 68(1): 42–44.

14.

Glehr

Stibor

Sadoghi

et al . Thermal imaging as a noninvasive diagnostic tool for anterior knee pain following implantation of artificial knee joints. Int J Thermodyn 2011; 14(2): 71–78.

15.

Vardasca

Ring

EFJ

Plassmann

et al . Thermal symmetry of the upper and lower extremities in healthy subjects. Thermol Int 2012; 22(2): 53–60.

16.

Dacre

Huskisson

. The automatic assessment of knee radiographs in osteoarthritis using digital image analysis. Br J Rheumatol 1989; 28(6): 506–510.

17.

Mazzuca

Brandt

Buckland-Wright

et al . Field test of the reproducibility of automated measurements of medial tibiofemoral joint space width derived from standardized knee radiographs. J Rheumatol 1999; 26(6): 1359–1365.

18.

Mazzuca

Brandt

Buckwalter

. Detection of radiographic joint space narrowing in subjects with knee osteoarthritis: longitudinal comparison of the metatarsophalangeal and semiflexed anteroposterior views. Arthritis Rheum 2003; 48(2): 385–390.

19.

Stachowiak

Wolski

Woloszynski

et al . Detection and prediction of osteoarthritis in knee and hand joints based on the X-ray image analysis. Biosurf Biotribol 2016; 4(2): 162–172.

20.

Subramaniam

Barani

Rajini

. A non-invasive computer aided diagnosis of osteoarthritis from digital X-ray images. Biomed Res 2015; 26(4): 721–729.

21.

Gornale

Patravali

Manza

. Detection of osteoarthritis using knee X-ray image analyses: a machine vision based approach. Int J Comput Appl 2016; 145(1): 20–26.

22.

Brioschi

Matias

JEF

Teixeira

et al . Automated computer diagnosis of IR medical imaging. In: InfraMation 2010 proceedings, https://www.photonicsonline.com/doc/automated-computer-diagnosis-of-ir-medical-0001 (2010, accessed July 2017).

23.

Szentkuti

Kavanagh

Grazio

. Infrared thermography and image analysis for biomedical use. Period Biol 2011; 113(4): 385–392.

24.

Varga

Hanka

. Automatic thermal image analysis for medical diagnosis. In: Proceedings of the international conference on image processing and its applications, Maastricht, 7–9 April 1992, pp.526–529. New York: IEEE.

25.

Jin

Yang

Xue

et al . Automated analysis method for screening knee osteoarthritis using medical infrared thermography. J Med Biol Eng 2011; 33(5): 471–477.

26.

Selvarasu

Sangeetha

Nandhita

. Performance evaluation of image processing algorithms for automatic detection and quantification of abnormality in medical thermograms. In: Proceedings of the international conference on computational intelligence and multimedia applications, Sivakasi, India, 13–15 December 2007, pp.388–393. New York: IEEE.

27.

Herry

Frize

Goubran

. Search for abnormal thermal patterns in clinical thermal infrared imaging. In: Proceedings of the IEEE international workshop on medical measurements and applications, Ottawa, ON, Canada, 9–10 May 2008, pp.61–65. New York: IEEE.

28.

Mishra

Sharma

Gupta

et al . Indian Rheumatology Association consensus statement on the management of adults with rheumatoid arthritis. Indian J Rheumatol 2008; 3(3): S1–S16.

29.

Sakalli

Lam

Yan

. A faster converging snake algorithm to locate object boundaries. IEEE Trans Image Process 2006; 15(5): 1182–1191.

30.

Khan

Raahemifar

. A novel accelerated greedy snake algorithm for active contours. In: Proceedings of the 2011 24th Canadian conference on electrical and computer engineering, Niagara Falls, ON, Canada, 8–11 May 2011, pp.186–190. New York: IEEE.

31.

Chokkalingam

Komathy

. Intelligent assistive methods for diagnosis of rheumatoid arthritis using histogram smoothing and feature extraction of bone images. World Acad Sci Eng Tech 2014; 8(5): 905–914.

32.

Helwan

Tantua

Adeola

. IKRAI: intelligent knee rheumatoid arthritis identification. Int J Intell Syst Appl 2016; 8(1): 18–24.

33.

Mittal

Dubey

. Analysis of rheumatoid arthritis through image processing. Int J Comput Sci 2012; 9(6): 442–447.

34.

Shamir

Ling

Scott

et al . Knee X-ray image analysis method for automated detection of osteoarthritis. IEEE Trans Biomed Eng 2009; 56(2): 407–415.

35.

Schmidt

Amrami

Manduca

et al . Semi-automated digital image analysis of joint space width in knee radiographs. Skeletal Radiol 2005; 34(10): 639–643.

36.

Vignon

Piperno

Hellio

Graverand

et al . Measurement of radiographic joint space width in the tibiofemoral compartment of the osteoarthritic knee: comparison of standing anteroposterior and Lyon schuss views. Arthritis Rheum 2003; 48(2): 378–384.

37.

Selvarasu

Nachiappan

Nandhitha

. Feature extraction algorithms for abnormality quantification from medical thermograms. Int J Recent Trends Eng 2009; 1(3): 350–352.

38.

Frize

Adea

Payeur

et al . Detection of rheumatoid arthritis using infrared imaging. In: Proceedings of the SPIE 7962 medical imaging, Lake Buena Vista, FL, 11 March 2011, vol. 7692, pp.79620M-1–79620M-2. Bellingham, WA: SPIE.

39.

Herry

Frize

Goubran

. Segmentation and landmark identification in infrared images of the human body. In: Proceedings of the 28th annual international conference of the IEEE engineering in medicine and biology society, 2006 (EMBS ’06) New York, 30 August–3 September 2006, vol. 1, pp.957–960. New York: IEEE.

40.

Yang

Park

Lim

et al . Infrared thermal imaging in patients with medial collateral ligament injury of the knee—a retrospective study. J Pharmacopuncture 2014; 17(4): 50–54.