YOLO-DLL: an effective detection method for fabric defects

Abstract

Owing to the complex fabric structure and appearance variations, the diversity of defect types and scales, as well as the impact of lighting and environmental conditions on fabric appearance and detection results, automated fabric defect detection remains a challenging issue in the industry. To address the problems of complex background textures and limited hardware resources in online fabric defect detection, this paper proposes a high-precision and lightweight fabric defect detector: YOLO with dilation and lightweight attentive learning (YOLO-DLL). First, the dilation-wise residual module (DWR) is proposed to optimize the backbone network of YOLOv8. This module can capture multiscale contextual information from the input feature maps, and enhance the model's ability to integrate multiscale information. Second, the spatial pyramid pooling - fast (SPPF) module in the backbone network is optimized by using large separable kernel attention (LSKA). This enhancement can increase the network's focus on important features, and achieve a balance between high-precision detection and fast inference. Furthermore, to address the deployment of the detector on edge computing devices, the lightweight shared convolution detection (LSCD) head is designed. This LSCD head can use the scale layer to scale features, and further enhance the model's feature extraction capability while reinforcing its lightweight characteristics. Finally, extensive experiments were conducted on the large circular knitting fabric defect dataset and the fiberglass fabric defect dataset. The experimental results show that the proposed YOLO-DLL defect detection model achieves an accuracy of 99.2%, with 17.5% reduction in computational load and 28% increase in detection speed compared with the original model. The YOLO-DLL defect detection model not only improves the extraction of small target defect features and the ability to resist interference, but also achieves lightweight characteristics, which can meet the online detection needs of the textile industry for fabric defects.

Keywords

Fabric defects defect detection YOLO-DLL machine vision deep learning

Get full access to this article

View all access options for this article.

References

Zhu

Jinfeng

Bugao

Fabric defect classification using prototypical network of few-shot learning algorithm. Comput Ind 2022; 138 DOI: 10.1109/TIM.2022.3188550.

Nasim

Mumtaz

Ahmad

, et al. Fabric defect detection in real world manufacturing using deep learning. Information 2024; 15(8): 476–476.

Ashiba

IH.

New algorithm fabric defects detection. Multimedia Tools Applicat 2024. DOI: 10.1007/s11042-024-19735-2

Liu

Zhang

Image retrieval algorithm based on convolutional neural network and manifold ranking. J Comput Applicat 2016; 36(2): 531–534．

Fouda Yasser M. Integral images-based approach for fabric defect detection. Opt Laser Technol 2022; 147. DOI:10.1016/J.OPTLASTEC.2021.107608.

Mahmood

Digital image processing: advanced technologies and applications. Appl Sci 2024; 14(14): 6051–6051.

Bizzego

Carollo

Senay

, et al. Computer vision-driven movement annotations to advance fNIRS pre-processing algorithms. Sensors 2024; 24(21): 6821–6821.

Akyildiz Halil I, Yigit Enes, Arat Asife B , et al. A machine learning approach for the estimation of photocatalytic activity of ALD ZnO thin films on fabric substrates. J Photochemi Photobiol A Chem 2024; 448. DOI:10.1016/J.JPHOTOCHEM.2023.115308.

Furferi

Governi

Volpe

Machine vision-based pilling assessment: a review. J Eng Fibers Fabrics 2015; 10(3): 155892501501000320.

10.

Chunping

Yilong

Shuai

, et al. Deep learning-accelerated designs of tunable magneto-mechanical metamaterials. ACS Appl Mater Interf 2022; 14(29): 33892–33902.

11.

Liu

Xia

Shi

Lin

Deep learning in sheet metal bending with a novel theory-guided deep neural network. IEEE-CAA J Autom Sin 2021; 8(3): 565–581.

12.

Huang

Y-P

Wang

T-H

Haobijam

Deep learning and image processing techniques for recognizing liquid-crystal display array residue and the automatic planning of laser-cutting segments. IEEE Trans Instrum Meas 2022; 71: 1–10. DOI: 10.1109/TIM.2022.3188550

13.

Danfeng Hong, Lianru Gao, Naoto Yokoya, , et al. More diverse means better: multimodal deep learning meets remote-sensing imagery classification. IEEE Trans Geosci Remote Sens 2022; 59(5): 4340–4354.

14.

Diwan Tausif, Anirudh G and Tembhurne Jitendra V . Object detection using YOLO: challenges, architectural successors, datasets and applications. Multimedia Tools Applicat 2022; 82(6): 31–33.

15.

Wei

Liu

, et al. DWRSeg: Rethinking efficient acquisition of multi-scale contextual information for real-time semantic segmentation. arxiv preprint arxiv:2212.01173, 2022.

16.

Wai

Lai-Man

AYR.

Large separable kernel attention: rethinking the large kernel attention design in CNN. Exp Syst Applicat 2024; 236: 121352.

17.

Liu

Shi

, et al. Fabric defect detection method based on improved U-Net. J Phys Conf Ser 2021; 1948(1): 012160.

18.

Ronneberger

Fischer

Brox

U-net: Convolutional networks for biomedical image segmentation. In 18th International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI 2015), Munich, Germany, 5-9 October 2015, part III 18. Berlin: Springer International Publishing, 2015, pp. 234–241.

19.

Yang

Wei

Hao

, et al. An efficient unsupervised approach for textile defect detection through unifying texture reconstruction and semantic localization. Text Res J 2024; 94: 192–208.

20.

Jing

Wang

Rätsch

, et al. Mobile-Unet: an efficient convolutional neural network for fabric defect detection. Text Res J 2022; 92(1–2): 30–42.

21.

Sandler

Howard

Zhu

, et al. Mobilenetv2: inverted residuals and linear bottlenecks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018, pp. 4510–4520.

22.

Joulin

Cissé

Grangier

, et al. Efficient softmax approximation for GPUs. In International Conference on Machine Learning (PMLR), 2017, pp. 1302–1310.

23.

Badrinarayanan

Kendall

Cipolla

SegNet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans Pattern Anal Machine Intell 2017; 39(12): 2481–2495.

24.

Yuxiang Wang, Shiyi Mu, Xiang Xie , et al. DCSNet: a surface defect classification and segmentation model by one-class learning. J Phys Conf Ser 2021; 1914(1): 012037.

25.

Wang

Junfeng

Zhang

, et al. Real-time fabric defect segmentation based on convolutional neural network. AATCC J Res 2021; 8(1 suppl): 91–96.

26.

Huang

Xiang

RPDNet: automatic fabric defect detection based on a convolutional neural network and repeated pattern analysis. Sensors 2022; 22(16): 6226.

27.

Cheng

Chen

, et al. Fabric defect detection based on separate convolutional UNet. Multimedia Tools Applicat 2023; 82(2): 3101–3122.

28.

Jing

Zhang

HH.

Automatic fabric defect detection using a deep convolutional neural network. Colorat Technol 2019; 135(3): 213–223.

29.

Chen

Zhi

, et al. Improved faster R-CNN for fabric defect detection based on Gabor filter with genetic algorithm optimization. Comput Ind 2022; 134: 103551.

30.

Luan

Chen

Zhang

Han

Liu

Gabor convolutional networks. IEEE Trans Image Process 2018, 27(9): 4357–4366.

31.

Ren

Girshick

Sun

Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Trans Pattern Anal Machine Intell 2017; 39(6): 1137–1149.

32.

Zhao

Yin

Zhang

, et al. Real-time fabric defect detection based on multi-scale convolutional neural network. IET Collab Intell Manuf 2020; 2(4): 189–196.

33.

Simonyan

Zisserman

Very deep convolutional networks for large-scale image recognition. arxiv preprint arxiv:1409.1556, 2014

34.

Kim

Kong

Son

Conditional variational autoencoder with adversarial learning for end-to-end text-to-speech. In International Conference on Machine Learning (PMLR), 2021, pp. 5530–5540.

35.

Ahmedov

Jiang

, et al. Coordinate-aware mask R-CNN with group normalization: a underwater marine animal instance segmentation framework. Neurocomputing 2024; 583: 127488.

36.

Kang

AYOLOv7-tiny: towards efficient defect detection in solid color circular weft fabric. Text Res J 2024; 94(1–2): 225–245.

37.

Lu Zhengyang, Zhang Yudian, Xu Han , et al. Fabric defect detection via a spatial cloze strategy. Text Res J 2023; 93(7–8): 1612–1627.