Abstract
Modern textile industry integrates video sensors with automated fabric reeling systems for real-time fabric weave pattern inspection. This automation system lessens the human-vision-based cognitive load and improves fabric weave pattern inspection work. However, this automation system poses a unique challenge, particularly when dealing with high-dimensional streaming data from highly precision digital microscope cameras. The complexity arises from the continuous acquisition and management of such high-dimensional streaming video data. Considering the challenges posed by dimensionality reduction in high-dimensional data, this study employs multilinear principal component analysis (MPCA)-based tensor decomposition, a statistical technique designed to effectively reduce high-dimensional datasets into low-dimensional features. This paper proposes an innovative method for fabric weave pattern recognition (FWPR) by leveraging MPCA-based tensor decomposition to extract low-dimensional features from the high-dimensional fabric’s surface texture descriptor tensor (STDT). This proposed method replicates fabric pattern monitoring in automated fabric reeling systems by integrating a digital microscope camera to capture high-dimensional streaming video data from fabric surface texture features. Subsequently high-dimensional video data is converted into sequential image frames representing different fabric weave patterns. These image frames are processed with local binary pattern (LBP) and gray-level co-occurrence matrix (GLCM) methods to aggregate fabric’s surface pattern features and construct the high-dimensional STDT. This STDT is subsequently decomposed into low-dimensional features by leveraging MPCA, resulting in an impressive 99.99% reduction in dimension. A supervised machine learning method utilizes the extracted low-dimensional features to enable FWPR, demonstrating superiority of the proposed method over the benchmark methods in evaluation.
Similar content being viewed by others
Data availability
No datasets were generated or analysed during the current study.
References
Ragab M, Othman H, Hassabo A (2022) An overview of printing textile techniques. Egypt J Chem. https://doi.org/10.21608/ejchem.2022.131477.5793
Zhan Z, Zhou J, Xu B (2022) Fabric defect classification using prototypical network of few-shot learning algorithm. Comput Ind. https://doi.org/10.1016/j.compind.2022.103628
Chan CH (2000) Fabric defect detection by Fourier analysis. IEEE Trans Ind Appl 36:1267–1276. https://doi.org/10.1109/28.871274
Zhong P, Shi Y, Chen X et al (2013) Research on digital intelligent recognition method of the weave pattern of fabric based on the redundant information. Fibers Polym 14:1919–1926. https://doi.org/10.1007/s12221-013-1919-0
Peng P, Wang Y, Hao C et al (2020) Automatic fabric defect detection method using PRAN-Net. Appl Sci 10:8434. https://doi.org/10.3390/app10238434
Zhang R, Xin B (2016) A review of woven fabric pattern recognition based on image processing technology. Res J Text Appar 20:37–47. https://doi.org/10.1108/RJTA-08-2015-0022
Lušić M, Braz KS, Wittmann S et al (2014) Worker information systems including dynamic visualisation: a perspective for minimising the conflict of objectives between a resource-efficient use of inspection equipment and the cognitive load of the worker. Adv Mater Res 1018:23–30. https://doi.org/10.4028/www.scientific.net/AMR.1018.23
Babic B, Nesic N, Miljkovic Z (2008) A review of automated feature recognition with rule-based pattern recognition. Comput Ind 59:321–337. https://doi.org/10.1016/j.compind.2007.09.001
Shahin M, Chen FF, Hosseinzadeh A et al (2023) Waste reduction via image classification algorithms: beyond the human eye with an AI-based vision. Int J Prod Res. https://doi.org/10.1080/00207543.2023.2225652
Haleem N, Bustreo M, Del Bue A (2021) A computer vision based online quality control system for textile yarns. Comput Ind. https://doi.org/10.1016/j.compind.2021.103550
Wang X, Georganas ND, Petriu EM (2011) Fabric texture analysis using computer vision techniques. IEEE Trans Instrum Meas 60:44–56. https://doi.org/10.1109/TIM.2010.2069850
Fang H, Xin B, Liu X (2013) A review of yarn appearance evaluation based on image analysis technology. Res J Text Appar 17:1–11. https://doi.org/10.1108/RJTA-17-04-2013-B001
Tolba AS, Abu-Rezeq AN (1997) A self-organizing feature map for automated visual inspection of textile products. Comput Ind 32:319–333. https://doi.org/10.1016/S0166-3615(96)00076-0
Peng T, Zhou X, Liu J et al (2021) A textile fabric classification framework through small motions in videos. Multimed Tools Appl 80:7567–7580. https://doi.org/10.1007/s11042-020-10085-3
de Giorgio A, Roci M, Maffei A et al (2023) Measuring the effect of automatically authored video aid on assembly time for procedural knowledge transfer among operators in adaptive assembly stations. Int J Prod Res 61:3910–3925. https://doi.org/10.1080/00207543.2021.1970850
Iqbal Hussain MA, Khan B, Wang Z, Ding S (2020) woven fabric pattern recognition and classification based on deep convolutional neural networks. Electronics 9:1048. https://doi.org/10.3390/electronics9061048
Chen M, Yu L, Zhi C et al (2022) Improved faster R-CNN for fabric defect detection based on gabor filter with genetic algorithm optimization. Comput Ind. https://doi.org/10.1016/j.compind.2021.103551
Kumar V, Hernández N, Jensen M, Pal R (2023) Deep learning based system for garment visual degradation prediction for longevity. Comput Ind 144:103779. https://doi.org/10.1016/j.compind.2022.103779
Du NH, Long NH, Ha KN et al (2023) Trans-lighter: a light-weight federated learning-based architecture for remaining useful lifetime prediction. Comput Ind. https://doi.org/10.1016/j.compind.2023.103888
Balaprakash P, Salim M, Uram TD, et al (2018) Deephyper: asynchronous hyperparameter search for deep neural networks. In: 2018 IEEE 25th international conference on high performance computing (HiPC). IEEE, pp 42–51
Al MA, Liu C, Kan C, Tian W (2022) Securing cyber-physical additive manufacturing systems by in-situ process authentication using streamline video analysis. J Manuf Syst 62:429–440. https://doi.org/10.1016/j.jmsy.2021.12.007
Jiang X (2011) Linear subspace learning-based dimensionality reduction. IEEE Signal Process Mag 28:16–26. https://doi.org/10.1109/MSP.2010.939041
Diaz-Chito K, Ferri FJ, Hernández-Sabaté A (2018) An overview of incremental feature extraction methods based on linear subspaces. Knowledge-Based Syst 145:219–235. https://doi.org/10.1016/j.knosys.2018.01.020
Lu H, Plataniotis KN, Venetsanopoulos AN (2008) MPCA: multilinear principal component analysis of tensor objects. IEEE Trans Neural Netw 19:18–39. https://doi.org/10.1109/TNN.2007.901277
Kolda TG, Bader BW (2009) Tensor decompositions and applications. SIAM Rev 51:455–500. https://doi.org/10.1137/07070111X
Yan H, Paynabar K, Shi J (2018) Real-time monitoring of high-dimensional functional data streams via spatio-temporal smooth sparse decomposition. Technometrics 60:181–197. https://doi.org/10.1080/00401706.2017.1346522
Yan H, Paynabar K, Shi J (2015) Image-based process monitoring using low-rank tensor decomposition. IEEE Trans Autom Sci Eng 12:216–227. https://doi.org/10.1109/TASE.2014.2327029
Lu H, Plataniotis KN, Venetsanopoulos AN (2011) A survey of multilinear subspace learning for tensor data. Pattern Recognit 44:1540–1551. https://doi.org/10.1016/j.patcog.2011.01.004
Kumar G, Bhatia PK (2014) A detailed review of feature extraction in image processing systems. Int Conf Adv Comput Commun Technol. https://doi.org/10.1109/ACCT.2014.74
Rasheed A, Zafar B, Rasheed A et al (2020) Fabric defect detection using computer vision techniques: a comprehensive review. Math Probl Eng. https://doi.org/10.1155/2020/8189403
Das S, Shanmugaraja K (2022) Application of artificial neural network in determining the fabric weave pattern. Zast Mater 63:291–299. https://doi.org/10.5937/zasmat2203291D
Sakhare K, Kulkarni A, Kumbhakarn M, Kare N (2015) Spectral and spatial domain approach for fabric defect detection and classification. In: 2015 international conference on industrial instrumentation and control (ICIC). IEEE, pp 640–644
Grigoryan AM, Agaian SS (2004) Transform-based image enhancement algorithms with performance measure. In: advances in imaging and electron physics. pp 165–242
Bugao Xu (1996) Identifying fabric structures with fast Fourier transform techniques. Text Res J 66:496–506. https://doi.org/10.1177/004051759606600803
Escofet J, Millán MS, Ralló M (2001) Modeling of woven fabric structures based on Fourier image analysis. Appl Opt 40:6170. https://doi.org/10.1364/AO.40.006170
Pan R, Gao W, Li Z et al (2015) Measuring thread densities of woven fabric using the Fourier transform. Fibres Text East Eur 23:35–40
Zhang J, Pan R, Gao W, Xiang J (2017) Weave pattern recognition by measuring fiber orientation with Fourier transform. J Text Inst 108:622–630. https://doi.org/10.1080/00405000.2016.1177865
Le B, Troendle D, Jang B (2021) Detecting fabric density and weft distortion in woven fabrics using the discrete fourier transform. In: proceedings of the 2021 ACM southeast conference. ACM, New York, NY, USA, pp 108–113
Gong X, Yuan L, Yang Y et al (2022) Classification of colored spun fabric structure based on wavelet decomposition and hierarchical hybrid classifier. J Text Inst 113:1832–1837. https://doi.org/10.1080/00405000.2021.1950452
Shen J, Zou X, Xu F, Xian Z (2010) Intelligent recognition of fabric weave patterns using texture orientation features. In: communications in computer and information science. pp 8–15
Zhang CS, Ke W, Wang GH (2011) Automatic recognition analysis of fabric structure based on GLCM and BP neural network. Adv Mater Res 332–334:1167–1170. https://doi.org/10.4028/www.scientific.net/AMR.332-334.1167
Lesiangi FS, Mauko AY, Djahi BS (2021) Feature extraction hue, saturation, value (HSV) and gray level cooccurrence matrix (GLCM) for identification of woven fabric motifs in South Central timor regency. J Phys Conf Ser 2017:012010. https://doi.org/10.1088/1742-6596/2017/1/012010
Benco M, Hudec R, Kamencay P et al (2014) An advanced approach to extraction of colour texture features based on GLCM. Int J Adv Robot Syst. https://doi.org/10.5772/58692
Sadaghiyanfam S (2018) Using gray-level-co-occurrence matrix and wavelet transform for textural fabric defect detection: a comparison study. In: 2018 electric electronics, computer science, biomedical engineerings’ meeting (EBBT). IEEE, pp 1–5
Xin Wang, Georganas ND, Petriu EM (2010) Automatic woven fabric structure identification by using principal component analysis and fuzzy clustering. In: 2010 IEEE instrumentation and measurement technology conference proceedings. IEEE, pp 590–595
Gustian DA, Rohmah NL, Shidik GF, et al (2019) Classification of troso fabric using SVM-RBF multi-class method with glcm and pca feature extraction. In: 2019 international seminar on application for technology of information and communication (iSemantic). IEEE, pp 7–11
Jing J, Xu M, Li P et al (2014) Automatic classification of woven fabric structure based on texture feature and PNN. Fibers Polym 15:1092–1098. https://doi.org/10.1007/s12221-014-1092-0
Konda Reddy RO, Eswara Reddy B, Keshava Reddy E (2013) classifying similarity and defect fabric textures based on GLCM and Binary pattern schemes. Int J Inf Eng Electron Bus 5:25–33. https://doi.org/10.5815/ijieeb.2013.05.04
Arora S, Majumdar A (2022) Machine learning and soft computing applications in textile and clothing supply chain: bibliometric and network analyses to delineate future research agenda. Expert Syst Appl 200:117000. https://doi.org/10.1016/j.eswa.2022.117000
Septiarini A, Saputra R, Tedjawati A et al (2022) Pattern recognition of sarong fabric using machine learning approach based on computer vision for cultural preservation. Int J Intell Eng Syst 15:284–295. https://doi.org/10.22266/ijies2022.1031.26
Pawening RE, Dijaya R, Brian T, Suciati N (2015) classification of textile image using support vector machine with textural feature. In: 2015 international conference on information and communication technology and systems (ICTS). IEEE, pp 119–122
Diao G, Zhao L, Yao Y (2015) A dynamic quality control approach by improving dominant factors based on improved principal component analysis. Int J Prod Res 53:4287–4303. https://doi.org/10.1080/00207543.2014.997400
Yildiz K (2017) Dimensionality reduction-based feature extraction and classification on fleece fabric images. Signal Image Video Process 11:317–323. https://doi.org/10.1007/s11760-016-0939-9
Serdaroglu A, Ertuzun A, Ercil A (2006) Defect detection in textile fabric images using wavelet transforms and independent component analysis. Pattern Recognit Image Anal 16:61–64. https://doi.org/10.1134/S1054661806010196
Sezer OG, Ercil A, Ertuzun A (2007) Using perceptual relation of regularity and anisotropy in the texture with independent component model for defect detection. Pattern Recognit 40:121–133. https://doi.org/10.1016/j.patcog.2006.05.023
Al Mamun A, Bappy MM, Mudiyanselage AS et al (2023) Multi-channel sensor fusion for real-time bearing fault diagnosis by frequency-domain multilinear principal component analysis. Int J Adv Manuf Technol 124:1321–1334. https://doi.org/10.1007/s00170-022-10525-4
Hu C, He S, Wang Y (2021) A classification method to detect faults in a rotating machinery based on kernelled support tensor machine and multilinear principal component analysis. Appl Intell 51:2609–2621. https://doi.org/10.1007/s10489-020-02011-9
Jeyaraj PR, Samuel Nadar ER (2019) Computer vision for automatic detection and classification of fabric defect employing deep learning algorithm. Int J Cloth Sci Technol 31:510–521. https://doi.org/10.1108/IJCST-11-2018-0135
Zhang D, Gao X (2021) Soft sensor of flotation froth grade classification based on hybrid deep neural network. Int J Prod Res 59:4794–4810. https://doi.org/10.1080/00207543.2021.1894366
Boonsirisumpun N, Puarungroj W (2018) Loei fabric weaving pattern recognition using deep neural network. In: 2018 15th international joint conference on computer science and software engineering (JCSSE). IEEE, pp 1–6
Meng S, Pan R, Gao W et al (2021) A multi-task and multi-scale convolutional neural network for automatic recognition of woven fabric pattern. J Intell Manuf 32:1147–1161. https://doi.org/10.1007/s10845-020-01607-9
Rizki Y, Medikawati Taufiq R, Mukhtar H, et al (2020) Comparison between faster R-CNN and CNN in recognizing weaving patterns. In: 2020 international conference on informatics, multimedia, cyber and information system (ICIMCIS). IEEE, pp 81–86
Maged A, Lui CF, Haridy S, Xie M (2023) Variational autoencoders-LSTM based fault detection of time-dependent high dimensional processes. Int J Prod Res. https://doi.org/10.1080/00207543.2023.2175591
Al MA, Nabi MM, Islam F et al (2023) Streamline video-based automatic fabric pattern recognition using Bayesian-optimized convolutional neural network. J Text Inst. https://doi.org/10.1080/00405000.2023.2269760
Makaremi M, Razmjooy N, Ramezani M (2018) A new method for detecting texture defects based on modified local binary pattern. Signal Image Video Process 12:1395–1401. https://doi.org/10.1007/s11760-018-1294-9
Heikkilä M, Pietikäinen M, Schmid C (2009) Description of interest regions with local binary patterns. Pattern Recognit 42:425–436. https://doi.org/10.1016/j.patcog.2008.08.014
Malhotra A, Sankaran A, Mittal A, Vatsa M, Singh R (2017) Fingerphoto authentication using smartphone camera captured under varying environmental conditions. Human recognition in unconstrained environments. Elsevier, pp 119–144. https://doi.org/10.1016/B978-0-08-100705-1.00006-3
Faber NM, Bro R, Hopke PK (2003) Recent developments in CANDECOMP/PARAFAC algorithms: a critical review. Chemom Intell Lab Syst 65:119–137. https://doi.org/10.1016/S0169-7439(02)00089-8
Uschmajew A (2012) Local convergence of the alternating least squares algorithm for canonical tensor approximation. SIAM J Matrix Anal Appl 33:639–652. https://doi.org/10.1137/110843587
Wu C, Liu F, Zhu B (2015) Control chart pattern recognition using an integrated model based on binary-tree support vector machine. Int J Prod Res 53:2026–2040. https://doi.org/10.1080/00207543.2014.948222
Sheykhmousa M, Mahdianpari M, Ghanbari H et al (2020) Support vector machine versus random forest for remote sensing image classification: a meta-analysis and systematic review. IEEE J Sel Top Appl Earth Obs Remote Sens 13:6308–6325. https://doi.org/10.1109/JSTARS.2020.3026724
Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A (2020) A comprehensive survey on support vector machine classification: applications challenges and trends. Neurocomputing 408:189–215. https://doi.org/10.1016/j.neucom.2019.10.118
Tharwat A (2021) Classification assessment methods. Appl Comput Inform 17:168–192. https://doi.org/10.1016/j.aci.2018.08.003
Deng X, Liu Q, Deng Y, Mahadevan S (2016) An improved method to construct basic probability assignment based on the confusion matrix for classification problem. Inf Sci 340–341:250–261. https://doi.org/10.1016/j.ins.2016.01.033
Davis J, Goadrich M (2006) The relationship between precision-recall and ROC curves. In: proceedings of the 23rd international conference on machine learning—ICML’06 ACM Press, New York, New York, USA, pp 233–240
Cao LJ, Chua KS, Chong WK et al (2003) A comparison of PCA, KPCA and ICA for dimensionality reduction in support vector machine. Neurocomputing 55:321–336. https://doi.org/10.1016/S0925-2312(03)00433-8
Young SR, Rose DC, Karnowski TP, et al (2015) Optimizing deep learning hyper-parameters through an evolutionary algorithm. In: proceedings of the workshop on machine learning in high-performance computing environments. ACM, New York, NY, USA, pp 1–5
Güneş A, Kalkan H, Durmuş E (2016) Optimizing the color-to-grayscale conversion for image classification. Signal Image Video Process 10:853–860. https://doi.org/10.1007/s11760-015-0828-7
Kanan C, Cottrell GW (2012) Color-to-grayscale: does the method matter in image recognition? PLoS ONE 7:e29740. https://doi.org/10.1371/journal.pone.0029740
Al MA, Liu C, Kan C, Tian W (2021) Real-time process authentication for additive manufacturing processes based on in-situ video analysis. Procedia Manuf 53:697–704. https://doi.org/10.1016/j.promfg.2021.06.068
Acknowledgements
The authors express their gratitude to the Department of Human Sciences at Mississippi State University for their invaluable technical support and for facilitating the acquisition of fabric swatches, which were instrumental in conducting this research.
Funding
The authors did not receive any financial assistance or related support for the preparation and composition of this manuscript.
Author information
Authors and Affiliations
Contributions
Abdullah Al Mamun: conceptualization, supervision, methodology, statistical computing, original draft preparation, review, and editing. Md. Imranul Islam: conceptualization, methodology, original draft preparation, and supervision. Md Abu Sayeed Shohag: methodology, statistical computing, review, and editing. Wael Al-Kouz: methodology, supervision, review, and editing. K. M. Abdun Noor: methodology, review, and editing.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Al Mamun, A., Islam, M.I., Shohag, M.A.S. et al. Multilinear principal component analysis-based tensor decomposition for fabric weave pattern recognition from high-dimensional streaming data. Pattern Anal Applic 27, 100 (2024). https://doi.org/10.1007/s10044-024-01318-4
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10044-024-01318-4