Skip to main content
Log in

Multilinear principal component analysis-based tensor decomposition for fabric weave pattern recognition from high-dimensional streaming data

  • Original Article
  • Published:
Pattern Analysis and Applications Aims and scope Submit manuscript

Abstract

Modern textile industry integrates video sensors with automated fabric reeling systems for real-time fabric weave pattern inspection. This automation system lessens the human-vision-based cognitive load and improves fabric weave pattern inspection work. However, this automation system poses a unique challenge, particularly when dealing with high-dimensional streaming data from highly precision digital microscope cameras. The complexity arises from the continuous acquisition and management of such high-dimensional streaming video data. Considering the challenges posed by dimensionality reduction in high-dimensional data, this study employs multilinear principal component analysis (MPCA)-based tensor decomposition, a statistical technique designed to effectively reduce high-dimensional datasets into low-dimensional features. This paper proposes an innovative method for fabric weave pattern recognition (FWPR) by leveraging MPCA-based tensor decomposition to extract low-dimensional features from the high-dimensional fabric’s surface texture descriptor tensor (STDT). This proposed method replicates fabric pattern monitoring in automated fabric reeling systems by integrating a digital microscope camera to capture high-dimensional streaming video data from fabric surface texture features. Subsequently high-dimensional video data is converted into sequential image frames representing different fabric weave patterns. These image frames are processed with local binary pattern (LBP) and gray-level co-occurrence matrix (GLCM) methods to aggregate fabric’s surface pattern features and construct the high-dimensional STDT. This STDT is subsequently decomposed into low-dimensional features by leveraging MPCA, resulting in an impressive 99.99% reduction in dimension. A supervised machine learning method utilizes the extracted low-dimensional features to enable FWPR, demonstrating superiority of the proposed method over the benchmark methods in evaluation.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

Data availability

No datasets were generated or analysed during the current study.

References

  1. Ragab M, Othman H, Hassabo A (2022) An overview of printing textile techniques. Egypt J Chem. https://doi.org/10.21608/ejchem.2022.131477.5793

    Article  Google Scholar 

  2. Zhan Z, Zhou J, Xu B (2022) Fabric defect classification using prototypical network of few-shot learning algorithm. Comput Ind. https://doi.org/10.1016/j.compind.2022.103628

    Article  Google Scholar 

  3. Chan CH (2000) Fabric defect detection by Fourier analysis. IEEE Trans Ind Appl 36:1267–1276. https://doi.org/10.1109/28.871274

    Article  Google Scholar 

  4. Zhong P, Shi Y, Chen X et al (2013) Research on digital intelligent recognition method of the weave pattern of fabric based on the redundant information. Fibers Polym 14:1919–1926. https://doi.org/10.1007/s12221-013-1919-0

    Article  Google Scholar 

  5. Peng P, Wang Y, Hao C et al (2020) Automatic fabric defect detection method using PRAN-Net. Appl Sci 10:8434. https://doi.org/10.3390/app10238434

    Article  Google Scholar 

  6. Zhang R, Xin B (2016) A review of woven fabric pattern recognition based on image processing technology. Res J Text Appar 20:37–47. https://doi.org/10.1108/RJTA-08-2015-0022

    Article  Google Scholar 

  7. Lušić M, Braz KS, Wittmann S et al (2014) Worker information systems including dynamic visualisation: a perspective for minimising the conflict of objectives between a resource-efficient use of inspection equipment and the cognitive load of the worker. Adv Mater Res 1018:23–30. https://doi.org/10.4028/www.scientific.net/AMR.1018.23

    Article  Google Scholar 

  8. Babic B, Nesic N, Miljkovic Z (2008) A review of automated feature recognition with rule-based pattern recognition. Comput Ind 59:321–337. https://doi.org/10.1016/j.compind.2007.09.001

    Article  Google Scholar 

  9. Shahin M, Chen FF, Hosseinzadeh A et al (2023) Waste reduction via image classification algorithms: beyond the human eye with an AI-based vision. Int J Prod Res. https://doi.org/10.1080/00207543.2023.2225652

    Article  Google Scholar 

  10. Haleem N, Bustreo M, Del Bue A (2021) A computer vision based online quality control system for textile yarns. Comput Ind. https://doi.org/10.1016/j.compind.2021.103550

    Article  Google Scholar 

  11. Wang X, Georganas ND, Petriu EM (2011) Fabric texture analysis using computer vision techniques. IEEE Trans Instrum Meas 60:44–56. https://doi.org/10.1109/TIM.2010.2069850

    Article  Google Scholar 

  12. Fang H, Xin B, Liu X (2013) A review of yarn appearance evaluation based on image analysis technology. Res J Text Appar 17:1–11. https://doi.org/10.1108/RJTA-17-04-2013-B001

    Article  Google Scholar 

  13. Tolba AS, Abu-Rezeq AN (1997) A self-organizing feature map for automated visual inspection of textile products. Comput Ind 32:319–333. https://doi.org/10.1016/S0166-3615(96)00076-0

    Article  Google Scholar 

  14. Peng T, Zhou X, Liu J et al (2021) A textile fabric classification framework through small motions in videos. Multimed Tools Appl 80:7567–7580. https://doi.org/10.1007/s11042-020-10085-3

    Article  Google Scholar 

  15. de Giorgio A, Roci M, Maffei A et al (2023) Measuring the effect of automatically authored video aid on assembly time for procedural knowledge transfer among operators in adaptive assembly stations. Int J Prod Res 61:3910–3925. https://doi.org/10.1080/00207543.2021.1970850

    Article  Google Scholar 

  16. Iqbal Hussain MA, Khan B, Wang Z, Ding S (2020) woven fabric pattern recognition and classification based on deep convolutional neural networks. Electronics 9:1048. https://doi.org/10.3390/electronics9061048

    Article  Google Scholar 

  17. Chen M, Yu L, Zhi C et al (2022) Improved faster R-CNN for fabric defect detection based on gabor filter with genetic algorithm optimization. Comput Ind. https://doi.org/10.1016/j.compind.2021.103551

    Article  Google Scholar 

  18. Kumar V, Hernández N, Jensen M, Pal R (2023) Deep learning based system for garment visual degradation prediction for longevity. Comput Ind 144:103779. https://doi.org/10.1016/j.compind.2022.103779

    Article  Google Scholar 

  19. Du NH, Long NH, Ha KN et al (2023) Trans-lighter: a light-weight federated learning-based architecture for remaining useful lifetime prediction. Comput Ind. https://doi.org/10.1016/j.compind.2023.103888

    Article  Google Scholar 

  20. Balaprakash P, Salim M, Uram TD, et al (2018) Deephyper: asynchronous hyperparameter search for deep neural networks. In: 2018 IEEE 25th international conference on high performance computing (HiPC). IEEE, pp 42–51

  21. Al MA, Liu C, Kan C, Tian W (2022) Securing cyber-physical additive manufacturing systems by in-situ process authentication using streamline video analysis. J Manuf Syst 62:429–440. https://doi.org/10.1016/j.jmsy.2021.12.007

    Article  Google Scholar 

  22. Jiang X (2011) Linear subspace learning-based dimensionality reduction. IEEE Signal Process Mag 28:16–26. https://doi.org/10.1109/MSP.2010.939041

    Article  Google Scholar 

  23. Diaz-Chito K, Ferri FJ, Hernández-Sabaté A (2018) An overview of incremental feature extraction methods based on linear subspaces. Knowledge-Based Syst 145:219–235. https://doi.org/10.1016/j.knosys.2018.01.020

    Article  Google Scholar 

  24. Lu H, Plataniotis KN, Venetsanopoulos AN (2008) MPCA: multilinear principal component analysis of tensor objects. IEEE Trans Neural Netw 19:18–39. https://doi.org/10.1109/TNN.2007.901277

    Article  Google Scholar 

  25. Kolda TG, Bader BW (2009) Tensor decompositions and applications. SIAM Rev 51:455–500. https://doi.org/10.1137/07070111X

    Article  MathSciNet  Google Scholar 

  26. Yan H, Paynabar K, Shi J (2018) Real-time monitoring of high-dimensional functional data streams via spatio-temporal smooth sparse decomposition. Technometrics 60:181–197. https://doi.org/10.1080/00401706.2017.1346522

    Article  MathSciNet  Google Scholar 

  27. Yan H, Paynabar K, Shi J (2015) Image-based process monitoring using low-rank tensor decomposition. IEEE Trans Autom Sci Eng 12:216–227. https://doi.org/10.1109/TASE.2014.2327029

    Article  Google Scholar 

  28. Lu H, Plataniotis KN, Venetsanopoulos AN (2011) A survey of multilinear subspace learning for tensor data. Pattern Recognit 44:1540–1551. https://doi.org/10.1016/j.patcog.2011.01.004

    Article  Google Scholar 

  29. Kumar G, Bhatia PK (2014) A detailed review of feature extraction in image processing systems. Int Conf Adv Comput Commun Technol. https://doi.org/10.1109/ACCT.2014.74

    Article  Google Scholar 

  30. Rasheed A, Zafar B, Rasheed A et al (2020) Fabric defect detection using computer vision techniques: a comprehensive review. Math Probl Eng. https://doi.org/10.1155/2020/8189403

    Article  Google Scholar 

  31. Das S, Shanmugaraja K (2022) Application of artificial neural network in determining the fabric weave pattern. Zast Mater 63:291–299. https://doi.org/10.5937/zasmat2203291D

    Article  Google Scholar 

  32. Sakhare K, Kulkarni A, Kumbhakarn M, Kare N (2015) Spectral and spatial domain approach for fabric defect detection and classification. In: 2015 international conference on industrial instrumentation and control (ICIC). IEEE, pp 640–644

  33. Grigoryan AM, Agaian SS (2004) Transform-based image enhancement algorithms with performance measure. In: advances in imaging and electron physics. pp 165–242

  34. Bugao Xu (1996) Identifying fabric structures with fast Fourier transform techniques. Text Res J 66:496–506. https://doi.org/10.1177/004051759606600803

    Article  Google Scholar 

  35. Escofet J, Millán MS, Ralló M (2001) Modeling of woven fabric structures based on Fourier image analysis. Appl Opt 40:6170. https://doi.org/10.1364/AO.40.006170

    Article  Google Scholar 

  36. Pan R, Gao W, Li Z et al (2015) Measuring thread densities of woven fabric using the Fourier transform. Fibres Text East Eur 23:35–40

    Google Scholar 

  37. Zhang J, Pan R, Gao W, Xiang J (2017) Weave pattern recognition by measuring fiber orientation with Fourier transform. J Text Inst 108:622–630. https://doi.org/10.1080/00405000.2016.1177865

    Article  Google Scholar 

  38. Le B, Troendle D, Jang B (2021) Detecting fabric density and weft distortion in woven fabrics using the discrete fourier transform. In: proceedings of the 2021 ACM southeast conference. ACM, New York, NY, USA, pp 108–113

  39. Gong X, Yuan L, Yang Y et al (2022) Classification of colored spun fabric structure based on wavelet decomposition and hierarchical hybrid classifier. J Text Inst 113:1832–1837. https://doi.org/10.1080/00405000.2021.1950452

    Article  Google Scholar 

  40. Shen J, Zou X, Xu F, Xian Z (2010) Intelligent recognition of fabric weave patterns using texture orientation features. In: communications in computer and information science. pp 8–15

  41. Zhang CS, Ke W, Wang GH (2011) Automatic recognition analysis of fabric structure based on GLCM and BP neural network. Adv Mater Res 332–334:1167–1170. https://doi.org/10.4028/www.scientific.net/AMR.332-334.1167

    Article  Google Scholar 

  42. Lesiangi FS, Mauko AY, Djahi BS (2021) Feature extraction hue, saturation, value (HSV) and gray level cooccurrence matrix (GLCM) for identification of woven fabric motifs in South Central timor regency. J Phys Conf Ser 2017:012010. https://doi.org/10.1088/1742-6596/2017/1/012010

    Article  Google Scholar 

  43. Benco M, Hudec R, Kamencay P et al (2014) An advanced approach to extraction of colour texture features based on GLCM. Int J Adv Robot Syst. https://doi.org/10.5772/58692

    Article  Google Scholar 

  44. Sadaghiyanfam S (2018) Using gray-level-co-occurrence matrix and wavelet transform for textural fabric defect detection: a comparison study. In: 2018 electric electronics, computer science, biomedical engineerings’ meeting (EBBT). IEEE, pp 1–5

  45. Xin Wang, Georganas ND, Petriu EM (2010) Automatic woven fabric structure identification by using principal component analysis and fuzzy clustering. In: 2010 IEEE instrumentation and measurement technology conference proceedings. IEEE, pp 590–595

  46. Gustian DA, Rohmah NL, Shidik GF, et al (2019) Classification of troso fabric using SVM-RBF multi-class method with glcm and pca feature extraction. In: 2019 international seminar on application for technology of information and communication (iSemantic). IEEE, pp 7–11

  47. Jing J, Xu M, Li P et al (2014) Automatic classification of woven fabric structure based on texture feature and PNN. Fibers Polym 15:1092–1098. https://doi.org/10.1007/s12221-014-1092-0

    Article  Google Scholar 

  48. Konda Reddy RO, Eswara Reddy B, Keshava Reddy E (2013) classifying similarity and defect fabric textures based on GLCM and Binary pattern schemes. Int J Inf Eng Electron Bus 5:25–33. https://doi.org/10.5815/ijieeb.2013.05.04

    Article  Google Scholar 

  49. Arora S, Majumdar A (2022) Machine learning and soft computing applications in textile and clothing supply chain: bibliometric and network analyses to delineate future research agenda. Expert Syst Appl 200:117000. https://doi.org/10.1016/j.eswa.2022.117000

    Article  Google Scholar 

  50. Septiarini A, Saputra R, Tedjawati A et al (2022) Pattern recognition of sarong fabric using machine learning approach based on computer vision for cultural preservation. Int J Intell Eng Syst 15:284–295. https://doi.org/10.22266/ijies2022.1031.26

    Article  Google Scholar 

  51. Pawening RE, Dijaya R, Brian T, Suciati N (2015) classification of textile image using support vector machine with textural feature. In: 2015 international conference on information and communication technology and systems (ICTS). IEEE, pp 119–122

  52. Diao G, Zhao L, Yao Y (2015) A dynamic quality control approach by improving dominant factors based on improved principal component analysis. Int J Prod Res 53:4287–4303. https://doi.org/10.1080/00207543.2014.997400

    Article  Google Scholar 

  53. Yildiz K (2017) Dimensionality reduction-based feature extraction and classification on fleece fabric images. Signal Image Video Process 11:317–323. https://doi.org/10.1007/s11760-016-0939-9

    Article  Google Scholar 

  54. Serdaroglu A, Ertuzun A, Ercil A (2006) Defect detection in textile fabric images using wavelet transforms and independent component analysis. Pattern Recognit Image Anal 16:61–64. https://doi.org/10.1134/S1054661806010196

    Article  Google Scholar 

  55. Sezer OG, Ercil A, Ertuzun A (2007) Using perceptual relation of regularity and anisotropy in the texture with independent component model for defect detection. Pattern Recognit 40:121–133. https://doi.org/10.1016/j.patcog.2006.05.023

    Article  Google Scholar 

  56. Al Mamun A, Bappy MM, Mudiyanselage AS et al (2023) Multi-channel sensor fusion for real-time bearing fault diagnosis by frequency-domain multilinear principal component analysis. Int J Adv Manuf Technol 124:1321–1334. https://doi.org/10.1007/s00170-022-10525-4

    Article  Google Scholar 

  57. Hu C, He S, Wang Y (2021) A classification method to detect faults in a rotating machinery based on kernelled support tensor machine and multilinear principal component analysis. Appl Intell 51:2609–2621. https://doi.org/10.1007/s10489-020-02011-9

    Article  Google Scholar 

  58. Jeyaraj PR, Samuel Nadar ER (2019) Computer vision for automatic detection and classification of fabric defect employing deep learning algorithm. Int J Cloth Sci Technol 31:510–521. https://doi.org/10.1108/IJCST-11-2018-0135

    Article  Google Scholar 

  59. Zhang D, Gao X (2021) Soft sensor of flotation froth grade classification based on hybrid deep neural network. Int J Prod Res 59:4794–4810. https://doi.org/10.1080/00207543.2021.1894366

    Article  Google Scholar 

  60. Boonsirisumpun N, Puarungroj W (2018) Loei fabric weaving pattern recognition using deep neural network. In: 2018 15th international joint conference on computer science and software engineering (JCSSE). IEEE, pp 1–6

  61. Meng S, Pan R, Gao W et al (2021) A multi-task and multi-scale convolutional neural network for automatic recognition of woven fabric pattern. J Intell Manuf 32:1147–1161. https://doi.org/10.1007/s10845-020-01607-9

    Article  Google Scholar 

  62. Rizki Y, Medikawati Taufiq R, Mukhtar H, et al (2020) Comparison between faster R-CNN and CNN in recognizing weaving patterns. In: 2020 international conference on informatics, multimedia, cyber and information system (ICIMCIS). IEEE, pp 81–86

  63. Maged A, Lui CF, Haridy S, Xie M (2023) Variational autoencoders-LSTM based fault detection of time-dependent high dimensional processes. Int J Prod Res. https://doi.org/10.1080/00207543.2023.2175591

    Article  Google Scholar 

  64. Al MA, Nabi MM, Islam F et al (2023) Streamline video-based automatic fabric pattern recognition using Bayesian-optimized convolutional neural network. J Text Inst. https://doi.org/10.1080/00405000.2023.2269760

    Article  Google Scholar 

  65. Makaremi M, Razmjooy N, Ramezani M (2018) A new method for detecting texture defects based on modified local binary pattern. Signal Image Video Process 12:1395–1401. https://doi.org/10.1007/s11760-018-1294-9

    Article  Google Scholar 

  66. Heikkilä M, Pietikäinen M, Schmid C (2009) Description of interest regions with local binary patterns. Pattern Recognit 42:425–436. https://doi.org/10.1016/j.patcog.2008.08.014

    Article  Google Scholar 

  67. Malhotra A, Sankaran A, Mittal A, Vatsa M, Singh R (2017) Fingerphoto authentication using smartphone camera captured under varying environmental conditions. Human recognition in unconstrained environments. Elsevier, pp 119–144. https://doi.org/10.1016/B978-0-08-100705-1.00006-3

    Chapter  Google Scholar 

  68. Faber NM, Bro R, Hopke PK (2003) Recent developments in CANDECOMP/PARAFAC algorithms: a critical review. Chemom Intell Lab Syst 65:119–137. https://doi.org/10.1016/S0169-7439(02)00089-8

    Article  Google Scholar 

  69. Uschmajew A (2012) Local convergence of the alternating least squares algorithm for canonical tensor approximation. SIAM J Matrix Anal Appl 33:639–652. https://doi.org/10.1137/110843587

    Article  MathSciNet  Google Scholar 

  70. Wu C, Liu F, Zhu B (2015) Control chart pattern recognition using an integrated model based on binary-tree support vector machine. Int J Prod Res 53:2026–2040. https://doi.org/10.1080/00207543.2014.948222

    Article  Google Scholar 

  71. Sheykhmousa M, Mahdianpari M, Ghanbari H et al (2020) Support vector machine versus random forest for remote sensing image classification: a meta-analysis and systematic review. IEEE J Sel Top Appl Earth Obs Remote Sens 13:6308–6325. https://doi.org/10.1109/JSTARS.2020.3026724

    Article  Google Scholar 

  72. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A (2020) A comprehensive survey on support vector machine classification: applications challenges and trends. Neurocomputing 408:189–215. https://doi.org/10.1016/j.neucom.2019.10.118

    Article  Google Scholar 

  73. Tharwat A (2021) Classification assessment methods. Appl Comput Inform 17:168–192. https://doi.org/10.1016/j.aci.2018.08.003

    Article  Google Scholar 

  74. Deng X, Liu Q, Deng Y, Mahadevan S (2016) An improved method to construct basic probability assignment based on the confusion matrix for classification problem. Inf Sci 340–341:250–261. https://doi.org/10.1016/j.ins.2016.01.033

    Article  Google Scholar 

  75. Davis J, Goadrich M (2006) The relationship between precision-recall and ROC curves. In: proceedings of the 23rd international conference on machine learning—ICML’06 ACM Press, New York, New York, USA, pp 233–240

  76. Cao LJ, Chua KS, Chong WK et al (2003) A comparison of PCA, KPCA and ICA for dimensionality reduction in support vector machine. Neurocomputing 55:321–336. https://doi.org/10.1016/S0925-2312(03)00433-8

    Article  Google Scholar 

  77. Young SR, Rose DC, Karnowski TP, et al (2015) Optimizing deep learning hyper-parameters through an evolutionary algorithm. In: proceedings of the workshop on machine learning in high-performance computing environments. ACM, New York, NY, USA, pp 1–5

  78. Güneş A, Kalkan H, Durmuş E (2016) Optimizing the color-to-grayscale conversion for image classification. Signal Image Video Process 10:853–860. https://doi.org/10.1007/s11760-015-0828-7

    Article  Google Scholar 

  79. Kanan C, Cottrell GW (2012) Color-to-grayscale: does the method matter in image recognition? PLoS ONE 7:e29740. https://doi.org/10.1371/journal.pone.0029740

    Article  Google Scholar 

  80. Al MA, Liu C, Kan C, Tian W (2021) Real-time process authentication for additive manufacturing processes based on in-situ video analysis. Procedia Manuf 53:697–704. https://doi.org/10.1016/j.promfg.2021.06.068

    Article  Google Scholar 

Download references

Acknowledgements

The authors express their gratitude to the Department of Human Sciences at Mississippi State University for their invaluable technical support and for facilitating the acquisition of fabric swatches, which were instrumental in conducting this research.

Funding

The authors did not receive any financial assistance or related support for the preparation and composition of this manuscript.

Author information

Authors and Affiliations

Authors

Contributions

Abdullah Al Mamun: conceptualization, supervision, methodology, statistical computing, original draft preparation, review, and editing. Md. Imranul Islam: conceptualization, methodology, original draft preparation, and supervision. Md Abu Sayeed Shohag: methodology, statistical computing, review, and editing. Wael Al-Kouz: methodology, supervision, review, and editing. K. M. Abdun Noor: methodology, review, and editing.

Corresponding author

Correspondence to Abdullah Al Mamun.

Ethics declarations

Conflict of interest

The authors declare no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Al Mamun, A., Islam, M.I., Shohag, M.A.S. et al. Multilinear principal component analysis-based tensor decomposition for fabric weave pattern recognition from high-dimensional streaming data. Pattern Anal Applic 27, 100 (2024). https://doi.org/10.1007/s10044-024-01318-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10044-024-01318-4

Keywords

Navigation