Automatic Crack Detection Using Convolutional Neural Network

Document Type : Regular Article

Authors

1 B Tech, Department of Civil Engineering, Institute of Technology, Nirma University, Ahmedabad, Gujarat, India

2 Associate Professor, Department of Civil Engineering, Institute of Technology, Nirma University, Ahmedabad, Gujarat, India

Abstract

Manual inspection of cracks on concrete surfaces requires wholesome knowledge and depends entirely on the expertise and capabilities of the inspector. This study proposes the use of a simple Convolutional Neural Network (CNN) for automatic crack detection. A comparative approach for Automated Crack Detection is presented between Feed-Forward Fully Connected Neural Networks and CNN, focusing on the primary hyperparameters affecting the accuracy of both systems. An inclination towards CNN is concluded due to its simplicity and computational efficiency. For the purpose of this study, the input data is extracted from an open-source platform. In the second step, the images are pre-processed for obtaining low-pixel density images with the aim to get better accuracy at lower computer power. The CNN proposed uses Max Pooling and appropriate optimization techniques. The model is trained to detect and segregate cracked and non-cracked concrete surfaces through input images. The proposed model predicts and labels images with cracks on concrete surfaces and images with no cracks using pixel-level information. The final accuracy achieved is 97.8% by the proposed CNN model. The proposed model is a novel approach to detecting cracks on low pixel density images of concrete surfaces for its economic and processing efficiency and thus eliminates the need for high-cost digital image capturing devices. This study signifies and confirms the impact of Artificial Intelligence in the Civil Engineering field where using simple techniques like a simple four-layered Neural Network is capable of carrying automatic inspection of cracks which can be further developed for other applications.

Keywords


[1]     Avendaño J. Identification and quantification of concrete cracks using image analysis and machine learning. KTH VETENSKAP OCH KONST, 2020.
[2]     O’ Mahony N, Campbell S, Carvalho A, Harapanahalli S, Velasco Hernandez G, Krpalkova L, et al. Deep Learning vs. Traditional Computer Vision. n.d.
[3]     Barrias A, Casas JR, Villalba S. Embedded distributed optical fiber sensors in reinforced concrete structures - A case study. Sensors (Switzerland) 2018;18. https://doi.org/10.3390/s18040980.
[4]     Feng H, Member S, Li W, Luo Z, Chen Y, Member S, et al. GCN-Based Pavement Crack Detection Using Mobile LiDAR Point Clouds. n.d.
[5]     Yan J, Downey A, Cancelli A, Laflamme S, Chen A, Li J, et al. Concrete crack detection and monitoring using a capacitive dense sensor array. Sensors (Switzerland) 2019;19. https://doi.org/10.3390/s19081843.
[6]     Downey A, D’Alessandro A, Ubertini F, Laflamme S. Automated crack detection in conductive smart-concrete structures using a resistor mesh model. Meas Sci Technol 2018;29. https://doi.org/10.1088/1361-6501/aa9fb8.
[7]     Kim H, Lee S, Ahn E, Shin M, Sim SH. Crack identification method for concrete structures considering angle of view using RGB-D camera-based sensor fusion. Struct Heal Monit 2021;20:500–12. https://doi.org/10.1177/1475921720934758.
[8]     Cho S, Park S, Cha G, Oh T. Development of Image Processing for Crack Detection on Concrete Structures through Terrestrial Laser Scanning Associated with the Octree Structure. Appl Sci 2018;8. https://doi.org/10.3390/app8122373.
[9]     Farhangi V, Jahangir H, Rezazadeh Eidgahee D, Karimipour A, Javan SAN, Hasani H, et al. Behaviour Investigation of SMA-Equipped Bar Hysteretic Dampers Using Machine Learning Techniques. Appl Sci 2021;11:10057. https://doi.org/10.3390/app112110057.
[10]   Khaleghi M, Salimi J, Farhangi V, Moradi MJ, Karakouzian M. Evaluating the behaviour of centrally perforated unreinforced masonry walls: Applications of numerical analysis, machine learning, and stochastic methods. Ain Shams Eng J 2022;13. https://doi.org/10.1016/j.asej.2021.10.026.
[11]   Chen C, Chandra S, Han Y, Seo H. Deep learning-based thermal image analysis for pavement defect detection and classification considering complex pavement conditions. Remote Sens 2022;14. https://doi.org/10.3390/rs14010106.
[12]   Sarker IH. Deep Learning: A Comprehensive Overview on Techniques, Taxonomy, Applications and Research Directions. SN Comput Sci 2021;2. https://doi.org/10.1007/s42979-021-00815-1.
[13]   Byrne MO, Schoefs F, Gosh B, Pakrashi V, Analysis T, Damage B, et al. Texture Analysis Based Damage Detection of Ageing Infrastructural Elements. Comput Civ Infrastruct Eng Wiley 2013;28:162–77.
[14]   Kalfarisi R, Wu ZY, Soh K. Crack Detection and Segmentation Using Deep Learning with 3D Reality Mesh Model for Quantitative Assessment and Integrated Visualization. J Comput Civ Eng 2020;34:04020010. https://doi.org/10.1061/(asce)cp.1943-5487.0000890.
[15]   Li S, Zhao X, Zhou G. Automatic pixel-level multiple damage detection of concrete structure using fully convolutional network. Comput Civ Infrastruct Eng 2019;34:616–34. https://doi.org/10.1111/mice.12433.
[16]   Gao YQ, Li KB, Mosalam KM, Gunay S. Deep residual network with transfer learning for image-based structural damage recognition. 11th Natl. Conf. Earthq. Eng. 2018, NCEE 2018 Integr. Sci. Eng. Policy, vol. 11, 2018, p. 6971–81.
[17]   Fang F, Li L, Gu Y, Zhu H, Lim JH. A novel hybrid approach for crack detection. Pattern Recognit 2020;107. https://doi.org/10.1016/j.patcog.2020.107474.
[18]   Dorafshan S, Thomas RJ, Maguire M. Comparison of Deep Convolutional Neural Networks and Edge Detectors for Image-Based Crack Detection in Concrete. n.d.
[19]   Qiao W, Liu Q, Wu X, Ma B, Li G. Automatic pixel-level pavement crack recognition using a deep feature aggregation segmentation network with a scse attention mechanism module. Sensors 2021;21. https://doi.org/10.3390/s21092902.
[20]   Flood I, Kartam N. Neural Networks in Civil Engineering. I: Principles and Understanding. J Comput Civ Eng 1994;8:131–48. https://doi.org/10.1061/(ASCE)0887-3801(1994)8:2(131).
[21]   Flood I, Kartam N. NEURAL NETWORKS IN CIVIL ENGINEERING. II: SYSTEMS AND APPLICATION. J Comput Civ Eng 1994;8:149–62.
[22]   Hinton G, Osindero S, Teh Y-W. A Fast Learning Algorithm for Deep Belief Nets Geoffrey. Neural Comput 2006;1:1527–54. https://doi.org/10.7763/ijesd.2010.v1.67.
[23]   Park S, Bang S, Kim H, Kim H. Patch-Based Crack Detection in Black Box Images Using Convolutional Neural Networks. J Comput Civ Eng 2019;33:04019017. https://doi.org/10.1061/(asce)cp.1943-5487.0000831.
[24]   Hsieh Y-A, Tsai YJ. Machine Learning for Crack Detection: Review and Model Performance Comparison. J Comput Civ Eng 2020;34:04020038. https://doi.org/10.1061/(asce)cp.1943-5487.0000918.
[25]   Zhang L, Yang F, Daniel Zhang Y, Zhu YJ. Road crack detection using deep convolutional neural network. 2016 IEEE Int. Conf. Image Process., IEEE; 2016, p. 3708–12. https://doi.org/10.1109/ICIP.2016.7533052.
[26]   Hirasawa K, Ohbayashi M, Koga M, Harada M. Forward propagation universal learning network. IEEE Int Conf Neural Networks - Conf Proc 1996;1:353–8. https://doi.org/10.1109/icnn.1996.548917.
[27]   Hu GX, Hu BL, Yang Z, Huang L, Li P. Pavement Crack Detection Method Based on Deep Learning Models. Wirel Commun Mob Comput 2021;2021:1–13. https://doi.org/10.1155/2021/5573590.
[28]   Chun P, Izumi S, Yamane T. Automatic detection method of cracks from concrete surface imagery using two‐step light gradient boosting machine. Comput Civ Infrastruct Eng 2021;36:61–72. https://doi.org/10.1111/mice.12564.
[29]   Yu Y, Rashidi M, Samali B, Mohammadi M, Nguyen TN, Zhou X. Crack detection of concrete structures using deep convolutional neural networks optimized by enhanced chicken swarm algorithm. Struct Heal Monit 2022:147592172110535. https://doi.org/10.1177/14759217211053546.
[30]   Andrushia A D, N A, Lubloy E, G PA. Deep learning based thermal crack detection on structural concrete exposed to elevated temperature. Adv Struct Eng 2021;24:1896–909. https://doi.org/10.1177/1369433220986637.
[31]   Chehri A, Saeidi A. IoT and Deep Learning Solutions for an Automated Crack Detection for the Inspection of Concrete Bridge Structures, 2021, p. 110–9. https://doi.org/10.1007/978-981-16-3264-8_11.
[32]   Zhao W, Liu Y, Zhang J, Shao Y, Shu J. Automatic pixel‐level crack detection and evaluation of concrete structures using deep learning. Struct Control Heal Monit 2022;29. https://doi.org/10.1002/stc.2981.
[33]   Munawar HS, Hammad AWA, Haddad A, Soares CAP, Waller ST. Image-Based Crack Detection Methods: A Review. Infrastructures 2021;6:115. https://doi.org/10.3390/infrastructures6080115.
[34]   Özgenel F, Gönenç Sorguç A. Performance comparison of pretrained convolutional neural networks on crack detection in buildings. ISARC 2018 - 35th Int. Symp. Autom. Robot. Constr. Int. AEC/FM Hackathon Futur. Build. Things, International Association for Automation and Robotics in Construction I.A.A.R.C); 2018. https://doi.org/10.22260/isarc2018/0094.