Deep Learning Advancements in Railway Track Segmentation: Previous Studies and Improvements

Abstract views: 8 / PDF downloads: 6


  • Utku Kaya Eskisehir Technical University
  • Turan Teymurbaylı



Deep learning, Railway track segmentation, Convolutional neural networks


This article focuses on investigating the utilization of deep convolutional neural networks for segmenting railway tracks. Deep learning, which aims to simplify data processing by emulating human intelligence on computers, plays a significant role in this regard. Railway tracks are widely recognized for their importance in railway transportation. Consequently, ensuring track integrity requires thorough surface scanning. However, considering the extensive expanse of railway tracks, manual scanning proves to be a challenging and time-consuming task. Railway track segmentation serves as a fundamental step in identifying track defects, enabling easier detection by extracting tracks from surrounding images. This article discusses various studies conducted in this field and provides insights into the advantages offered by each approach.


Sresakoolchai, J., & Kaewunruen, S. (2021). Detection and severity evaluation of combined rail defects using deep learning. Vibration, 4(2), 341-356.

Xu, Q., Zhao, Q., Yu, G., Wang, L., & Shen, T. (2020, July). Rail defect detection method based on recurrent neural network. In 2020 39th Chinese Control Conference (CCC) (pp. 6486-6490). IEEE.

Chen, Z., Wang, Q., He, Q., Yu, T., Zhang, M., & Wang, P. (2022). CUFuse: Camera and ultrasound data fusion for rail defect detection. IEEE Transactions on Intelligent Transportation Systems, 23(11), 21971-21983.

Boronakhin, A. M., Podgornaya, L. N., Bokhman, E. D., Filipenya, N. S., Filatov, Y. V., Shalymov, R. B., & Larionov, D. Y. (2011). MEMS-based inertial system for railway track diagnostics. Gyroscopy and navigation, 2, 261-268.

Antipov, A. G., & Markov, A. A. (2019). Detectability of rail defects by magnetic flux leakage method. Russian journal of nondestructive testing, 55, 277-285.

Liang, Z., Zhang, H., Liu, L., He, Z., & Zheng, K. (2018, July). Defect detection of rail surface with deep convolutional neural networks. In 2018 13th World Congress on Intelligent Control and Automation (WCICA) (pp. 1317-1322). IEEE.

Gibert, X., Patel, V. M., & Chellappa, R. (2016). Deep multitask learning for railway track inspection. IEEE transactions on intelligent transportation systems, 18(1), 153-164.

James, A., Jie, W., Xulei, Y., Chenghao, Y., Ngan, N. B., Yuxin, L., ... & Zeng, Z. (2018, December). Tracknet-a deep learning based fault detection for railway track inspection. In 2018 International Conference on Intelligent Rail Transportation (ICIRT) (pp. 1-5). IEEE.

Zahran, O., & Al-Nuaimy, W. (2004). Automatic segmentation of time-of-flight diffraction images using time-frequency techniques application to rail-track defect detection. Insight-Non-Destructive Testing and Condition Monitoring, 46(6), 338-343.

Zhao, J., Chan, A. H. C., & Burrow, M. P. N. (2009). A genetic-algorithm-based approach for scheduling the renewal of railway track components. Proceedings of the Institution of Mechanical Engineers, Part F: Journal of Rail and Rapid Transit, 223(6), 533-541.

Guler, H. (2014). Prediction of railway track geometry deterioration using artificial neural networks: a case study for Turkish state railways. Structure and Infrastructure Engineering, 10(5), 614-626.

Giben, X., Patel, V. M., & Chellappa, R. (2015, September). Material classification and semantic segmentation of railway track images with deep

convolutional neural networks. In 2015 IEEE International Conference on Image Processing (ICIP) (pp. 621-625). IEEE.

Mittal, S., & Rao, D. (2017). Vision based railway track monitoring using deep learning. arXiv preprint arXiv:1711.06423.

Guo, F., Qian, Y., Wu, Y., Leng, Z., & Yu, H. (2021). Automatic railroad track components inspection using real‐time instance segmentation. Computer‐Aided Civil and Infrastructure Engineering, 36(3), 362-377.

Meng, S., Kuang, S., Ma, Z., & Wu, Y. (2022). MtlrNet: An effective deep multitask learning architecture for rail crack detection. IEEE Transactions on Instrumentation and Measurement, 71, 1-10.

Lateef, F., & Ruichek, Y. (2019). Survey on semantic segmentation using deep learning techniques. Neurocomputing, 338, 321-348.

Zeiler, M. D., & Fergus, R. (2014). Visualizing and understanding convolutional networks. In Computer Vision–ECCV 2014: 13th European Conference, Zurich, Switzerland, September 6-12, 2014, Proceedings, Part I 13 (pp. 818-833). Springer International Publishing.

Long, J., Shelhamer, E., & Darrell, T. (2015). Fully convolutional networks for semantic segmentation. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 3431-3440).

Qi, G. J. (2016). Hierarchically gated deep networks for semantic segmentation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 2267-2275).

Zhang, D., Song, K., Xu, J., He, Y., Niu, M., & Yan, Y. (2020). MCnet: Multiple context information segmentation network of no-service rail surface defects. IEEE Transactions on Instrumentation and Measurement, 70, 1-9.

Garcia-Garcia, A., Orts-Escolano, S., Oprea, S., Villena-Martinez, V., & Garcia-Rodriguez, J. (2017). A review on deep learning techniques applied to semantic segmentation. arXiv preprint arXiv:1704.06857.

Li, X., Zhu, L., Yu, Z., Guo, B., & Wan, Y. (2020). Vanishing point detection and rail segmentation based on deep multi-task learning. IEEE Access, 8, 163015-163025.

Yuan, H., Chen, H., Liu, S., Lin, J., & Luo, X. (2019, October). A deep convolutional neural network for detection of rail surface defect. In 2019 IEEE vehicle power and propulsion conference (VPPC) (pp. 1-4). IEEE.

Wu, Y., Qin, Y., Qian, Y., Guo, F., Wang, Z., & Jia, L. (2022). Hybrid deep learning architecture for rail surface segmentation and surface defect detection. Computer‐Aided Civil and Infrastructure Engineering, 37(2), 227-244.

Yanan, S., Hui, Z., Li, L., & Hang, Z. (2018, November). Rail surface defect detection method based on YOLOv3 deep learning networks. In 2018 chinese automation congress (CAC) (pp. 1563-1568). IEEE.

Kim, H., Lee, S., & Han, S. (2020). Railroad Surface Defect Segmentation Using a Modified Fully Convolutional Network. KSII Transactions on Internet & Information Systems, 14(12).

Wang, Y., Zhu, L., Yu, Z., & Guo, B. (2019). An adaptive track segmentation algorithm for a railway intrusion detection system. Sensors, 19(11), 2594.

Bojarczak, P., & Nowakowski, W. (2021). Application of Deep Learning Networks to Segmentation of Surface of Railway Tracks. Sensors, 21(12), 4065.

Yang, H., Li, X., Guo, Y., & Jia, L. (2022). RT-GAN: GAN Based Architecture for Precise Segmentation of Railway Tracks. Applied Sciences, 12(23), 12044.

Song, Z., Yamada, T., Shitara, H., & Takemura, Y. (2011). Detection of damage and crack in railhead by using eddy current testing. Journal of Electromagnetic Analysis and Applications, 2011.




How to Cite

Kaya, U., & Teymurbaylı, T. (2023). Deep Learning Advancements in Railway Track Segmentation: Previous Studies and Improvements. Journal of Natural Sciences and Technologies, 2(1), 191–194.