Recent Implementation of Deep Learning Methods for Shoplifting Detection in Retail Environments Using Surveillance Videos
Main Article Content
Abstract
Shoplifting is a problem that continues to face retail businesses and is associated with a serious loss of revenue and security issues for retailers. The recent developments in deep learning have created new possibilities to develop intelligent surveillance systems that detect suspicious behaviour automatically and with high precision. This paper systematically reviews recent literature between 2018-2025 on deep learning methods for shoplifting detection in retail environments. It discusses the applications of deep learning mechanisms in the detection of shoplifting in retail settings. In addition, the paper presents methods that utilise Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs), and hybrid deep neural networks to detect shoplifting. Further discussions were presented on privacy-preserving architectures, behaviour analysis, and anomaly detection using surveillance videos. To ensure continued implementation by researchers, the paper outlines research gaps such as low levels of real-time use, poor general applicability in a variety of retail environments, low compliance with privacy, and ethical issues that require further research. The findings reveal that deep learning approaches are important artificial and machine learning techniques for shoplifting surveillance and detection of suspicious activities in retail settings for prompt prevention of crimes and thefts by business owners. Also, the study will add to the contained improvements to the existing body of knowledge in the field of computer vision, deep learning, and cybersecurity.
Article Details
Copyright (c) 2025 Chioma Virginia Anikwe-Onyiwa, Henry Friday Nweke, Kingsley Nnabuike Omeje (Author)
This work is licensed under a Creative Commons Attribution 4.0 International License.
Henry Friday Nweke, Computer Science Department, David Umahi Federal University of Health Sciences, P.M.B 211, Uburu, Ebonyi State, Nigeria.
Institute for Machine Learning, Robotics and Artificial Intelligence Research, David Umahi Federal University of Health Sciences, P.M.B 211, Uburu, Ebonyi State, Nigeria.
Abdolrasol, M. G. M., Suhail Hussain, S. M., Ustun, T. S., Sarker, M. R., Hannan, M. A., Mohamed, R., Ali, J. A., Mekhilef, S., & Milad, A. (2021). Artificial neural networks-based optimization techniques: A review. Electronics, 10(10), 2689. https://doi.org/10.3390/electronics10102689 DOI: https://doi.org/10.3390/electronics10212689
Adnan, K., & Akbar, R. (2019). Limitations of information extraction methods and techniques for
heterogeneous unstructured big data. International Journal of Engineering Business Management, 11, 1847979019890771.
Alsaiari, A., & Ilyas, M. (2025). A hybrid CNN-LSTM deep learning model for intrusion detection in smart grid. arXiv preprint arXiv:2509.07208. https://arxiv.org/abs/2509.07208 DOI: https://doi.org/10.5121/ijaia.2025.16501
Ansari, M. A., & Singh, D. K. (2022). An expert video surveillance system to identify and mitigate shoplifting in megastores. Multimedia Tools and Applications, 81(16), 22497–22525. DOI: https://doi.org/10.1007/s11042-021-11438-2
Ansari, M. A., & Singh, D. K. (2023). Optimized parameter tuning in a recurrent learning process for shoplifting activity classification. Cybernetics and Information Technologies, 23(1), 141–160. https://doi.org/10.2478/cait-2023-0008 DOI: https://doi.org/10.2478/cait-2023-0008
Arroyo, R., Yebes, J. J., Bergasa, L. M., Daza, I. G., & Almazán, J. (2015). Expert video-surveillance system for real-time detection of suspicious behaviors in shopping malls. Expert Systems with Applications, 42(21), 7991–8005. DOI: https://doi.org/10.1016/j.eswa.2015.06.016
Benthall, S., & Haynes, B. D. (2019). Racial categories in machine learning. In Proceedings of the Conference on Fairness, Accountability, and Transparency (pp. 289–298). DOI: https://doi.org/10.1145/3287560.3287575
Bhuiyan, M. R., Abdullah, J., Hashim, N., & Al Farid, F. (2022). Video analytics using deep
learning for crowd analysis: a review. Multimedia Tools and Applications, 81(19), 27895-27922.
Binetti, M. S., Massarelli, C., & Uricchio, V. F. (2024). Machine Learning in Geosciences: A Review of Complex Environmental Monitoring Applications. Machine Learning and Knowledge Extraction, 6(2), 1263-1280. https://doi.org/10.3390/make6020059 DOI: https://doi.org/10.3390/make6020059
Buet-Golfouse, F., & Utyagulov, I. (2022). Towards fair unsupervised learning. In Proceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency (pp. 1399–1409). DOI: https://doi.org/10.1145/3531146.3533197
Capital One Shopping. (2024). https://www.capitalone.com/ Accessed: November 20, 2024.
Chervonenkis, A. Y. (2013). Early history of support vector machines. In Empirical Inference: Festschrift in Honor of Vladimir N. Vapnik (pp. 13–20). https://doi.org/10.1007/978-3-642-41136-6_2 DOI: https://doi.org/10.1007/978-3-642-41136-6_3
Choudhry, N., Abawajy, J., Huda, S., & Rao, I. (2023). A comprehensive survey of machine
learning methods for surveillance videos anomaly detection. IEEE Access, 11, 114680-114713. DOI: https://doi.org/10.1109/ACCESS.2023.3321800
Dramsch, J. S. (2020). 70 years of machine learning in geoscience in review. Advances in Geophysics, 61, 1–55. https://doi.org/10.1016/bs.agph.2020.05.001 DOI: https://doi.org/10.1016/bs.agph.2020.08.002
Guan, Y., & Plötz, T. (2017). Ensembles of deep lstm learners for activity recognition using DOI: https://doi.org/10.1145/3090076
wearables. Proceedings of the ACM on interactive, mobile, wearable and ubiquitous technologies, 1(2), 1-28.
He, H., Ming, Z., Zhang, J., Wang, L., Yang, R., Chen, T., & Zhou, F. (2024). Robust estimation of landslide displacement from multitemporal UAV photogrammetry-derived point clouds. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 17, 6627–6641. https://doi.org/10.1109/JSTARS.2024.XXXXX DOI: https://doi.org/10.1109/JSTARS.2024.3373505
Hirschorn, O., & Avidan, S. (2023). Normalizing Flows for Human Pose Anomaly Detection. In Proceedings of the IEEE/CVF International Conference on Computer Vision (pp. 13545–13554). DOI: https://doi.org/10.1109/ICCV51070.2023.01246
Hofman, O., Giloni, A., Hayun, Y., Morikawa, I., Shimizu, T., Elovici, Y., & Shabtai, A. (2024).
X-detect: Explainable adversarial patch detection for object detectors in retail. Machine Learning, 113(9), 6273-6292. DOI: https://doi.org/10.1007/s10994-024-06548-5
Islam, M. S., Sultana, S., Kumar Roy, U., & Al Mahmud, J. (2020). A review on video
classification with methods, findings, performance, challenges, limitations and future work. Jurnal Ilmiah Teknik Elektro Komputer dan Informatika, 6(2), 47-57. DOI: https://doi.org/10.26555/jiteki.v6i2.18978
Issa, A., & Aldair, A. (2022). Learning the quadruped robot by reinforcement learning (RL). Iraqi Journal for Electrical and Electronic Engineering, 18(1), 1–8. DOI: https://doi.org/10.37917/ijeee.18.2.15
Jabur, S. A., Alzubaidi, L., Hussein, K. A., Hoomod, H. K., Saihood, A. A., & Gu, Y. T. (2024). A scalable and generalized deep learning framework for anomaly detection in surveillance videos. Department of Computer Sciences, University of Technology, Baghdad, Iraq. DOI: https://doi.org/10.1155/int/1947582
Jia, Y., Anida Abdullah, N., Eliza, H., Lu, Q., Si, D., Guo, H., & Wang, W. (2025). A narrative
review of deep learning applications in sports performance analysis: current practices, challenges, and future directions. BMC Sports Science, Medicine and Rehabilitation, 17(1), 249.
Kang, B., Chen, X., Lai, S., Liu, Y., Liu, Y., & Wang, D. (2025, April). Exploring enhanced
contextual information for video-level object tracking. In Proceedings of the AAAI Conference on Artificial Intelligence (Vol. 39, No. 4, pp. 4194-4202). DOI: https://doi.org/10.1609/aaai.v39i4.32440
Khaldi, M. I., Erraissi, A., Hain, M., & Banane, M. (2025). Comparative analysis of supervised machine learning classification models. In Intersection of Artificial Intelligence, Data Science, and Cutting-Edge Technologies: From Concepts to Applications in Smart Environment (pp. 321–326). Springer. https://link.springer.com/chapter/10.1007/978-3-031-88304-0_44 DOI: https://doi.org/10.1007/978-3-031-88304-0_44
Kirichenko, L., Pichugina, O., Sydorenko, B., & Yakovlev, S. (2022a). Recognition of shoplifting activities in CCTV footage using the combined CNN-RNN model. In Progress in Polish Artificial Intelligence Research (Vol. 4). https://doi.org/10.34658/9788366741928.8
Kirichenko, L., Radivilova, T., Sydorenko, B., & Yakovlev, S. (2022b). Detection of shoplifting on video using a hybrid network. Computation, 10(11), 199. DOI: https://doi.org/10.3390/computation10110199
Kirichenko, L., Sydorenko, B., Radivilova, T., & Zinchenko, P. (2022c). Video surveillance shoplifting recognition based on a hybrid neural network. In 2022 IEEE 17th International Conference on Computer Sciences and Information Technologies (CSIT) (pp. 44–47). IEEE. DOI: https://doi.org/10.1109/CSIT56902.2022.10000545
Kumar, N. (2017, December). Machine intelligence prospective for large scale video based visual DOI: https://doi.org/10.1109/ICoAC.2017.8441320
activities analysis. In 2017 Ninth International Conference on Advanced Computing (ICoAC) (pp. 29-34). IEEE.
Kushwaha, A., Ravish, K., Lamba, P., & Kumar, P. (2025). A survey of safe reinforcement learning and constrained MDPs. arXiv preprint arXiv:2505.17342. https://arxiv.org/pdf/2505.17342
Liang, X., Ouyang, Y., Yang, H., & Zhang, Y. (2024). RL-OPC: Mask optimization with deep reinforcement learning. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 43(5), 1123–1135. DOI: https://doi.org/10.1109/TCAD.2023.3309745
LeCun, Y., Bengio, Y., & Hinton, G. (2015). Deep learning. nature, 521(7553), 436-444. DOI: https://doi.org/10.1038/nature14539
Liu, S., Yuan, H., Hu, M., & Zhang, J. (2024). RL-GPT: Integrating reinforcement learning and code-as-policy. arXiv preprint arXiv:2403.11245.
Manasa, S. (2025). A comparative study of supervised learning algorithms for real-time classification tasks. International Journal of Future Machine Research, 4(49854), 1–12. https://www.ijfmr.com/papers/2025/4/49854.pdf
Martínez-Mascorro, G. A., Abreu-Pederzini, J. R., Ortiz-Bayliss, J. C., Garcia-Collantes, A., & Terashima-Marín, H. (2021). Criminal intention detection at early stages of shoplifting cases by using 3D convolutional neural networks. Computation, 9(2), 24. https://doi.org/10.3390/computation9020024
Martínez-Mascorro, G. A., Abreu-Pederzini, J. R., Ortiz-Bayliss, J. C., & Terashima-Marín, H. (2020). Suspicious behavior detection on shoplifting cases for crime prevention by using 3D convolutional neural networks. arXiv preprint arXiv:2005.02142. https://arxiv.org/abs/2005.02142 DOI: https://doi.org/10.3390/computation9020024
Muneer, I., Saddique, M., Habib, Z., & Mohamed, H. G. (2023). Shoplifting detection using a hybrid neural network CNN-BiLSTM and development of a benchmark dataset. Applied Sciences, 13(14), 8341. https://doi.org/10.3390/app13148341 DOI: https://doi.org/10.3390/app13148341
Nagpal, S., Singh, M., Singh, R., & Vatsa, M. (2019). Deep learning for face recognition: Pride or prejudice? arXiv preprint arXiv:1904.01219.
Nazir, A., Mitra, R., Sulieman, H., & Kamalov, F. (2023). Suspicious behavior detection with temporal feature extraction and time-series classification for shoplifting crime prevention. Sensors, 23(13), 5811. https://doi.org/10.3390/s23135811 DOI: https://doi.org/10.3390/s23135811
Noghre, G. A., Pazho, A. D., Katariya, V., & Tabkhi, H. (2023). Understanding the challenges and opportunities of pose-based anomaly detection. In Proceedings of the 8th International Workshop on Sensor-Based Activity Recognition and Artificial Intelligence (pp. 1–9). DOI: https://doi.org/10.1145/3615834.3615844
Noghre, G. A., Yao, S., Pazho, A. D., Ardabili, B. R., Katariya, V., & Tabkhi, H. (2024). PHEVA: A privacy-preserving human-centric video anomaly detection dataset. arXiv preprint arXiv:2408.14329.
Nweke, H. F., Teh, Y. W., Al-Garadi, M. A., & Alo, U. R. (2018). Deep learning algorithms for
human activity recognition using mobile and wearable sensor networks: State of the art and research challenges. Expert Systems with Applications, 105, 233-261. DOI: https://doi.org/10.1016/j.eswa.2018.03.056
Osisanwo, F. Y., Akinsola, J. E. T., Awodele, O., Hinmikaiye, J. O., Olakanmi, O., & Akinjobi, J. (2017). Supervised machine learning algorithms: Classification and comparison. International Journal of Computer Trends and Technology, 48, 128–138. https://doi.org/10.14445/22312803/IJCTT-V48P126 DOI: https://doi.org/10.14445/22312803/IJCTT-V48P126
Pacchiano, A., Saha, A., & Lee, J. (2021). Dueling RL: Reinforcement learning with trajectory preferences. Proceedings of the 38th International Conference on Machine Learning, 139, 8325–8335.
Pandey, A., Mannepalli, P. K., Gupta, M., Dangi, R., & Choudhary, G. (2024). A deep learning-based hybrid CNN-LSTM model for location-aware web service recommendation. Neural Processing Letters, 56, Article 234. https://doi.org/10.1007/s11063-024-11687-w DOI: https://doi.org/10.1007/s11063-024-11687-w
Pazho, A. D., Neff, C., Noghre, G. A., Ardabili, B. R., Yao, S., Baharani, M., & Tabkhi, H. (2023). Ancilia: Scalable intelligent video surveillance for the artificial intelligence of things. IEEE Internet of Things Journal, 10(17), 14940–14951. DOI: https://doi.org/10.1109/JIOT.2023.3263725
Perumal, S., & Ganesh, M. K. (2025). Shoplifting detection system using YOLOv5, MediaPipe pose estimation, and machine learning-based behavior analysis. International Journal of Advance Research in Multidisciplinary, 3(2), 297–301. https://doi.org/10.5281/zenodo.15590304
Trung Pham, D., & Lukowski, F. (2024). BobDontRob: Hybrid Neural Network for Shoplifting
Detection: Detecting Theft from Camera Footage in Grocery Retail Stores.
Ragnoli, M., Esposito, P., Stornelli, V., Barile, G., Santis, E. D., & Sciarra, N. (2023, September 22–24). A LoRa-based wireless sensor network monitoring system for urban areas subjected to landslide. In Proceedings of the 2023 8th International Conference on Cloud Computing and Internet of Things (pp. 91–97). Okinawa, Japan. https://doi.org/10.1109/CCIT.2023.XXXXX DOI: https://doi.org/10.1145/3627345.3627359
Rashvand, N., Noghre, G. A., Pazho, A. D., Yao, S., & Tabkhi, H. (2025). Exploring Pose-Based Anomaly Detection for Retail Security: A Real-World Shoplifting Dataset and Benchmark. In Proceedings of the Winter Conference on Applications of Computer Vision (pp. 1123-1131). https://doi.org/10.1109/WACVW65960.2025.00125 DOI: https://doi.org/10.1109/WACVW65960.2025.00125
Singh, A., Thakur, N., & Sharma, A. (2016, March 16–18). A review of supervised machine learning algorithms. In Proceedings of the 2016 3rd International Conference on Computing for Sustainable Global Development (INDIACom). New Delhi, India.
Sultani, W., Chen, C., & Shah, M. (2018). Real-world anomaly detection in surveillance videos. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 6479–6488). DOI: https://doi.org/10.1109/CVPR.2018.00678
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., ... & Rabinovich, A. (2015).
Going deeper with convolutions. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1-9).
Tyagi, K., Rane, C., Sriram, R., & Manry, M. (2022). Unsupervised learning. In Artificial Intelligence, Machine Learning and Edge Computing (pp. 33–52). https://doi.org/10.1016/B978-0-323-89832-2.00002-6 DOI: https://doi.org/10.1016/B978-0-12-824054-0.00012-5
Umut, Ö., Atasoy, Y., Seskir, A., & Ateş, H. F. (2025). Shoplifting detection from customer behavior using deep learning. Signal, Image and Video Processing, 19, Article 988. https://link.springer.com/article/10.1007/s11760-025-04543-4 DOI: https://doi.org/10.1007/s11760-025-04543-4
Waradpande, V., Kudenko, D., & Khosla, M. (2020). Graph-based state representation for deep reinforcement learning. Proceedings of the 16th International Workshop on Mining and Learning with Graphs (MLG ’20), 1–8.
Woods, W. (2021). RL-GRIT: Reinforcement learning for grammar inference. IEEE Security and Privacy Workshops (SPW), 2021, 1–6. DOI: https://doi.org/10.1109/SPW53761.2021.00031
Yogi, M. K., & Mundru, Y. (2024). Illuminating Evidence: Explainable AI in Cyber Crime Investigations. In Redefining Security With Cyber AI (pp. 195-229). IGI Global. DOI: https://doi.org/10.4018/979-8-3693-6517-5.ch011
Article Sidebar
