Screen recapture detection based on color-texture analysis of document boundary regions

Автор: Kunina I.A., Sher A.V., Nikolaev D.P.

Журнал: Компьютерная оптика @computer-optics

Рубрика: Обработка изображений, распознавание образов

Статья в выпуске: 4 т.47, 2023 года.

Бесплатный доступ

This paper examines a presentation attack detection when a document recaptured from a screen is presented instead of the original document. We propose an algorithm based on analyzing a moiré pattern within document boundary regions as a distinctive feature of the recaptured image. It is assumed that the pattern overlapping the document boundaries is a recapture artifact, not a match between document and background textures. To detect such a pattern, we propose an algorithm that employs the result of the fast Hough transform of the document boundary regions with enhanced pattern contrast. The algorithm performance was measured for the open dataset DLC-2021, which contains images of mock documents as originals and their screen recaptures. The precision of the proposed solution was evaluated as 95.4 %, and the recall as 90.5 %.

Еще

Document analysis, document liveness detection, screen recapture detection, fast hough transform

Короткий адрес: https://sciup.org/140301838

IDR: 140301838   |   DOI: 10.18287/2412-6179-CO-1237

Список литературы Screen recapture detection based on color-texture analysis of document boundary regions

  • Kada O., Kurtz C., van Kieu C., Vincent N. Hologram Detection for Identity Document Authentication. In Pattern Recognition and Artificial Intelligence: Third International Conference, ICPRAI 2022, Paris, France, June 1 - 3, 2022, Proceedings, Part I. Cham: Springer International Publishing. 346-357. DOI: https://doi.org/10.1007/978-3-031-09037-0_29.
  • Chernyshova YS, Aliev MA, Gushchanskaia ES, Sheshkus AV. (2019, March). Optical font recognition in smartphone-captured images and its applicability for ID forgery detection, Proc. SPIE 11041, Eleventh International Conference on Machine Vision (ICMV 2018), 110411J (15 March 2019). DOI: https://doi.org/10.1117/12.2522955.
  • Polevoy DV, Sigareva IV, Ershova DM, Arlazarov VV, Nikolaev DP, Ming Z, Luqman MM, Burie J-C. Document Liveness Challenge Dataset (DLC-2021). Journal of Imaging. 2022; 8(7): 181. DOI: https://doi.org/10.3390/jimaging8070181.
  • Mahdian, B., Novozamsky, A., Saic, S. Identification of aliasing-based patterns in re-captured LCD screens. In 2015 IEEE International Conference on Image Processing (ICIP) (pp. 616-620). IEEE. DOI: 10.1109/ICIP.2015.7350872.
  • Thongkamwitoon T., Muammar H., Dragotti P.L. An image recapture detection algorithm based on learning dictionaries of edge profiles. IEEE Transactions on Information Forensics and Security, 10(5), 953-968. DOI: 10.1109/TIFS.2015.2392566.
  • Zhu N., Li Z. Recaptured Image Detection Through Enhanced Residual-Based Correlation Coefficients. In: Sun, X., Pan, Z., Bertino, E. (eds) Cloud Computing and Security. ICCCS 2018. Lecture Notes in Computer Science, vol 11068. Springer, Cham. DOI: https://doi.org/10.1007/978-3-030-00021-9_55.
  • Yang C, Yang Z, Ke Y, Chen T, Grzegorzek M, See J. Doing More With Moir'e Pattern Detection in Digital Photos. IEEE Transactions on Image Processing, 32. 2023. 694-708. DOI: 10.1109/TIP.2022.3232232.
  • Garcia DC, de Queiroz RL. Face-spoofing 2D-detection based on Moiré-pattern analysis. IEEE transactions on information forensics and security, 10(4), 778-786. DOI: 10.1109/TIFS.2015.2411394.
  • Garcia DC, de Queiroz RL. Evaluating the effects of image compression in Moiré-pattern-based face-spoofing detection. In 2015 IEEE International Conference on Image Processing (ICIP). 4843-4847. IEEE. DOI: 10.1109/ICIP.2015.7351727.
  • Benlamoudi A, Bekhouche SE, Korichi M, Bensid K, Ouahabi A, Hadid A, Taleb-Ahmed A. Face Presentation Attack Detection Using Deep Background Subtraction. Sensors. 2022; 22(10):3760. https://doi.org/10.3390/s22103760.
  • Yan, J., Chen, C. Cross-domain recaptured document detection with texture and reflectance characteristics. In 2021 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC). 1708-1715.
  • Chen C, Zhao L, Yan J, Li H. A distortion model-based pre-screening method for document image tampering localization under recapturing attack. Signal Processing, 200. 2022. 108666. DOI: https://doi.org/10.1016/j.sigpro.2022.108666.
  • Mudgalgundurao, R., Schuch, P., Raja, K., Ramachandra, R., Damer, N. Pixel-wise supervision for presentation attack detection on identity document cards. IET Biometrics, 11(5). 2022. 383-395. DOI: https://doi.org/10.1049/bme2.12088.
  • Abraham E. Moiré pattern detection using wavelet decomposition and convolutional neural network. In 2018 IEEE Symposium Series on Computational Intelligence (SSCI). 2018. 1275-1279. DOI: 10.1109/SSCI.2018.8628746.
  • Brady ML, Yong W. Fast parallel discrete approximation algorithms for the Radon transform. SPAA '92: Proceedings of the fourth annual ACM symposium on Parallel algorithms and architectures. 1992 91-99. DOI: https://doi.org/10.1145/140901.140911.
  • Aliev M, Ershov EI, Nikolaev DP. On the use of FHT, its modification for practical applications and the structure of Hough image. Proc. SPIE 11041, Eleventh International Conference on Machine Vision (ICMV 2018). 1104119. 2019. DOI: https://doi.org/10.1117/12.2522803.
  • Hough PV. Machine analysis of bubble chamber pictures. In International Conference on High Energy Accelerators and Instrumentation, CERN. 1959. 554-556.
  • Finlayson GD, Schiele B, Crowley JL. Comprehensive colour image normalization. In: Burkhardt, H., Neumann, B. (eds) Computer Vision - ECCV'98. ECCV 1998. Lecture Notes in Computer Science, V.1406. Springer, Berlin, Heidelberg. DOI: https://doi.org/10.1007/BFb0055685.
  • Smith AR. Color gamut transform pairs. ACM Siggraph Computer Graphics. 1978. V.12(3). 12-19.
  • Bezmaternykh PV, Nikolaev DP. A document skew detection method using fast Hough transform. Proc. SPIE 11433, Twelfth International Conference on Machine Vision (ICMV 2019), 114330J (31 January 2020). DOI: https://doi.org/10.1117/12.2559069.
Еще
Статья научная