ICTACT Journal on Image and Video Processing

Open Access Open Access  Restricted Access Subscription Access
Open Access Open Access Open Access  Restricted Access Restricted Access Subscription Access

An Optimized Convolution Neural Network Based Inter-frame Forgery Detection Model - A Multi-feature Extraction Framework


Affiliations
1 School of Information Technology, Artificial Intelligence and Cyber Security, Rashtriya Raksha University, India
     

   Subscribe/Renew Journal


Surveillance systems are becoming pervasive throughout our daily lives, and surveillance recordings are being used as the essential evidence in criminal investigations. The authenticity of surveillance videos is tough to confirm. One of the most popular methods of video tampering is inter-frame forgery. Using an optimised deep learning methodology, a novel inter-frame forgery detection and localization model is introduced in this research work. Pre-processing, feature extraction, and forgery detection will be the three main phases of the presented design forgery detection model. In the detection model, the original video frames will be pre-processed to improve the image quality. The pre-processing phase includes the frame extraction from video, grey conversion and removal of movement frames as well. Following that, features such as SURF, PCA-HOG features, MBFDF, correlation of adjacent frames, PRG, and OFG based features is extracted. These extracted features will be subjected for forgery detection using Optimised CNN with fine-tuned weights by the hybrid approach. The suggested hybrid paradigm Mayfly Optimization espoused Black Widow Optimization (MO-BWO) is a mathematical fusion of both the Black Widow Optimization (BWO) and Mayfly Optimization Algorithms (MA). In case if the video is detected to be prone to tampers, then the corresponding location gets trapped in the localization phase. Moreover, the detection phase will portray the information regarding the type of tamper like duplication, insertion and deletion of frames. Here, the exact tamper localization is accomplished based on the PRG and OFG. Finally, the supremacy of the MO-BWO+CNN is validated over other conventional models.

Keywords

Inter-Frame Forgery Detection, Multi-Feature Extraction, CNN Based Tamper Detection, Hybrid optimization Model, PRG And OFG Based Tamper Localization
Subscription Login to verify subscription
User
Notifications
Font Size

  • A. Ullah, K. Muhammad, T. Hussain, S.W. Baik and V.H.C. De Albuquerque, “Event-Oriented 3D Convolutional Features Selection and Hash Codes Generation Using PCA for Video Retrieval”, IEEE Access, Vol. 8, pp. 196529196540, 2020.

  • Sondos Fadl and Qi Han Qiong Li, “CNN Spatiotemporal Features and Fusion for Surveillance Video Forgery Detection”, Signal Processing: Image Communication, Vol. 90, pp. 1-14, 2020.

  • Jun Liu Zhong, Chi Man Pun and Yan Fen Ganb, “Dense Moment Feature Index and Best Match Algorithms for Video Copy-Move Forgery Detection”, Information Sciences, Vol. 23, No. 2, pp. 1-13, 2020.

  • Dong Ning Zhao and Ren-Kui Wang, “Inter-Frame PassiveBlind Forgery Detection for Video Shot based on Similarity Analysis”, Multimedia Tools and Applications, Vol. 77, pp. 25389-25408, 2018.

  • Staffy Kingra and Naveen Aggarwal, “Inter-Frame Forgery Detection in H.264 Videos using Motion and Brightness Gradients”, Multimedia Tools and Applications, Vol. 76, No. 24, pp. 25767-25786, 2017.

  • Harpreet Kaur and Neeru Jindal, “Deep Convolutional Neural Network for Graphics Forgery Detection in Video”, Wireless Personal Communications, Vol. 112, pp. 17631781, 2020.

  • Jamimamul Bakas, Buchira Naskar and Rahul Dixit, “Detection and Localization of Inter-Frame Video Forgeries based on Inconsistency in Correlation Distribution between Haralick Coded Frames”, Multimedia Tools and Applications, Vol. 78, pp. 4905-4935, 2018.

  • Yuqing Liu and Tianqiang Huang, “A Novel Video Forgery Detection Algorithm for Blue Screen Compositing based on 3-Stage Foreground Analysis and Tracking”, Multimedia Tools and Applications, Vol. 77, No. 12, pp. 1-22, 2017.

  • S. Jia, Z. Xu, H. Wang, C. Feng and T. Wang, “Coarse-toFine Copy-Move Forgery Detection for Video Forensics”, IEEE Access, Vol. 6, pp. 25323-25335, 2018.

  • L. Su, H. Luo and S. Wang, “A Novel Forgery Detection Algorithm for Video Foreground Removal”, IEEE Access, Vol. 7, pp. 109719-109728, 2019.

  • L. Su, C. Li, Y. Lai and J. Yang, “A Fast Forgery Detection Algorithm Based on Exponential-Fourier Moments for Video Region Duplication”, IEEE Transactions on Multimedia, Vol. 20, No. 4, pp. 825-840, 2018.

  • L. D. Amiano, D. Cozzolino, G. Poggi and L. Verdoliva, “A PatchMatch-Based Dense-Field Algorithm for Video CopyMove Detection and Localization”, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 29, No. 3, pp. 669-682, 2019.

  • C. Feng, Z. Xu, S. Jia, W. Zhang and Y. Xu, “MotionAdaptive Frame Deletion Detection for Digital Video Forensics”, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 27, No. 12, pp. 2543-2554, 2017.

  • F. Khelifi and A. Bouridane, “Perceptual Video Hashing for Content Identification and Authentication”, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 29, No. 1, pp. 50-67, 2019.

  • Q. Liu, “An Improved Approach to Exposing JPEG Seam Carving under Recompression”, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 29, No. 7, pp. 1907-1918, 2019.

  • S. Ghimire, J.Y. Choi and B. Lee, “Using Blockchain for Improved Video Integrity Verification”, IEEE Transactions on Multimedia, Vol. 22, No. 1, pp. 108-121, 2020.

  • Y. Zheng, Y. Cao and C. Chang, “A PUF-Based DataDevice Hash for Tampered Image Detection and Source Camera Identification”, IEEE Transactions on Information Forensics and Security, Vol. 15, pp. 620-634, 2020.

  • E.A. Armas Vega, E. Gonzalez Fernandez, A.L. Sandoval Orozco and L.J. Garcia Villalba, “Passive Image Forgery Detection Based on the Demosaicing Algorithm and JPEG Compression”, IEEE Access, Vol. 8, pp. 11815-11823, 2020.

  • X. Ding, G. Yang, R. Li, L. Zhang, Y. Li and X. Sun, “Identification of Motion-Compensated Frame Rate UpConversion Based on Residual Signals”, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 28, No. 7, pp. 1497-1512, 2018.

  • A. Chintha, “Recurrent Convolutional Structures for Audio Spoof and Video Deepfake Detection”, IEEE Journal of Selected Topics in Signal Processing, Vol. 14, No. 5, pp. 1024-1037, 2020.

  • M. Saddique, K. Asghar, U.I. Bajwa, M. Hussain, H.A. Aboalsamh and Z. Habib, “Classification of Authentic and Tampered Video Using Motion Residual and Parasitic Layers”, IEEE Access, Vol. 8, pp. 56782-56797, 2020.

  • H. Chen, W. Wang, J. Zhang and Q. Zhang, “EchoFace: Acoustic Sensor-Based Media Attack Detection for Face Authentication”, IEEE Internet of Things Journal, Vol. 7, No. 3, pp. 2152-2159, 2020.

  • J. Hou and H. Lee, “Detection of Hue Modification using Photo Response Nonuniformity”, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 27, No. 8, pp. 1826-1832, 2017.

  • E.T. Grogan, “Techniques to Detect Modified Video”, SMPTE Motion Imaging Journal, Vol. 127, No. 1, pp. 6167, 2018.

  • I.J. Yu, S.H. Nam, W. Ahn, M.J.Kwon and H.K. Lee, “Manipulation Classification for JPEG Images using MultiDomain Features”, IEEE Access, Vol. 8, pp. 210837210854, 2020.

  • Vahideh Hayyolalam, Ali Asghar and Pourhaji Kazem, “Black Widow Optimization Algorithm: A Novel MetaHeuristic Approach for Solving Engineering Optimization Problems”, Engineering Applications of Artificial Intelligence, Vol. 87, pp. 1-19, 2020.

  • Seyedali Mirjalili, “Moth-Flame Optimization Algorithm: A Novel Nature-Inspired Heuristic Paradigm”, KnowledgeBased Systems, Vol. 89, pp. 228-249, 2015.

  • M. Marsaline Beno, I.R. Valarmathi, S.M. Swamy and B.R. Rajakumar, “Threshold Prediction for Segmenting Tumour from Brain MRI Scans”, International Journal of Imaging Systems and Technology, Vol. 24, No. 2, pp. 129-137, 2014.

  • B.R. Rajakumar, “Static and Adaptive Mutation Techniques for Genetic Algorithm: A Systematic Comparative Analysis”, International Journal of Computational Science and Engineering, Vol. 8, No. 2, pp. 180-193, 2013.

  • Malige Gangappa, C. Kiran Mai and P. Sammulal, “Enhanced Crow Search Optimization Algorithm and Hybrid NN-CNN Classifiers for Classification of Land Cover Images”, Multimedia Research, Vol. 2, No. 3, pp. 12-22, 2019.

  • Raviraj Vishwambhar Darekar and Ashwinikumar Panjabrao Dhande, “Emotion Recognition from Speech Signals using DCNN with Hybrid GA-GWO Algorithm”, Multimedia Research, Vol. 2, No. 4, pp. 12-22, 2019.

  • G. Gokulkumari, “Classification of Brain tumor using Manta Ray Foraging Optimization-based DeepCNN Classifier”, Multimedia Research, Vol. 3, No. 4, pp. 1-12, 2020.

  • M.R. Puttaswamy, “Improved Deer Hunting Optimization Algorithm for Video based Salient Object Detection”, Multimedia Research, Vol. 3, No. 3, pp. 1-16, 2020.

  • H.J. Bouchech, S. Foufou and M. Abidi, “Strengthening Surf Descriptor with Discriminant Image Filter Learning: Application to Face Recognition”, Proceedings of International Conference on Microelectronics, pp. 136-139,2014.

  • Jamimamul Bakas, Ruchira Naskar and Sambit Bakshi, “Detection and Localization of Inter-Frame Forgeries in Videos based on Macroblock Variation and Motion Vector Analysis”, Computers and Electrical Engineering, Vol. 89, pp. 1-23, 2020.


Abstract Views: 146

PDF Views: 0




  • An Optimized Convolution Neural Network Based Inter-frame Forgery Detection Model - A Multi-feature Extraction Framework

Abstract Views: 146  |  PDF Views: 0

Authors

Jatin Patel
School of Information Technology, Artificial Intelligence and Cyber Security, Rashtriya Raksha University, India
Ravi Sheth
School of Information Technology, Artificial Intelligence and Cyber Security, Rashtriya Raksha University, India

Abstract


Surveillance systems are becoming pervasive throughout our daily lives, and surveillance recordings are being used as the essential evidence in criminal investigations. The authenticity of surveillance videos is tough to confirm. One of the most popular methods of video tampering is inter-frame forgery. Using an optimised deep learning methodology, a novel inter-frame forgery detection and localization model is introduced in this research work. Pre-processing, feature extraction, and forgery detection will be the three main phases of the presented design forgery detection model. In the detection model, the original video frames will be pre-processed to improve the image quality. The pre-processing phase includes the frame extraction from video, grey conversion and removal of movement frames as well. Following that, features such as SURF, PCA-HOG features, MBFDF, correlation of adjacent frames, PRG, and OFG based features is extracted. These extracted features will be subjected for forgery detection using Optimised CNN with fine-tuned weights by the hybrid approach. The suggested hybrid paradigm Mayfly Optimization espoused Black Widow Optimization (MO-BWO) is a mathematical fusion of both the Black Widow Optimization (BWO) and Mayfly Optimization Algorithms (MA). In case if the video is detected to be prone to tampers, then the corresponding location gets trapped in the localization phase. Moreover, the detection phase will portray the information regarding the type of tamper like duplication, insertion and deletion of frames. Here, the exact tamper localization is accomplished based on the PRG and OFG. Finally, the supremacy of the MO-BWO+CNN is validated over other conventional models.

Keywords


Inter-Frame Forgery Detection, Multi-Feature Extraction, CNN Based Tamper Detection, Hybrid optimization Model, PRG And OFG Based Tamper Localization

References