Open Access
Subscription Access
Open Access
Subscription Access
Single Image Reflection Removal with Segmentation
Subscribe/Renew Journal
Removal of reflection is of high importance to reclaim the original background image. Several attempts have been made to separate reflection from background. A number of approaches are based on assuming certain conditions about the reflective material (glass) and type of reflection. Humans can separate familiar objects easily due to the understanding of the objects in scene, same analogy is applied here. In this paper, additional information of segmentation map is utilized rather than using a single reflection image as input. Estimated segmentation map corresponds to the composite image. Our aim is to investigate the efficacy of segmentation map in reflection removal approaches. Proposed method performs adequately on real-world images and suppresses the reflection components in background effectively.
Keywords
Reflection Removal, Deep Learning, Semantic Guidance
Subscription
Login to verify subscription
User
Font Size
Information
- Y. Liu, Y. Li and F. Lu, “Semantic Guided Single Image Reflection Removal”, Proceedings of International Conference on Recent Trends in Computer Science, pp. 1-7, 2019.
- Li Yu, “Two-Stage Single Image Reflection Removal with Reflection-Aware Guidance”, Proceedings of International Conference on Image Processing, pp. 1-9, 2021.
- A. Levin and Y. Weiss, “User Assisted Separation of Reflections from a Single Image using a Sparsity Prior”, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 29, No. 9, pp. 1647-1654, 2007.
- A. Agrawal, R. Raskar and Y. Li, “Removing Photography Artifacts using Gradient Projection and Flash Exposure Sampling”, ACM Transactions on Graphics, Vol. 24, No. 3, pp. 828-835, 2005.
- K. Gai, Z. Shi and C. Zhang, “Blind Separation of Superimposed Moving Images using Image Statistics”, Proceedings of IEEE Transactions on Pattern Analysis and Machine Intelligence, pp. 19-32, 2012.
- Y. Li and S.M. Brown, “Exploiting Reflection Change for Automatic Reflection Removal”, Proceedings of IEEE International Conference on Computer Vision, pp. 2432-2439, 2013.
- X. Guo, X. Cao and Y. Ma, “Robust Separation of Reflection from Multiple Images”, Proceedings of International Conference on Computer Vision and Pattern Recognition, pp. 2187-2194, 2014.
- N. Kong, Y. Tai and J.S. Shin, “A Physically-Based Approach to Reflection Separation: from Physical Modeling to Constrained Optimization”, Proceedings of IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 36, No. 2, pp. 209-221, 2014.
- Y.Y. Schechner, J. Shamir and N. Kiryati, “Polarization and Statistical Analysis of Scenes Containing a Semireflector”, Journal of the Optical Society of America, Vol. 17, No. 2, pp. 276-284, 2000.
- B. Sarel and M. Irani, “Separating Transparent Layers through Layer Information Exchange”, Proceedings of International Conference on Electronics and Computer Vision, pp. 328-341, 2004.
- T. Xue, M. Rubinstein and W.T. Freeman, “A Computational Approach for Obstruction-Free Photography”, Proceedings of ACM Transactions on Graphics, Vol. 34, No. 4, pp. 1-11, 2015.
- Y. Li and M.S. Brown, “Single Image Layer Separation using Relative Smoothness”, Proceedings of International Conference on Electronics and Computer Vision, pp. 2752-2759, 2014.
- A. Levin, A. Zomet and Y. Weiss, “Learning to Perceive Transparency from the Statistics of Natural Scenes”, Proceedings of International Conference on Advances in Neural Information Processing Systems, pp. 1271-1278, 2003.
- R. Wan, B. Shi, A.H. Tan and A.C. Kot, “Depth of Field Guided Reflection Removal”, Proceedings of International Conference on Electronics and Computer Vision, pp. 21-25, 2016.
- N. Arvanitopoulos, R. Achanta and S. Susstrunk, “Single Image Reflection Suppression”, Proceedings of International Conference on Computer Vision and Pattern Recognition, pp. 1752-1760, 2017.
- Y. Shih, D. Krishnan and W.T. Freeman, “Reflection Removal using Ghosting Cues”, Proceedings of International Conference on Computer Vision and Pattern Recognition, pp.3193-3201, 2015.
- Q. Fan, J. Yang and D. Wipf, “A Generic Deep Architecture for Single Image Reflection Removal and Image Smoothing”, Proceedings of IEEE International Conference on Computer Vision, pp. 1-13, 2017.
- R. Wan, B. Shi and A.C. Kot, “CRRN: Multi-Scale Guided Concurrent Reflection Removal Network”, Proceedings of International Conference on Computer Vision and Pattern Recognition, pp. 4777-4785, 2018.
- J. Yang, D. Gong, L. Liu and Q. Shi, “Seeing Deeply and Bidirectionally: A Deep Learning Approach for Single Image Reflection Removal”, Proceedings of International Conference on Electronics and Computer Vision, pp. 654-669, 2018.
- X. Zhang, R. Ng and Q. Chen, “Single Image Reflection Separation with Perceptual Losses”, Proceedings of International Conference on Electronics and Computer Vision and Pattern Recognition, pp. 4786-4794, 2018.
- Z. Chi, X. Wu and J. Gu, “Single Image Reflection Removal using Deep Encoder-Decoder Network”, Proceedings of International Conference on Electronics and Computer Vision, pp. 1-13, 2018 [22] J. Johnson, A. Alahi and L. Fei-Fei, “Perceptual Losses for Real-Time Style Transfer and Super-Resolution”, Proceedings of European Conference on Computer Vision, pp 694-711, 2016.
- D. Lee, M.H. Yang and S. Oh, “Generative Single Image Reflection Separation”, Proceedings of International Conference on Electronics and Computer Vision, pp. 78-88, 2018
- H. Zhang, K. Dana, J. Shi and A. Agrawal, “Context Encoding for Semantic Segmentation”, Proceedings of International Conference on Computer Vision and Pattern Recognition, pp. 7151-7160, 2018.
- O. Russakovsky, J. Deng and M. Bernstein, “ImageNet Large Scale Visual Recognition Challenge”, International Journal of Computer Vision, Vol. 115, No. 3, pp. 211-252, 2015.
- Y. Chang and C. Jung, “Single Image Reflection Removal Using Convolutional Neural Networks”, IEEE Transactions on Image Processing, Vol. 28, No. 4, pp. 1954-1966, 2019.
- C. Li, Y. Yang and J. Hopcroft, “Single Image Reflection Removal through Cascaded Refinement”, Proceedings of International Conference on Computer Vision and Pattern Recognition, pp. 3562-3571, 2019.
- K. Wei and H. Huang, “Single Image Reflection Removal Exploiting Misaligned Training Data and Network Enhancements”, Proceedings of International Conference on Computer Vision and Pattern Recognition, pp. 8170-8179, 2019.
- D. Fleet, D. “Microsoft COCO: Common Objects in Context”, Proceedings of International Conference on Conference on Computer Vision, pp. 90-98, 2014.
- L.C. Chen, Y. Zhu and H. Adam, “Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation”, Proceedings of International Conference on Conference on Computer Vision, pp. 1-13, 2018.
- M. Everingham and A. Zisserman, “The PASCAL Visual Object Classes Challenge”, Available at http://www.pascal-network.org/challenges/VOC/voc2012/workshop/index.html, Accessed at 2012.
- R. Wan, B. Shi and C.A. Kot, “Benchmarking Single-Image Reflection Removal Algorithms”, Proceedings of International Conference on Conference on Computer Vision, pp. 441-447, 2017.
- O. Ronneberger, P. Fischer and T. Brox, “Unet: Convolutional Networks for Biomedical Image Segmentation”, Proceedings of International Conference on Conference on Medical Image Computing and Computer-assisted Intervention, pp. 234-241, 2015.
- S. Liu and W. Deng, “Very Deep Convolutional Neural Network based Image Classification using Small Training Sample Size”, Proceedings of International Conference on Conference on Pattern Recognition, pp. 730-734, 2015.
Abstract Views: 111
PDF Views: 1