Image smog restoration using oblique gradient profile prior and energy minimization

doi:10.1007/s11704-020-9305-8

Front. Comput. Sci.

2021, Vol. 15

Issue (6) : 156706 https://doi.org/10.1007/s11704-020-9305-8

RESEARCH ARTICLE

Image smog restoration using oblique gradient profile prior and energy minimization

Ashok KUMAR, Arpit JAIN(

)

College of Computing Science and Information Technogy, TeerthankerMahaveer University,Moradabad 244001, India

Download: PDF(806 KB)
Export: BibTeX | EndNote | Reference Manager | ProCite | RefWorks

Abstract

Removing the smog from digital images is a challenging pre-processing tool in various imaging systems. Therefore, many smog removal (i.e., desmogging) models are proposed so far to remove the effect of smog from images. The desmogging models are based upon a physical model, it means it requires efficient estimation of transmission map and atmospheric veil from a single smoggy image. Therefore, many prior based restoration models are proposed in the literature to estimate the transmission map and an atmospheric veil. However, these models utilized computationally extensive minimization of an energy function. Also, the existing restoration models suffer from various issues such as distortion of texture, edges, and colors. Therefore, in this paper, a convolutional neural network (CNN) is used to estimate the physical attributes of smoggy images. Oblique gradient channel prior (OGCP) is utilized to restore the smoggy images. Initially, a dataset of smoggy and sunny images are obtained. Thereafter, we have trained CNN to estimate the smog gradient from smoggy images. Finally, based upon the computed smog gradient, OGCP is utilized to restore the still smoggy images. Performance analyses reveal that the proposed CNN-OGCP based desmogging model outperforms the existing desmogging models in terms of various performance metrics.

Keywords convolutional neural networks desmogging smog oblique gradient channel prior

Corresponding Author(s): Arpit JAIN

Just Accepted Date: 11 May 2020 Issue Date: 13 July 2021

Cite this article:

Ashok KUMAR,Arpit JAIN. Image smog restoration using oblique gradient profile prior and energy minimization[J]. Front. Comput. Sci., 2021, 15(6): 156706.

URL:

https://academic.hep.com.cn/fcs/EN/10.1007/s11704-020-9305-8
https://academic.hep.com.cn/fcs/EN/Y2021/V15/I6/156706

1	Li C, Guo J, Cong R, Pang Y, Wang B. Underwater image enhancement by dehazing with minimum information loss and histogram distribution prior. IEEE Transactions on Image Processing, 2016, 25(12): 5664–5677 https://doi.org/10.1109/TIP.2016.2612882
2	Nnolim U A. Partial differential equation-based hazy image contrast enhancement. Computers & Electrical Engineering, 2018, 72: 670–681 https://doi.org/10.1016/j.compeleceng.2018.01.041
3	Kim J H, Jang W D, Sim J Y, Kim C S. Optimized contrast enhancement for real-time image and video dehazing. Journal of Visual Communication and Image Representation, 2013, 24(3): 410–425 https://doi.org/10.1016/j.jvcir.2013.02.004
4	Kim K, Kim S, Kim K S. Effective image enhancement techniques for fog-affected indoor and outdoor images. IET Image Processing, 2018, 12(4): 465–471 https://doi.org/10.1049/iet-ipr.2016.0819
5	Shi Z, Feng Y, Zhao M, Zhang E, He L. Let you see in sand dust weather: a method based on halo-reduced dark channel prior dehazing for sanddust image enhancement. IEEE Access, 2019, 7: 116722–116733 https://doi.org/10.1109/ACCESS.2019.2936444
6	Lai Y, Chen Y, Chiou C, Hsu C. Single-image dehazing via optimal transmission map under scene priors. IEEE Transactions on Circuits and Systems for Video Technology, 2015, 25(1): 1–14 https://doi.org/10.1109/TCSVT.2014.2329381
7	Bui TM, Kim W. Single image dehazing using color ellipsoid prior. IEEE Transactions on Image Processing, 2018, 27(2): 999–1009 https://doi.org/10.1109/TIP.2017.2771158
8	Yu T, Riaz I, Piao J, Shin H. Real-time single image dehazing using blockto-pixel interpolation and adaptive dark channel prior. IET Image Processing, 2015, 9(9): 725–734 https://doi.org/10.1049/iet-ipr.2015.0087
9	Golts A, Freedman D, Elad M. Unsupervised single image dehazing using dark channel prior loss. IEEE Transactions on Image Processing, 2020, 29: 2692–2701 https://doi.org/10.1109/TIP.2019.2952032
10	Zhu M, He B, Wu Q. Single image dehazing based on dark channel prior and energy minimization. IEEE Signal Processing Letters, 2018, 25(2): 174–178 https://doi.org/10.1109/LSP.2017.2780886
11	Xiao J, Zhu L, Zhang Y, Liu E, Lei J. Scene-aware image dehazing based on sky-segmented dark channel prior. IET Image Processing, 2017, 11(12): 1163–1171 https://doi.org/10.1049/iet-ipr.2017.0058
12	Singh D, Kumar V, Kaur M. Single image dehazing using gradient channel prior. Applied Intelligence, 2019, 49(12): 4276–4293 https://doi.org/10.1007/s10489-019-01504-6
13	Bala J, Lakhwani K. Single image desmogging using oblique gradient profile prior and variational minimization. Multidimensional Systems and Signal Processing, 2020, 31: 1259–1275 https://doi.org/10.1007/s11045-020-00707-2
14	Zhao D, Xu L, Yan Y, Chen J, Duan L Y. Multi-scale optimal fusion model for single image dehazing. Signal Processing: Image Communication, 2019, 74: 253–265 https://doi.org/10.1016/j.image.2019.02.004
15	Jiang Y, Sun C, Zhao Y, Yang L. Image dehazing using adaptive bichannel priors on superpixels. Computer Vision and Image Understanding, 2017, 165: 17–32 https://doi.org/10.1016/j.cviu.2017.10.014
16	Wang Y, Huang T Z, Zhao X L, Deng L J, Ji T Y. A convex single image dehazing model via sparse dark channel prior. Applied Mathematics and Computation, 2020, 375: 125085 https://doi.org/10.1016/j.amc.2020.125085
17	Gui B, Zhu Y, Zhen T. Adaptive single image dehazing method based on support vector machine. Journal of Visual Communication and Image Representation, 2020, 70: 102792 https://doi.org/10.1016/j.jvcir.2020.102792
18	Yin S, Wang Y, Yang Y H. A novel image-dehazing network with a parallel attention block. Pattern Recognition, 2020, 102: 107255 https://doi.org/10.1016/j.patcog.2020.107255
19	Liang Z, Wang Y, Ding X, Mi Z, Fu X. Single underwater image enhancement by attenuation map guided color correction and detail preserved dehazing. Neurocomputing, 2021, 425: 160–172 https://doi.org/10.1016/j.neucom.2020.03.091
20	Zhang J, Wang X, Yang C, Zhang J, He D, Song H. Image dehazing based on dark channel prior and brightness enhancement for agricultural remote sensing images from consumer-grade cameras. Computers and Electronics in Agriculture, 2018, 151: 196–206 https://doi.org/10.1016/j.compag.2018.06.010
21	Emberton S, Chittka L, Cavallaro A. Underwater image and video dehazing with pure haze region segmentation. Computer Vision and Image Understanding, 2018, 168: 145–156 https://doi.org/10.1016/j.cviu.2017.08.003
22	Xiao J, Shen M, Lei J, Zhou J, Klette R, Sui H. Single image dehazing based on learning of haze layers. Neurocomputing, 2020, 389: 108–122 https://doi.org/10.1016/j.neucom.2020.01.007
23	Guo F, Zhao X, Tang J, Peng H, Liu L, Zou B. Single image dehazing based on fusion strategy. Neurocomputing, 2020, 378: 9–23 https://doi.org/10.1016/j.neucom.2019.09.094
24	Gao Y, Li Q, Li J. Single image dehazing via a dual-fusion method. Image and Vision Computing, 2020, 94: 103868 https://doi.org/10.1016/j.imavis.2019.103868
25	Khan H, Sharif M, Bibi N, Usman M, Haider S A, Zainab S, Shah J H, Bashir Y, Muhammad N. Localization of radiance transformation for image dehazing in wavelet domain. Neurocomputing, 2020, 381: 141–151 https://doi.org/10.1016/j.neucom.2019.10.005
26	Borkar K, Mukherjee S. Single image dehazing by approximating and eliminating the additional airlight component. Neurocomputing, 2020, 400: 294–308 https://doi.org/10.1016/j.neucom.2020.03.027
27	Galdran A. Image dehazing by artificial multiple-exposure image fusion. Signal Processing, 2018, 149: 135–147 https://doi.org/10.1016/j.sigpro.2018.03.008
28	Singh D, Kumar V. A novel dehazing model for remote sensing images. Computers & Electrical Engineering, 2018, 69: 14–27 https://doi.org/10.1016/j.compeleceng.2018.05.015
29	Yuan F, Zhou Y, Xia X, Shi J, Fang Y, Qian X. Image dehazing based on a transmission fusion strategy by automatic image matting. Computer Vision and Image Understanding, 2020, 194: 102933 https://doi.org/10.1016/j.cviu.2020.102933
30	Wang W, He C, Xia X G. A constrained total variation model for single image dehazing. Pattern Recognition, 2018, 80: 196–209 https://doi.org/10.1016/j.patcog.2018.03.009
31	Alajarmeh A, Salam R, Abdulrahim K, Marhusin M, Zaidan A, Zaidan B. Real-time framework for image dehazing based on linear transmission and constant-time airlight estimation. Information Sciences, 2018, 436: 108–130 https://doi.org/10.1016/j.ins.2018.01.009
32	Singh D, Kumar V. Dehazing of outdoor images using notch based integral guided filter. Multimedia Tools and Applications, 2018, 77(20): 27363–27386 https://doi.org/10.1007/s11042-018-5924-6
33	Basavegowda H S, Dagnew G. Deep learning approach for microarray cancer data classification. CAAI Transactions on Intelligence Technology, 2020, 5(1): 22–33 https://doi.org/10.1049/trit.2019.0028
34	Singh D, Kumar V. Single image defogging by gain gradient image filter. Science China Information Sciences, 2019, 62(7): 79101 https://doi.org/10.1007/s11432-017-9433-4
35	Osterland S , Weber J. Analytical analysis of single-stage pressure relief valves. International Journal of Hydromechatronics, 2019, 2(1): 32–53 https://doi.org/10.1504/IJHM.2019.098951
36	Wang R, Yu H, Wang G, Zhang G, Wang W. Study on the dynamic and static characteristics of gas static thrust bearing with micro-hole restrictors. International Journal of Hydromechatronics, 2019, 2(3): 189–202 https://doi.org/10.1504/IJHM.2019.102893
37	Qi G, Wang H, Haner M, Weng C, Chen S, Zhu Z. Convolutional neural network based detection and judgement of environmental obstacle in vehicle operation. CAAI Transactions on Intelligence Technology, 2019, 4(2): 80–91 https://doi.org/10.1049/trit.2018.1045
38	Singh D, Kumar V, Kaur M. Image dehazing using window-based integrated means filter. Multimedia Tools and Applications, 2020, 79: 34771–34793 https://doi.org/10.1007/s11042-019-08286-6
39	Kaur M, Singh D, Kumar V, Sun K. Color image dehazing using gradient channel prior and guided l0 filter. Information Sciences, 2020, 521: 326–342 https://doi.org/10.1016/j.ins.2020.02.048
40	Singh D, Kumar V. Image dehazing using moore neighborhood-based gradient profile prior. Signal Processing: Image Communication, 2019, 70: 131–144 https://doi.org/10.1016/j.image.2018.09.011
41	Wiens T. Engine speed reduction for hydraulic machinery using predictive algorithms. International Journal of Hydromechatronics, 2019, 2(1): 16–31 https://doi.org/10.1504/IJHM.2019.098949
42	Levin A, Lischinski D, Weiss Y. A closed form solution to natural image matting. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 2006
43	Singh D, Kumar V, Kaur M. Classification of COVID-19 patients from chest CT images using multi-objective differential evolution-based convolutional neural networks. European Journal of Clinical Microbiology & Infectious Diseases, 2020, 39(7): 1379–1389 https://doi.org/10.1007/s10096-020-03901-z
44	Ding R, Dai L, Li G, Liu H. TDD-net: a tiny defect detection network for printed circuit boards. CAAI Transactions on Intelligence Technology, 2019, 4(2): 110–116 https://doi.org/10.1049/trit.2019.0019
45	Kaur M, Kumar V. Beta chaotic map based image encryption using genetic algorithm. International Journal of Bifurcation and Chaos, 2018, 28(11): 1850132 https://doi.org/10.1142/S0218127418501328
46	Kaur M, Singh D, Uppal R S. Parallel strength pareto evolutionary algorithm-ii based image encryption. IET Image Processing, 2019, 14(6): 1015–1026 https://doi.org/10.1049/iet-ipr.2019.0587
47	Gupta A, Singh D, Kaur M. An efficient image encryption using nondominated sorting genetic algorithm-III based 4-D chaotic maps. Journal of Ambient Intelligence and Humanized Computing, 2020, 11(3): 1309–1324 https://doi.org/10.1007/s12652-019-01493-x
48	Kaur M, Singh D, Sun K, Rawat U. Color image encryption using nondominated sorting genetic algorithm with local chaotic search based 5D chaotic map. Future Generation Computer Systems, 2020, 107: 333–350 https://doi.org/10.1016/j.future.2020.02.029
49	Kaur M, Kumar V, Li L. Color image encryption approach based on memetic differential evolution. Neural Computing and Applications, 2019, 31(11): 7975–7987 https://doi.org/10.1007/s00521-018-3642-7

[1]

Article highlights

Download

[1]	Huiying ZHANG, Yu ZHANG, Xin GENG. Practical age estimation using deep label distribution learning[J]. Front. Comput. Sci., 2021, 15(3): 153318-.
[2]	Anna ZHU, Seiichi UCHIDA. Scene word recognition from pieces to whole[J]. Front. Comput. Sci., 2019, 13(2): 292-301.
[3]	Qianjun ZHANG, Lei ZHANG. Convolutional adaptive denoising autoencoders for hierarchical feature extraction[J]. Front. Comput. Sci., 2018, 12(6): 1140-1148.
[4]	Jun ZHANG, Bineng ZHONG, Pengfei WANG, Cheng WANG, Jixiang DU. Robust feature learning for online discriminative tracking without large-scale pre-training[J]. Front. Comput. Sci., 2018, 12(6): 1160-1172.
[5]	Lili HUANG, Jiefeng PENG, Ruimao ZHANG, Guanbin LI, Liang LIN. Learning deep representations for semantic image parsing: a comprehensive overview[J]. Front. Comput. Sci., 2018, 12(5): 840-857.
[6]	Philipp V. ROUAST, Marc T. P. ADAM, Raymond CHIONG, David CORNFORTH, Ewa LUX. Remote heart rate measurement using low-cost RGB face video: a technical literature review[J]. Front. Comput. Sci., 2018, 12(5): 858-872.
[7]	Feifei ZHANG,Yongbin YU,Qirong MAO,Jianping GOU,Yongzhao ZHAN. Pose-robust feature learning for facial expression recognition[J]. Front. Comput. Sci., 2016, 10(5): 832-844.

Viewed

Full text

Abstract

Cited

Shared

Discussed