Please wait a minute...
Frontiers of Environmental Science & Engineering

ISSN 2095-2201

ISSN 2095-221X(Online)

CN 10-1013/X

Postal Subscription Code 80-973

2018 Impact Factor: 3.883

Front. Environ. Sci. Eng.    2021, Vol. 15 Issue (6) : 136    https://doi.org/10.1007/s11783-021-1430-6
RESEARCH ARTICLE
Online recognition of drainage type based on UV-vis spectra and derivative neural network algorithm
Qiyun Zhu1, April Gu2, Dan Li3, Tianmu Zhang1, Lunhong Xiang1, Miao He1()
1. School of Environment, Tsinghua University, Beijing 100084, China
2. Department of Civil and Environmental Engineering, Cornell University, Ithaca, NY 14853, USA
3. Department of Environmental Science and Engineering, Fudan University, Shanghai 200438, China
 Download: PDF(846 KB)   HTML
 Export: BibTeX | EndNote | Reference Manager | ProCite | RefWorks
Abstract

• UV-vis absorption analyzer was applied in drainage type online recognition.

• The UV-vis spectrum of four drainage types were collected and evaluated.

• A convolutional neural network with multiple derivative inputs was established.

• Effects of different network structures and input contents were compared.

Optimizing sewage collection is important for water pollution control and wastewater treatment plants quality and efficiency improvement. Currently, the urban drainage pipeline network is upgrading to improve its classification and collection ability. However, there is a lack of efficient online monitoring and identification technology. UV-visible absorption spectrum probe is considered as a potential monitoring method due to its small size, reagent-free and fast detection. Because the performance parameters of probe like optic resolution, dynamic interval and signal-to-noise ratio are weak and high turbidity of sewage raises the noise level, it is necessary to extract shape features from the turbidity disturbed drainage spectrum for classification purposes. In this study, drainage network samples were online collected and tested, and four types were labeled according to sample sites and environment situation. Derivative spectrum were adopted to amplify the shape features, while convolutional neural network algorithm was established to conduct nonlinear spectrum classification. Influence of input and network structure on classification accuracy was compared. Original spectrum, first-order derivative spectrum and a combination of both were set to be three different inputs. Artificial neural network with or without convolutional layer were set be two different network structures. The results revealed a convolutional neural network combined with inputs of first and zero-order derivatives was proposed to have the best classification effect on domestic sewage, mixed rainwater, rainwater and industrial sewage. The recognition rate of industrial wastewater was 100%, and the recognition rate of domestic sewage and rainwater mixing system were over 90%.

Keywords Drainage online recognition      UV-vis spectra      Derivative spectrum      Convolutional neural network     
Corresponding Author(s): Miao He   
Just Accepted Date: 11 March 2021   Issue Date: 13 April 2021
 Cite this article:   
Qiyun Zhu,April Gu,Dan Li, et al. Online recognition of drainage type based on UV-vis spectra and derivative neural network algorithm[J]. Front. Environ. Sci. Eng., 2021, 15(6): 136.
 URL:  
https://academic.hep.com.cn/fese/EN/10.1007/s11783-021-1430-6
https://academic.hep.com.cn/fese/EN/Y2021/V15/I6/136
Site Type Area Sample number
W1 Separated domestic well Residential 24
W2 Separated domestic well Residential 24
Y1 Separated rainwater well Residential 24
Y2 Separated rainwater well Residential 24
Y3 Separated rainwater outlet Industrial 48
Y4 Separated rainwater outlet Open 48
Tab.1  Sample sites, types, and sampling areas
Fig.1  Online sampling system and UV-vis spectra testing device.
Fig.2  Schematic overview of classification system.
Fig.3  UV-vis spectra of each class. (a) the average value of each type; (b, c, d, e) average value±1 standard deviation of each type.
Fig.4  First-order derivative UV-vis spectra of each class.
Fig.5  Sample distribution in the space of the two first principal components of the original spectrum (a) and the 1st derivative spectrum (b).
Model input Network structure Domestic Rain Mixed Industry Overall
SENS (%) SPEC (%) SENS (%) SPEC (%) SENS (%) SPEC (%) SENS (%) SPEC (%) SENS (%) SPEC (%)
Origin FNN 91.7±6.5 97.2±5.0 87.5±13.7 93.1±7.8 83.3±2.2 97.2±2.2 97.9±5.1 99.3±1.7 90.1±5.0 96.7±1.7
1st derivative 100 98.6±3.4 97.9±5.1 95.1±4.1 81.3±19.0 99.3±1.7 100 100 94.8±5.8 98.2±1.9
Combined 100 100 97.9±5.1 95.1±4.1 85.4±12.3 99.3±1.7 100 100 95.8±3.8 98.6±1.3
Origin CNN 97.9±5.1 97.9±3.5 75.0±11.2 97.2±3.4 89.6±14.6 91.6±4.6 97.9±5.1 100 90.1±3.7 96.7±1.2
1st derivative 100 100 93.8±10.4 95.8±3.7 87.5±11.2 97.9±3.4 100 100 95.3±3.3 98.4±1.1
Combined 100 100 97.9±5.1 97.9±0.3 93.8±10.4 99.3±1.7 100 100 97.9±2.5 99.3±0.9
Tab.2  Sensitivity and specificity of each input type, network structure, and wastewater class
Fig.6  Histogram of sewage types proportions in all observed sites.
1 T Asheri-Arnon, S Ezra, B Fishbain (2018). Contamination detection of water with varying routine backgrounds by UV-spectrophotometry. Journal of Water Resources Planning and Management, 144(9): 04018056-1
https://doi.org/10.1061/(ASCE)WR.1943-5452.0000965
2 A Benvidi, S Abbasi, S Gharaghani, M Dehghan Tezerjani, S Masoum (2017). Spectrophotometric determination of synthetic colorants using PSO-GA-ANN. Food Chemistry, 220: 377–384
https://doi.org/10.1016/j.foodchem.2016.10.010
3 J V D Broeke, G Langergraber, A Weingartner (2006). On-line and in-situ UV/vis spectroscopy for multi-parameter measurements: a brief review. Spectroscopy Europe, 18(4): S3–S4
4 R E Cantwell, R Hofmann (2011). Ultraviolet absorption properties of suspended particulate matter in untreated surface waters. Water Research, 45(3): 1322–1328
https://doi.org/10.1016/j.watres.2010.10.020
5 Y S Cao, J G Tang, M Henze, X P Yang, Y P Gan, J Li, H Kroiss, M C M Van Loosdrecht, Y Zhang, G T Daigger (2019). The leakage of sewer systems and the impact on the ‘black and odorous water bodies’ and WWTPs in China. Water Science and Technology, 79(2): 334–341
https://doi.org/10.2166/wst.2019.051
6 E Carré, J Perot, V Jauzein, L Lin, M Lopez-Ferber (2017). Estimation of water quality by UV/Vis spectrometry in the framework of treated wastewater reuse. Water Science and Technology, 76(3): 633–641
https://doi.org/10.2166/wst.2017.096
7 M De Luca, F Oliverio, G Ioele, G Ragno (2009). Multivariate calibration techniques applied to derivative spectroscopy data for the analysis of pharmaceutical mixtures. Chemometrics and Intelligent Laboratory Systems, 96(1): 14–21
https://doi.org/10.1016/j.chemolab.2008.10.009
8 J L Dong, M J Hong, Y Xu, X Q Zheng (2019). A practical convolutional neural network model for discriminating Raman spectra of human and animal blood. Journal of Chemometrics, 33(11): e3184
https://doi.org/10.1002/cem.3184
9 J Gu, Z Wang, J Kuen, L Ma, A Shahroudy, B Shuai, T Liu, X Wang, G Wang (2015). Recent advances in convolutional neural networks. Computer Science, 77: 354–377
10 Y Hu, Y Wen, X Wang (2016). Novel method of turbidity compensation for chemical oxygen demand measurements by using UV–vis spectrometry. Sensors and Actuators. B, Chemical, 227: 393–398
https://doi.org/10.1016/j.snb.2015.12.078
11 Y T Hu, X P Wang (2017). Application of surrogate parameters in characteristic UV-vis absorption bands for rapid analysis of water contaminants. Sensors and Actuators. B, Chemical, 239: 718–726
https://doi.org/10.1016/j.snb.2016.08.072
12 K Ichimura (2017). The reproducibility and reliability of UV–vis higher-order derivative spectroscopy for quantitative analysis of spectral changes. Bulletin of the Chemical Society of Japan, 90(4): 411–418
https://doi.org/10.1246/bcsj.20160414
13 D Jacquemin, A Planchat, C Adamo, B Mennucci (2012). TD-DFT assessment of functionals for optical 0–0 transitions in solvated dyes. Journal of Chemical Theory and Computation, 8(7): 2359–2372
https://doi.org/10.1021/ct300326f
14 G Langergraber, N Fleischmann, F Hofstaedter, A Weingartner (2004). Monitoring of a paper mill wastewater treatment plant using UV/VIS spectroscopy. Water Science & Technology A Journal of the International Association on Water Pollution Research, 49(1): 9–14
15 M Lepot, A Torres, T Hofer, N Caradot, G Gruber, J B Aubin, J L Bertrand-Krajewski (2016). Calibration of UV/Vis spectrophotometers: A review and comparison of different methods to estimate TSS and total and dissolved COD concentrations in sewers, WWTPs and rivers. Water Research, 101: 519–534
https://doi.org/10.1016/j.watres.2016.05.070
16 J Liu, M Osadchy, L Ashton, M Foster, C J Solomon, S J Gibson (2017). Deep convolutional neural networks for Raman spectrum recognition: a unified solution. Analyst (London), 142(21): 4067–4074
https://doi.org/10.1039/C7AN01371J
17 Y Liu, L G Hou, W Bian, B L Zhou, D B Liang, J Li (2020). Turbidity in combined sewer sewage: an identification of stormwater detention tanks. International Journal of Environmental Research and Public Health, 17(9): 3053–3062
https://doi.org/10.3390/ijerph17093053
18 A Liudmil (1997). Drawbacks of the present standards for processing absorption spectra recorded linearly as a function of wavelength. Trends in Analytical Chemistry, 16(9): 536–543
19 J J Ma, F S Meng, Y X Zhou, Y Y Wang, P Shi (2018). Distributed water pollution source localization with mobile UV-visible spectrometer probes in wireless sensor networks. Sensors (Basel), 18(2): 606
https://doi.org/10.3390/s18020606
20 K Makantasis, K Karantzalos, A Doulamis, N Doulamis (2015). Deep supervised learning for hyperspectral data classification through convolutional neural networks. In: Proceedings of the IEEE Geoscience & Remote Sensing Symposium. Milan: IGARSS IEEE, 4959–4962
21 S Meriç, H Selçuk, V Belgiorno (2005). Acute toxicity removal in textile finishing wastewater by Fenton’s oxidation, ozone and coagulation–flocculation processes. Water Research, 39(6): 1147–1153
https://doi.org/10.1016/j.watres.2004.12.021
22 Y B Monakhova, S S Kolesnikova, S P Mushtakova (2013). Independent component analysis algorithms for spectral decomposition in UV/VIS analysis of metal-containing mixtures including multimineral food supplements and platinum concentrates. Analytical Methods, 5(11): 2761–2772
https://doi.org/10.1039/c3ay40082d
23 A Palacios-Morillo, A Alcazar, F De Pablos, J M Jurado (2013). Differentiation of tea varieties using UV-Vis spectra and pattern recognition techniques. Spectrochimica Acta. Part A: Molecular and Biomolecular Spectroscopy, 103: 79–83
https://doi.org/10.1016/j.saa.2012.10.052
24 A Parmar, S Sharma (2016). Derivative UV-vis absorption spectra as an invigorated spectrophotometric method for spectral resolution and quantitative analysis: Theoretical aspects and analytical applications: A review. Trends in Analytical Chemistry, 77: 44–53
https://doi.org/10.1016/j.trac.2015.12.004
25 X Qin, F Gao, G Chen (2012). Wastewater quality monitoring system using sensor fusion and machine learning techniques. Water Research, 46(4): 1133–1144
https://doi.org/10.1016/j.watres.2011.12.005
26 S Şahin, C Demir, Ş Güçer (2007). Simultaneous UV–vis spectrophotometric determination of disperse dyes in textile wastewater by partial least squares and principal component regression. Dyes and Pigments, 73(3): 368–376
https://doi.org/10.1016/j.dyepig.2006.01.045
27 M C Sarraguça, A Paulo, M M Alves, A M Dias, J A Lopes, E C Ferreira (2009). Quantitative monitoring of an activated sludge reactor using on-line UV-visible and near-infrared spectroscopy. Analytical and Bioanalytical Chemistry, 395(4): 1159–1166
https://doi.org/10.1007/s00216-009-3042-z
28 M B Takahashi, J Leme, C P Caricati, A Tonso, E G Fernandez Nunez, J C Rocha (2015). Artificial neural network associated to UV/Vis spectroscopy for monitoring bioreactions in biopharmaceutical processes. Bioprocess and Biosystems Engineering, 38(6): 1045–1054
https://doi.org/10.1007/s00449-014-1346-7
29 O Thomas, M Brogat (2017). UV-Visible Spectrophotometry of Water and Wastewater. Rennes: Elsevier, 73–138
30 M M Tomazzoli, R D Pai Neto, R Moresco, L Westphal, A R Zeggio, L Specht, C Costa, M Rocha, M Maraschin (2015). Discrimination of Brazilian propolis according to the seasoning using chemometrics and machine learning based on UV-Vis scanning data. Journal of Integrative Bioinformatics, 12(4): 15–26
https://doi.org/10.1515/jib-2015-279
31 A Vieira dos Santos, J C Masini (2007). Evaluating the removal of Cd(II), Pb(II) and Cu(II) from a wastewater sample of a coating industry by adsorption onto vermiculite. Applied Clay Science, 37(1–2): 167–174
https://doi.org/10.1016/j.clay.2006.12.009
32 S Wang, B Wang, X Cao, W Jin, L Jia (2007). Discussion on Chinese urban drainage system. China Water & Wastewater, 12: 16–21 (in Chinese)
33 Z Ye, A Gilman, Q Peng, K Levick, P Cosman, L Milstein (2019). Comparison of Neural Network Architectures for Spectrum Sensing. Sanya: IEEE
34 X Yin (2014). Discussion on pollution and control measures of rainwater system in rainwater and sewage separation drainage system. China Water & Wastewater, 30: 24–26 (in Chinese)
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed