Physiological-physical feature fusion for automatic voice spoofing detection
Junxiao XUE1,2,3, Hao ZHOU2()
1. Research Institute of Artificial Intelligence, Zhejiang Lab, Hangzhou 311121, China 2. School of Cyber Science and Engineering, Zhengzhou University, Zhengzhou 450002, China 3. Henan Key Laboratory of Cyberspace Situation Awareness, Zhengzhou 450000, China
Biometric speech recognition systems are often subject to various spoofing attacks, the most common of which are speech synthesis and speech conversion attacks. These spoofing attacks can cause the biometric speech recognition system to incorrectly accept these spoofing attacks, which can compromise the security of this system. Researchers have made many efforts to address this problem, and the existing studies have used the physical features of speech to identify spoofing attacks. However, recent studies have shown that speech contains a large number of physiological features related to the human face. For example, we can determine the speaker’s gender, age, mouth shape, and other information by voice. Inspired by the above researches, we propose a spoofing attack recognition method based on physiological-physical features fusion. This method involves feature extraction, a densely connected convolutional neural network with squeeze and excitation block (SE-DenseNet), and feature fusion strategies. We first extract physiological features in audio from a pre-trained convolutional network. Then we use SE-DenseNet to extract physical features. Such a dense connection pattern has high parameter efficiency, and squeeze and excitation blocks can enhance the transmission of the feature. Finally, we integrate the two features into the classification network to identify the spoofing attacks. Experimental results on the ASVspoof 2019 data set show that our model is effective for voice spoofing detection. In the logical access scenario, our model improves the tandem decision cost function and equal error rate scores by 5% and 7%, respectively, compared to existing methods.
D A Reynolds. An overview of automatic speaker recognition technology. In: Proceedings of 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing. 2002, IV-4072-IV-4075
2
M, Todisco X, Wang V, Vestman M, Sahidullah H, Delgado A, Nautsch J, Yamagishi N, Evans T, Kinnunen K A Lee. ASVspoof 2019: future horizons in spoofed and fake audio detection. In: Proceedings of the 20th Annual Conference of the International Speech Communication Association. 2019, 1008– 1012
3
Z, Chen Z, Xie W, Zhang X Xu. ResNet and model fusion for automatic spoofing detection. In: Proceedings of the 18th Annual Conference of the International Speech Communication Association. 2017, 102– 106
4
C I, Lai A, Abad K, Richmond J, Yamagishi N, Dehak S King. Attentive filtering networks for audio replay attack detection. In: Proceedings of 2019 IEEE International Conference on Acoustics, Speech and Signal Processing. 2019, 6316– 6320
5
G, Valenti H, Delgado M, Todisco N, Evans L Pilati. An end-to-end spoofing countermeasure for automatic speaker verification using evolving recurrent neural networks. In: Proceedings of Speaker and Language Recognition Workshop. 2018, 288– 295
6
C I, Lai N, Chen J, Villalba N Dehak. ASSERT: anti-spoofing with squeeze-excitation and residual networks. In: Proceedings of the 20th Annual Conference of the International Speech Communication Association. 2019, 1013– 1017
7
J, Monteiro J, Alam T H Falk. End-to-end detection of attacks to automatic speaker recognizers with time-attentive light convolutional neural networks. In: Proceedings of the 29th IEEE International Workshop on Machine Learning for Signal Processing. 2019, 1– 6
8
X, Wu R, He Z, Sun T Tan . A light CNN for deep face representation with noisy labels. IEEE Transactions on Information Forensics and Security, 2018, 13( 11): 2884– 2896
9
J, Hu L, Shen G Sun. Squeeze-and-excitation networks. In: Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2018, 7132– 7141
10
K, He X, Zhang S, Ren J Sun. Deep residual learning for image recognition. In: Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition. 2016, 770– 778
11
T H, Oh T, Dekel C, Kim I, Mosseri W T, Freeman M, Rubinstein W Matusik. Speech2Face: Learning the face behind a voice. In: Proceedings of 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2019, 7531– 7540
12
G, Lavrentyeva S, Novoselov A, Tseren M, Volkova A, Gorlanov A Kozlov. STC antispoofing systems for the ASVspoof2019 challenge. In: Proceedings of the 20th Annual Conference of the International Speech Communication Association. 2019, 1033– 1037
13
Y, Yang H, Wang H, Dinkel Z, Chen S, Wang Y, Qian K Yu. The SJTU robust anti-spoofing system for the ASVspoof 2019 challenge. In: Proceedings of the 20th Annual Conference of the International Speech Communication Association. 2019, 1038– 1042
14
L, Durak O Arikan . Short-time Fourier transform: two fundamental properties and an optimal implementation. IEEE Transactions on Signal Processing, 2003, 51( 5): 1231– 1242
15
P, Podder T Z, Khan M H, Khan M M Rahman . Comparative performance analysis of Hamming, Hanning and Blackman window. International Journal of Computer Applications, 2014, 96( 18): 1– 7
16
O M, Parkhi A, Vedaldi A Zisserman. Deep face recognition. In: Proceedings of the British Machine Vision Conference. 2015, 41. 1– 41.12
17
G, Huang Z, Liu Der Maaten L, Van K Q Weinberger. Densely connected convolutional networks. In: Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition. 2017, 2261– 2269
18
M, Alzantot Z, Wang M B Srivastava. Deep residual neural networks for audio spoofing detection. In: Proceedings of the 20th Annual Conference of the International Speech Communication Association. 2019, 1078– 1082
19
Z, Wu R K, Das J, Yang H Li. Light convolutional neural network with feature genuinization for detection of synthetic speech attacks. In: Proceedings of the 21st Annual Conference of the International Speech Communication Association. 2020, 1101– 1105
20
A, Gomez-Alanis J A, Gonzalez-Lopez A M Peinado . A kernel density estimation based loss function and its application to ASV-spoofing detection. IEEE Access, 2020, 8: 108530– 108543
