Cross-scene passive human activity recognition using commodity WiFi

doi:10.1007/s11704-021-0407-8

Front. Comput. Sci.

2022, Vol. 16

Issue (1) : 161502 https://doi.org/10.1007/s11704-021-0407-8

RESEARCH ARTICLE

Cross-scene passive human activity recognition using commodity WiFi

Yuanrun FANG, Fu XIAO(

), Biyun SHENG, Letian SHA, Lijuan SUN

School of Computer Science, Nanjing University of Posts and Telecommunications, Nanjing 210023, China

Download: PDF(715 KB)
Export: BibTeX | EndNote | Reference Manager | ProCite | RefWorks

Abstract

With the development of the Internet of Things (IoT) and the popularization of commercial WiFi, researchers have begun to use commercial WiFi for human activity recognition in the past decade. However, cross-scene activity recognition is still difficult due to the different distribution of samples in different scenes. To solve this problem, we try to build a cross-scene activity recognition system based on commercial WiFi. Firstly, we use commercial WiFi devices to collect channel state information (CSI) data and use the Bi-directional long short-termmemory (BiLSTM) network to train the activity recognition model. Then, we use the transfer learning mechanism to transfer the model to fit another scene. Finally, we conduct experiments to evaluate the performance of our system, and the experimental results verify the accuracy and robustness of our proposed system. For the source scene, the accuracy of the model trained from scratch can achieve over 90%. After transfer learning, the accuracy of cross-scene activity recognition in the target scene can still reach 90%.

Keywords Internet of Things WiFi sensing channel state in-formation (CSI) human activity recognition transfer learning

Corresponding Author(s): Fu XIAO

Just Accepted Date: 26 April 2021 Issue Date: 03 November 2021

Cite this article:

Yuanrun FANG,Fu XIAO,Biyun SHENG, et al. Cross-scene passive human activity recognition using commodity WiFi[J]. Front. Comput. Sci., 2022, 16(1): 161502.

URL:

https://academic.hep.com.cn/fcs/EN/10.1007/s11704-021-0407-8
https://academic.hep.com.cn/fcs/EN/Y2022/V16/I1/161502

1	Y Chen, L Yu, K Ota, M Dong. Robust activity recognition for aging society. IEEE Journal of Biomedical and Health Informatics, 2018, 22(6): 1754–1764 https://doi.org/10.1109/JBHI.2018.2819182
2	S Yousefi, H Narui, S Dayal, S Ermon, S Valaee. A survey on behavior recognition using wifi channel state information. IEEE Communications Magazine, 2017, 55: 98–104 https://doi.org/10.1109/MCOM.2017.1700082
3	K Wu, J Xiao, Y Yi, D Chen, X Luo, L M Ni. CSI-based indoor localization. IEEE Transactions on Parallel and Distributed Systems, 2012, 24: 1300–1309 https://doi.org/10.1109/TPDS.2012.214
4	C Wang, S Chen, Y Yang, F Hu, F Liu, J Wu. Literature review on wireless sensing-Wi-Fi signal-based recognition of human activities. Tsinghua Science and Technology, 2018, 23: 203–222 https://doi.org/10.26599/TST.2018.9010080
5	A S Paul, E A Wan. RSSI-based indoor localization and tracking using sigma-point Kalman smoothers. IEEE Journal of Selected Topics in Signal Processing, 2009, 3: 860–873 https://doi.org/10.1109/JSTSP.2009.2032309
6	J Xiao, K Wu, Y Yi, L Wang, L M Ni. Pilot: passive device-free indoor localization using channel state information. In: Proceedings of the 33rd IEEE International Conference on Distributed Computing Systems. 2013, 236–245 https://doi.org/10.1109/ICDCS.2013.49
7	X Wang, L Gao, S Mao, S Pandey. CSI-based fingerprinting for indoor localization: a deep learning approach. IEEE Transactions on Vehicular Technology, 2016, 66: 763–776 https://doi.org/10.1109/TVT.2016.2545523
8	K Qian, C Wu, Z Yang, Y Liu, K Jamieson. Widar: decimeter-level passive tracking via velocity monitoring with commodity Wi-Fi. In: Proceedings of the 18th ACM International Symposium on Mobile Ad Hoc Networking and Computing. 2017, 1–10 https://doi.org/10.1145/3084041.3084067
9	K Qian, C Wu, Y Zhang, G Zhang, Z Yang, Y Liu. Widar2. 0: passive human tracking with a singleWi-Fi link. In: Proceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services. 2018, 350–361 https://doi.org/10.1145/3210240.3210314
10	Q Pu, S Gupta, S Gollakota, S Patel. Whole-home gesture recognition using wireless signals. In: Proceedings of the 19th Annual International Conference on Mobile Computing & Networking. 2013, 27–38 https://doi.org/10.1145/2500423.2500436
11	Y Wang, K Wu, L M Ni. Wifall: device-free fall detection by wireless networks. IEEE Transactions on Mobile Computing, 2016, 16: 581–594 https://doi.org/10.1109/TMC.2016.2557792
12	H Wang, D Zhang, Y Wang, J Ma, Y Wang, S Li. RT-Fall: a real-time and contactless fall detection system with commodityWiFi devices. IEEE Transactions on Mobile Computing, 2016, 16: 511–526 https://doi.org/10.1109/TMC.2016.2557795
13	G Wang, Y Zou, Z Zhou, K Wu, L M Ni. We can hear you with Wi-Fi!. IEEE Transactions on Mobile Computing, 2016, 15: 2907–2920 https://doi.org/10.1109/TMC.2016.2517630
14	Y Zeng, P H Pathak, P Mohapatra. WiWho: wifi-based person identification in smart spaces. In: Proceedings of the 15th ACM/IEEE International Conference on Information Processing in Sensor Networks. 2016, 1–12 https://doi.org/10.1109/IPSN.2016.7460727
15	X Wu, Z Chu, P Yang, C Xiang, X Zheng, W Huang. TW-See: human activity recognition through the wall with commodity Wi-Fi devices. IEEE Transactions on Vehicular Technology, 2018, 68: 306–319 https://doi.org/10.1109/TVT.2018.2878754
16	H Li, K Ota, M Dong, M Guo. Learning human activities through Wi-Fi channel state information with multiple access points. IEEE Communications Magazine, 2018, 56(5): 124–129 https://doi.org/10.1109/MCOM.2018.1700083
17	J Zhang, Z Tang, M Li, D Fang, P Nurmi, Z Wang. : CrossSense:Towards cross-site and large-scale WiFi sensing. In: Proceedings of the 24th Annual International Conference on Mobile Computing and Networking. 2018, 305–320 https://doi.org/10.1145/3241539.3241570
18	W Jiang, C Miao, F Ma, S Yao, Y Wnag, Y Yuan, H Xue, C Song, X Ma, D Koutsonikolas, W Xu, L Su. Towards environment independent device free human activity recognition. In: Proceedings of the 24th Annual International Conference on Mobile Computing and Networking. 2018, 289–304 https://doi.org/10.1145/3241539.3241548
19	Y Zheng, Y Zhang, K Qian, G Zhang, Y Liu, C Wu, Z Yang. Zero-effort cross-domain gesture recognition with Wi-Fi. In: Proceedings of the 17th Annual International Conference on Mobile Systems, Applications, and Services. 2019, 313–325 https://doi.org/10.1145/3307334.3326081
20	D Halperin, W Hu, A Sheth, D Wetherall. Tool release: gathering 802.11 n traces with channel state information. ACM SIGCOMM Computer Communication Review, 2011, 41(1): 53–53 https://doi.org/10.1145/1925861.1925870
21	S Sen, J Lee, K H Kim, P Congdon. Avoiding multipath to revive inbuilding WiFi localization. In: Proceedings of the 11th Annual International Conference on Mobile Systems, Applications, and Services. 2013, 249–262 https://doi.org/10.1145/2462456.2464463
22	X Wang, L Gao, S Mao, S Pandey. DeepFi: deep learning for indoor fingerprinting using channel state information. In: Proceedings of the 2015 IEEEWireless Communications and Networking Conference. 2015, 1666–1671
23	F A Gers, J Schmidhuber, F Cummins. Learning to forget: continual prediction with LSTM. Neural Computation, 2000, 12(10): 2451–2471 https://doi.org/10.1162/089976600300015015
24	S J Pan, Q Yang. A survey on transfer learning. IEEE Transactions on Knowledge and Data Engineering, 2010, 22: 1345–1359 https://doi.org/10.1109/TKDE.2009.191
25	J Yosinski, J Clune, Y Bengio, H Lipson. How transferable are features in deep neural networks? In: Proceedings of the 37th International Conference on Neural Information Processing Systems. 2014, 3320–3328
26	J Howard, S Ruder. Universal language model fine-tuning for text classification. In: Proceedings of the 56th Annual Meeting of the Association for Computagional linguistics. 2018, 328–339 https://doi.org/10.18653/v1/P18-1031
27	M Long, Y Cao, J Wang, M Jordan. Learning transferable features with deep adaptation networks. In: Proceedings of the International Conference on Machine Learning. 2015, 97–105
28	Y Ganin, E Ustinova, H Ajakan, P Germain, H Larochelle, F Laviolette, M Marchand, V Lempitsky. Domain-adversarial training of neural networks. The Journal of Machine Learning Research, 2016, 17: 2096–2030 https://doi.org/10.1007/978-3-319-58347-1_10
29	B Esmael, A Arnaout, R K Fruhwirth, G Thonhauser. Improving time series classification using Hidden Markov Models. In: Proceedings of the 12th International Conference on Hybrid Intelligent Systems. 2012, 502–507 https://doi.org/10.1109/HIS.2012.6421385
30	R J Kate. Using dynamic time warping distances as features for improved time series classification. Data Mining and Knowledge Discovery, 2016, 30: 283–312 https://doi.org/10.1007/s10618-015-0418-x
31	S Ioffe, C Szegedy. Batch normalization: accelerating deep network training by reducing internal covariate shift. In: Proceedings of Internationcol Conference on Machine Learning. 2015, 448–456
32	A Y Ng. Feature selection, L1 vs. L2 regularization, and rotational invariance. In: Proceedings of the 21st International Conference on Machine Learning. 2004 https://doi.org/10.1145/1015330.1015435
33	D P Kingma, J Ba. Adam: a method for stochastic optimization. 2014, arXiv preprint arXiv:1412.6980
34	R Zhou, X Lu, P Zhao, J Chen. Device-free presence detection and localization with SVM and CSI fingerprinting. IEEE Sensors Journal, 2017, 17: 7990–7999 https://doi.org/10.1109/JSEN.2017.2762428
35	Z Wang, B Guo, Z Yu, X Zhou. Wi-Fi CSI-based behavior recognition: from signals and actions to activities. IEEE Communications Magazine, 2018, 56: 109–115 https://doi.org/10.1109/MCOM.2018.1700144
36	Y Zeng, P H Pathak, P Mohapatra. Analyzing shopper’s behavior through wifi signals. In: Proceedings of the 2nd Workshop on Physical Analytics. 2015, 13–18 https://doi.org/10.1145/2753497.2753508
37	S Sigg, U Blanke, G Troster. The telepathic phone: frictionless activity recognition from wifi-rssi. In: Proceedings of the 2014 IEEE International Conference on Pervasive Computing and Communications. 2014, 148–155 https://doi.org/10.1109/PerCom.2014.6813955

[1]

Article highlights

Download

[1]	Tian ZHENG, Xinyang QIAN, Jiayin WANG. A structural variation genotyping algorithm enhanced by CNV quantitative transfer[J]. Front. Comput. Sci., 2022, 16(6): 166905-.
[2]	Jingya FENG, Lang LI. SCENERY: a lightweight block cipher based on Feistel structure[J]. Front. Comput. Sci., 2022, 16(3): 163813-.
[3]	Xinyu TONG, Ziao YU, Xiaohua TIAN, Houdong GE, Xinbing WANG. Improving accuracy of automatic optical inspection with machine learning[J]. Front. Comput. Sci., 2022, 16(1): 161310-.
[4]	Huichao MEN, Botao WANG, Gang WU. MiTAR: a study on human activity recognition based on NLP with microscopic perspective[J]. Front. Comput. Sci., 2021, 15(5): 155330-.
[5]	Edje E. ABEL, Muhammad Shafie Abd LATIFF. The utilization of algorithms for cloud internet of things application domains: a review[J]. Front. Comput. Sci., 2021, 15(3): 153502-.
[6]	Hao LIN, Guannan LIU, Fengzhi LI, Yuan ZUO. Where to go? Predicting next location in IoT environment[J]. Front. Comput. Sci., 2021, 15(1): 151306-.
[7]	Yu ZHANG, Yuxing HAN, Jiangtao WEN. SMER: a secure method of exchanging resources in heterogeneous internet of things[J]. Front. Comput. Sci., 2019, 13(6): 1198-1209.
[8]	Xuan LI, Jin LI, Siuming YIU, Chongzhi GAO, Jinbo XIONG. Privacy-preserving edge-assisted image retrieval and classification in IoT[J]. Front. Comput. Sci., 2019, 13(5): 1136-1147.
[9]	Xu-Ying LIU, Sheng-Tao WANG, Min-Ling ZHANG. Transfer synthetic over-sampling for class-imbalance learning with limited minority class data[J]. Front. Comput. Sci., 2019, 13(5): 996-1009.
[10]	Chunjie ZHOU, Xiaoling WANG, Zhiwang ZHANG, Zhenxing ZHANG, Haiping QU. The time model for event processing in internet of things[J]. Front. Comput. Sci., 2019, 13(3): 471-488.
[11]	Hao SHAO. Query by diverse committee in transfer active learning[J]. Front. Comput. Sci., 2019, 13(2): 280-291.
[12]	Zheng HE, Kunpeng BAI, Dongdai LIN, Chuankun WU. Unification of identifiers in the Sea-Cloud system[J]. Front. Comput. Sci., 2018, 12(4): 749-762.
[13]	Jie XIN,Zhiming CUI,Pengpeng ZHAO,Tianxu HE. Active transfer learning of matching query results across multiple sources[J]. Front. Comput. Sci., 2015, 9(4): 595-607.
[14]	Hebah ELGIBREEN,Mehmet Sabih AKSOY. RULES-IT: incremental transfer learning with RULES family[J]. Front. Comput. Sci., 2014, 8(4): 537-562.
[15]	Wei FAN, Zhengyong CHEN, Zhang XIONG, Hui CHEN. The Internet of data: a new idea to extend the IOT in the digital world[J]. Front Comput Sci, 2012, 6(6): 660-667.

Viewed

Full text

Abstract

Cited

Shared

Discussed