Please wait a minute...
Frontiers of Computer Science

ISSN 2095-2228

ISSN 2095-2236(Online)

CN 10-1014/TP

邮发代号 80-970

2019 Impact Factor: 1.275

Frontiers of Computer Science  2022, Vol. 16 Issue (1): 161502   https://doi.org/10.1007/s11704-021-0407-8
  本期目录
Cross-scene passive human activity recognition using commodity WiFi
Yuanrun FANG, Fu XIAO(), Biyun SHENG, Letian SHA, Lijuan SUN
School of Computer Science, Nanjing University of Posts and Telecommunications, Nanjing 210023, China
 全文: PDF(715 KB)  
Abstract

With the development of the Internet of Things (IoT) and the popularization of commercial WiFi, researchers have begun to use commercial WiFi for human activity recognition in the past decade. However, cross-scene activity recognition is still difficult due to the different distribution of samples in different scenes. To solve this problem, we try to build a cross-scene activity recognition system based on commercial WiFi. Firstly, we use commercial WiFi devices to collect channel state information (CSI) data and use the Bi-directional long short-termmemory (BiLSTM) network to train the activity recognition model. Then, we use the transfer learning mechanism to transfer the model to fit another scene. Finally, we conduct experiments to evaluate the performance of our system, and the experimental results verify the accuracy and robustness of our proposed system. For the source scene, the accuracy of the model trained from scratch can achieve over 90%. After transfer learning, the accuracy of cross-scene activity recognition in the target scene can still reach 90%.

Key wordsInternet of Things    WiFi sensing    channel state in-formation (CSI)    human activity recognition    transfer learning
收稿日期: 2020-08-12      出版日期: 2021-11-03
Corresponding Author(s): Fu XIAO   
 引用本文:   
. [J]. Frontiers of Computer Science, 2022, 16(1): 161502.
Yuanrun FANG, Fu XIAO, Biyun SHENG, Letian SHA, Lijuan SUN. Cross-scene passive human activity recognition using commodity WiFi. Front. Comput. Sci., 2022, 16(1): 161502.
 链接本文:  
https://academic.hep.com.cn/fcs/CN/10.1007/s11704-021-0407-8
https://academic.hep.com.cn/fcs/CN/Y2022/V16/I1/161502
1 Y Chen, L Yu, K Ota, M Dong. Robust activity recognition for aging society. IEEE Journal of Biomedical and Health Informatics, 2018, 22(6): 1754–1764
https://doi.org/10.1109/JBHI.2018.2819182
2 S Yousefi, H Narui, S Dayal, S Ermon, S Valaee. A survey on behavior recognition using wifi channel state information. IEEE Communications Magazine, 2017, 55: 98–104
https://doi.org/10.1109/MCOM.2017.1700082
3 K Wu, J Xiao, Y Yi, D Chen, X Luo, L M Ni. CSI-based indoor localization. IEEE Transactions on Parallel and Distributed Systems, 2012, 24: 1300–1309
https://doi.org/10.1109/TPDS.2012.214
4 C Wang, S Chen, Y Yang, F Hu, F Liu, J Wu. Literature review on wireless sensing-Wi-Fi signal-based recognition of human activities. Tsinghua Science and Technology, 2018, 23: 203–222
https://doi.org/10.26599/TST.2018.9010080
5 A S Paul, E A Wan. RSSI-based indoor localization and tracking using sigma-point Kalman smoothers. IEEE Journal of Selected Topics in Signal Processing, 2009, 3: 860–873
https://doi.org/10.1109/JSTSP.2009.2032309
6 J Xiao, K Wu, Y Yi, L Wang, L M Ni. Pilot: passive device-free indoor localization using channel state information. In: Proceedings of the 33rd IEEE International Conference on Distributed Computing Systems. 2013, 236–245
https://doi.org/10.1109/ICDCS.2013.49
7 X Wang, L Gao, S Mao, S Pandey. CSI-based fingerprinting for indoor localization: a deep learning approach. IEEE Transactions on Vehicular Technology, 2016, 66: 763–776
https://doi.org/10.1109/TVT.2016.2545523
8 K Qian, C Wu, Z Yang, Y Liu, K Jamieson. Widar: decimeter-level passive tracking via velocity monitoring with commodity Wi-Fi. In: Proceedings of the 18th ACM International Symposium on Mobile Ad Hoc Networking and Computing. 2017, 1–10
https://doi.org/10.1145/3084041.3084067
9 K Qian, C Wu, Y Zhang, G Zhang, Z Yang, Y Liu. Widar2. 0: passive human tracking with a singleWi-Fi link. In: Proceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services. 2018, 350–361
https://doi.org/10.1145/3210240.3210314
10 Q Pu, S Gupta, S Gollakota, S Patel. Whole-home gesture recognition using wireless signals. In: Proceedings of the 19th Annual International Conference on Mobile Computing & Networking. 2013, 27–38
https://doi.org/10.1145/2500423.2500436
11 Y Wang, K Wu, L M Ni. Wifall: device-free fall detection by wireless networks. IEEE Transactions on Mobile Computing, 2016, 16: 581–594
https://doi.org/10.1109/TMC.2016.2557792
12 H Wang, D Zhang, Y Wang, J Ma, Y Wang, S Li. RT-Fall: a real-time and contactless fall detection system with commodityWiFi devices. IEEE Transactions on Mobile Computing, 2016, 16: 511–526
https://doi.org/10.1109/TMC.2016.2557795
13 G Wang, Y Zou, Z Zhou, K Wu, L M Ni. We can hear you with Wi-Fi!. IEEE Transactions on Mobile Computing, 2016, 15: 2907–2920
https://doi.org/10.1109/TMC.2016.2517630
14 Y Zeng, P H Pathak, P Mohapatra. WiWho: wifi-based person identification in smart spaces. In: Proceedings of the 15th ACM/IEEE International Conference on Information Processing in Sensor Networks. 2016, 1–12
https://doi.org/10.1109/IPSN.2016.7460727
15 X Wu, Z Chu, P Yang, C Xiang, X Zheng, W Huang. TW-See: human activity recognition through the wall with commodity Wi-Fi devices. IEEE Transactions on Vehicular Technology, 2018, 68: 306–319
https://doi.org/10.1109/TVT.2018.2878754
16 H Li, K Ota, M Dong, M Guo. Learning human activities through Wi-Fi channel state information with multiple access points. IEEE Communications Magazine, 2018, 56(5): 124–129
https://doi.org/10.1109/MCOM.2018.1700083
17 J Zhang, Z Tang, M Li, D Fang, P Nurmi, Z Wang. : CrossSense:Towards cross-site and large-scale WiFi sensing. In: Proceedings of the 24th Annual International Conference on Mobile Computing and Networking. 2018, 305–320
https://doi.org/10.1145/3241539.3241570
18 W Jiang, C Miao, F Ma, S Yao, Y Wnag, Y Yuan, H Xue, C Song, X Ma, D Koutsonikolas, W Xu, L Su. Towards environment independent device free human activity recognition. In: Proceedings of the 24th Annual International Conference on Mobile Computing and Networking. 2018, 289–304
https://doi.org/10.1145/3241539.3241548
19 Y Zheng, Y Zhang, K Qian, G Zhang, Y Liu, C Wu, Z Yang. Zero-effort cross-domain gesture recognition with Wi-Fi. In: Proceedings of the 17th Annual International Conference on Mobile Systems, Applications, and Services. 2019, 313–325
https://doi.org/10.1145/3307334.3326081
20 D Halperin, W Hu, A Sheth, D Wetherall. Tool release: gathering 802.11 n traces with channel state information. ACM SIGCOMM Computer Communication Review, 2011, 41(1): 53–53
https://doi.org/10.1145/1925861.1925870
21 S Sen, J Lee, K H Kim, P Congdon. Avoiding multipath to revive inbuilding WiFi localization. In: Proceedings of the 11th Annual International Conference on Mobile Systems, Applications, and Services. 2013, 249–262
https://doi.org/10.1145/2462456.2464463
22 X Wang, L Gao, S Mao, S Pandey. DeepFi: deep learning for indoor fingerprinting using channel state information. In: Proceedings of the 2015 IEEEWireless Communications and Networking Conference. 2015, 1666–1671
23 F A Gers, J Schmidhuber, F Cummins. Learning to forget: continual prediction with LSTM. Neural Computation, 2000, 12(10): 2451–2471
https://doi.org/10.1162/089976600300015015
24 S J Pan, Q Yang. A survey on transfer learning. IEEE Transactions on Knowledge and Data Engineering, 2010, 22: 1345–1359
https://doi.org/10.1109/TKDE.2009.191
25 J Yosinski, J Clune, Y Bengio, H Lipson. How transferable are features in deep neural networks? In: Proceedings of the 37th International Conference on Neural Information Processing Systems. 2014, 3320–3328
26 J Howard, S Ruder. Universal language model fine-tuning for text classification. In: Proceedings of the 56th Annual Meeting of the Association for Computagional linguistics. 2018, 328–339
https://doi.org/10.18653/v1/P18-1031
27 M Long, Y Cao, J Wang, M Jordan. Learning transferable features with deep adaptation networks. In: Proceedings of the International Conference on Machine Learning. 2015, 97–105
28 Y Ganin, E Ustinova, H Ajakan, P Germain, H Larochelle, F Laviolette, M Marchand, V Lempitsky. Domain-adversarial training of neural networks. The Journal of Machine Learning Research, 2016, 17: 2096–2030
https://doi.org/10.1007/978-3-319-58347-1_10
29 B Esmael, A Arnaout, R K Fruhwirth, G Thonhauser. Improving time series classification using Hidden Markov Models. In: Proceedings of the 12th International Conference on Hybrid Intelligent Systems. 2012, 502–507
https://doi.org/10.1109/HIS.2012.6421385
30 R J Kate. Using dynamic time warping distances as features for improved time series classification. Data Mining and Knowledge Discovery, 2016, 30: 283–312
https://doi.org/10.1007/s10618-015-0418-x
31 S Ioffe, C Szegedy. Batch normalization: accelerating deep network training by reducing internal covariate shift. In: Proceedings of Internationcol Conference on Machine Learning. 2015, 448–456
32 A Y Ng. Feature selection, L1 vs. L2 regularization, and rotational invariance. In: Proceedings of the 21st International Conference on Machine Learning. 2004
https://doi.org/10.1145/1015330.1015435
33 D P Kingma, J Ba. Adam: a method for stochastic optimization. 2014, arXiv preprint arXiv:1412.6980
34 R Zhou, X Lu, P Zhao, J Chen. Device-free presence detection and localization with SVM and CSI fingerprinting. IEEE Sensors Journal, 2017, 17: 7990–7999
https://doi.org/10.1109/JSEN.2017.2762428
35 Z Wang, B Guo, Z Yu, X Zhou. Wi-Fi CSI-based behavior recognition: from signals and actions to activities. IEEE Communications Magazine, 2018, 56: 109–115
https://doi.org/10.1109/MCOM.2018.1700144
36 Y Zeng, P H Pathak, P Mohapatra. Analyzing shopper’s behavior through wifi signals. In: Proceedings of the 2nd Workshop on Physical Analytics. 2015, 13–18
https://doi.org/10.1145/2753497.2753508
37 S Sigg, U Blanke, G Troster. The telepathic phone: frictionless activity recognition from wifi-rssi. In: Proceedings of the 2014 IEEE International Conference on Pervasive Computing and Communications. 2014, 148–155
https://doi.org/10.1109/PerCom.2014.6813955
[1] Article highlights Download
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed