|
|
A framework based on sparse representation model for time series prediction in smart city |
Zhiyong YU1, Xiangping ZHENG1, Fangwan HUANG1( ), Wenzhong GUO1, Lin SUN2, Zhiwen YU3 |
1. College of Mathematics and Computer Science, Fuzhou University, Fuzhou 350108, China 2. Hangzhou Key Laboratory for IoT Technology & Application, Zhejiang University City College, Hangzhou 310015, China 3. School of Computer Science, Northwestern Polytechnical University, Xi’an 710072, China |
|
|
Abstract Smart city driven by Big Data and Internet of Things (IoT) has become a most promising trend of the future. As one important function of smart city, event alert based on time series prediction is faced with the challenge of how to extract and represent discriminative features of sensing knowledge from the massive sequential data generated by IoT devices. In this paper, a framework based on sparse representation model (SRM) for time series prediction is proposed as an efficient approach to tackle this challenge. After dividing the over-complete dictionary into upper and lower parts, the main idea of SRMis to obtain the sparse representation of time series based on the upper part firstly, and then realize the prediction of future values based on the lower part. The choice of different dictionaries has a significant impact on the performance of SRM. This paper focuses on the study of dictionary construction strategy and summarizes eight variants of SRM. Experimental results demonstrate that SRM can deal with different types of time series prediction flexibly and effectively.
|
Keywords
sparse representation
smart city
time series prediction
dictionary construction
|
Corresponding Author(s):
Fangwan HUANG
|
Just Accepted Date: 16 October 2019
Issue Date: 24 September 2020
|
|
1 |
Y Zheng. Urban computing: enabling urban intelligence with big data. Frontiers of Computer Science, 2017, 11(1): 1–3
https://doi.org/10.1007/s11704-016-6907-2
|
2 |
K Su, J Li, H Fu. Smart city and the applications. In: Proceedings of International Conference on Electronics, Communications and Control. 2011, 1028–1031
https://doi.org/10.1109/ICECC.2011.6066743
|
3 |
F Yi, Z Yu, H Chen, H Du, B Guo. Cyber-physical-social collaborative sensing: from single space to cross-space. Frontiers of Computer Science, 2018, 12(4): 609–622
https://doi.org/10.1007/s11704-017-6612-9
|
4 |
Z Yu, F Yi, Q Lv, B Guo. Identifying on-site users for social events: mobility, content, and social relationship. IEEE Transactions on Mobile Computing, 2018, 17(9): 2055–2068
https://doi.org/10.1109/TMC.2018.2794981
|
5 |
Z Yu, H Wang, B Guo, T Gu, T Mei. Supporting serendipitous social interaction using human mobility prediction. IEEE Transactions on Human- Machine Systems, 2015, 45(6): 811–818
https://doi.org/10.1109/THMS.2015.2451515
|
6 |
Z Yu, Z Yu, Y Chen. Multi-hop mobility prediction. Mobile Networks and Applications, 2016, 21(2): 367–374
https://doi.org/10.1007/s11036-015-0668-2
|
7 |
Z Yu, H Xu, Z Yang, B Guo. Personalized travel package with multipoint- of-interest recommendation based on crowdsourced user footprints. IEEE Transactions on Human-Machine Systems, 2015, 46(1): 151–158
https://doi.org/10.1109/THMS.2015.2446953
|
8 |
L Wang, Z Yu, B Guo, T Ku, F Yi. Moving destination prediction using sparse dataset: a mobility gradient descent approach. ACM Transactions on Knowledge Discovery from Data, 2017, 11(3): 1–33
https://doi.org/10.1145/3051128
|
9 |
C N Yu, P Mirowski, T K Ho. A sparse coding approach to household electricity demand forecasting in smart grids. IEEE Transactions on Smart Grid, 2016, 8(2): 738–748
https://doi.org/10.1109/TSG.2015.2513900
|
10 |
T C Fu. A review on time series data mining. Engineering Applications of Artificial Intelligence, 2011, 24(1): 164–181
https://doi.org/10.1016/j.engappai.2010.09.007
|
11 |
Z Zhang, Y Xu, J Yang, X Li, D Zhang. A survey of sparse representation: algorithms and applications. IEEE Access, 2015, 3: 490–530
https://doi.org/10.1109/ACCESS.2015.2430359
|
12 |
MW Fakhr. Online nonstationary time series prediction using sparse coding with dictionary update. In: Proceedings of IEEE International Conference on Information and Communication Technology Research. 2015, 112–115
https://doi.org/10.1109/ICTRC.2015.7156434
|
13 |
R Rosas-Romero, A Díaz-Torres, G Etcheverry. Forecasting of stock return prices with sparse representation of financial time series over redundant dictionaries. Expert Systems with Applications, 2016, 57: 37–48
https://doi.org/10.1016/j.eswa.2016.03.021
|
14 |
A Helmi, MW Fakhr, A F Atiya. Multi-step ahead time series forecasting via sparse coding and dictionary based techniques. Applied Soft Computing, 2018, 69: 464–474
https://doi.org/10.1016/j.asoc.2018.04.017
|
15 |
J G De Gooijer, R J Hyndman. 25 years of time series forecasting. International Journal of Forecasting, 2006, 22(3): 443–473
https://doi.org/10.1016/j.ijforecast.2006.01.001
|
16 |
D Dijk, T Teräsvirta, P H Franses. Smooth transition autoregressive models—a survey of recent developments. Econometric Reviews, 2002, 21(1): 1–47
https://doi.org/10.1081/ETC-120008723
|
17 |
N C Anand, C Scoglio, B Natarajan. GARCH—non-linear time series model for traffic modeling and prediction. In: Proceedings of IEEE Network Operations and Management Symposium. 2008, 694–697
https://doi.org/10.1109/NOMS.2008.4575191
|
18 |
G Bontempi, S Taieb, Y L Borgne. Business Intelligence. Berlin, Springer, 2013
|
19 |
N K Ahmed, A F Atiya, N E Gayar, H E Shishiny. An empirical comparison of machine learning models for time series forecasting. Econometric Reviews, 2010, 29(5–6): 594–621
https://doi.org/10.1080/07474938.2010.481556
|
20 |
M Kumar, M Thenmozhi. Forecasting stock index movement: a comparison of support vector machines and random forest. In: Proceedings of the 9th Capital Markets Conference on Indian Institute of Capital Markets. 2006, 1–16
https://doi.org/10.2139/ssrn.876544
|
21 |
M Längkvist, L Karlsson, A Loutfi. A review of unsupervised feature learning and deep learning for time-series modeling. Pattern Recognition Letters, 2014, 42: 11–24
https://doi.org/10.1016/j.patrec.2014.01.008
|
22 |
J Zheng, C Xu, Z Zhang, X Li. Electric load forecasting in smart grids using long-short-term-memory based recurrent neural network. In: Proceedings of the 51st IEEE Annual Conference on Information Sciences and Systems. 2017, 1–6
|
23 |
R Fu, Z Zhang, L Li. Using LSTM and GRU neural network methods for traffic flow prediction. In: Proceedings of the 31st IEEE Youth Academic Annual Conference of Chinese Association of Automation. 2016, 324–328
https://doi.org/10.1109/YAC.2016.7804912
|
24 |
G B Zhou, J Wu, C L Zhang, Z H Zhou. Minimal gated unit for recurrent neural networks. International Journal of Automation and Computing, 2016, 13(3): 226–234
https://doi.org/10.1007/s11633-016-1006-2
|
25 |
W Guo, J Li, G Chen, Y Niu, C Chen. A PSO-optimized real-time fault-tolerant task allocation algorithm in wireless sensor networks. IEEE Transactions on Parallel and Distributed Systems, 2014, 26(12): 3236–3249
https://doi.org/10.1109/TPDS.2014.2386343
|
26 |
D Ye, Z Chen. A new approach to minimum attribute reduction based on discrete artificial bee colony. Soft Computing, 2015, 19(7): 1893–1903
https://doi.org/10.1007/s00500-014-1371-0
|
27 |
X Qiu, L Zhang, Y Ren, P N Suganthan, G Amaratunga. Ensemble deep learning for regression and time series forecasting. In: Proceedings of IEEE Symposium on Computational Intelligence in Ensemble Learning. 2014, 1–6
https://doi.org/10.1109/CIEL.2014.7015739
|
28 |
G P Zhang. Time series forecasting using a hybrid ARIMA and neural network model. Neurocomputing, 2003, 50: 159–175
https://doi.org/10.1016/S0925-2312(01)00702-0
|
29 |
Z Duan, Y Yang, K Zhang, Y Ni, S Bajgain. Improved deep hybrid networks for urban traffic flow prediction using trajectory data. IEEE Access, 2018, 6: 31820–31827
https://doi.org/10.1109/ACCESS.2018.2845863
|
30 |
D L Donoho. Compressed sensing. IEEE Transactions on Information Theory, 2006, 52(4): 1289–1306
https://doi.org/10.1109/TIT.2006.871582
|
31 |
M S Lewicki, T J Sejnowski. Learning overcomplete representations. Neural Computation, 2000, 12(2): 337–365
https://doi.org/10.1162/089976600300015826
|
32 |
S Wang, W Guo. Sparse multigraph embedding for multimodal feature representation. IEEE Transactions on Multimedia, 2017, 19(7): 1454–1466
https://doi.org/10.1109/TMM.2017.2663324
|
33 |
R Rubinstein, A M Bruckstein, M Elad. Dictionaries for sparse representation modeling. Proceedings of the IEEE, 2010, 98(6): 1045–1057
https://doi.org/10.1109/JPROC.2010.2040551
|
34 |
I Batal, M Hauskrecht. A supervised time series feature extraction technique using DCT and DWT. In: Proceedings of IEEE International Conference on Machine Learning and Applications. 2009, 735–739
https://doi.org/10.1109/ICMLA.2009.13
|
35 |
R S Stanković, B J Falkowski. The Haar wavelet transform: its status and achievements. Computers & Electrical Engineering, 2003, 29(1): 25–44
https://doi.org/10.1016/S0045-7906(01)00011-8
|
36 |
A Qayyum, A S Malik, M Naufal, M Saad, M Mazher, F Abdullah, T A R B T Abdullah. Designing of overcomplete dictionaries based on DCT and DWT. In: Proceedings of IEEE Student Symposium in Biomedical Engineering & Sciences. 2015, 134–139
https://doi.org/10.1109/ISSBES.2015.7435883
|
37 |
M Aharon, M Elad, A Bruckstein. K-SVD: an algorithm for designing overcomplete dictionaries for sparse representation. IEEE Transactions on Signal Processing, 2006, 54(11): 4311–4322
https://doi.org/10.1109/TSP.2006.881199
|
38 |
Ö F Ertugrul. Forecasting electricity load by a novel recurrent extreme learning machines approach. International Journal of Electrical Power & Energy Systems, 2016, 78: 429–435
https://doi.org/10.1016/j.ijepes.2015.12.006
|
39 |
B K Natarajan. Sparse approximate solutions to linear systems. SIAM Journal on Computing, 1995, 24(2): 227–234
https://doi.org/10.1137/S0097539792240406
|
40 |
S G Mallat, Z Zhang. Matching pursuits with time-frequency dictionaries. IEEE Transactions on Signal Processing, 1993, 41(12): 3397–3415
https://doi.org/10.1109/78.258082
|
41 |
Y C Pati, R Rezaiifar, P S Krishnaprasad. Orthogonal matching pursuit: recursive function approximation with applications to wavelet decomposition. In: Proceedings of the 27th IEEE Asilomar Conference on Signals, Systems and Computers. 1993, 40–44
|
42 |
D Needell, J A Tropp. CoSaMP: iterative signal recovery from incomplete and inaccurate samples. Applied and Computational Harmonic Analysis, 2009, 26(3): 301–321
https://doi.org/10.1016/j.acha.2008.07.002
|
43 |
D L Donoho, Y Tsaig, I Drori, J L Starck. Sparse solution of underdetermined linear equations by stagewise orthogonal matching pursuit. IEEE Transactions on Information Theory, 2012, 58(2): 1094–1121
https://doi.org/10.1109/TIT.2011.2173241
|
44 |
W Dai, O Milenkovic. Subspace pursuit for compressive sensing signal reconstruction. IEEE Transactions on Information Theory, 2009, 55(5): 2230–2249
https://doi.org/10.1109/TIT.2009.2016006
|
45 |
N B Karahanoglu, H Erdogan. Compressed sensing signal recovery via forward–backward pursuit. Digital Signal Processing, 2013, 23(5): 1539–1548
https://doi.org/10.1016/j.dsp.2013.05.007
|
46 |
D L Donoho. For most large underdetermined systems of linear equations the minimal l1-norm solution is also the sparsest solution. Communications on Pure and Applied Mathematics, 2006, 59(6): 797–829
https://doi.org/10.1002/cpa.20132
|
47 |
S S Chen, D L Donoho, M A Saunders. Atomic decomposition by basis pursuit. SIAM Review, 2001, 43(1): 129–159
https://doi.org/10.1137/S003614450037906X
|
48 |
B Efron, T Hastie, I Johnstone, R Tibshirani. Least angle regression. The Annals of Statistics, 2004, 32(2): 407–499
https://doi.org/10.1214/009053604000000067
|
49 |
MA T Figueiredo, R D Nowak, S J Wright. Gradient projection for sparse reconstruction: application to compressed sensing and other inverse problems. IEEE Journal of Selected Topics in Signal Processing, 2007, 1(4): 586–597
https://doi.org/10.1109/JSTSP.2007.910281
|
50 |
A Beck, M Teboulle. A fast iterative shrinkage-thresholding algorithm for linear inverse problems. SIAM Journal on Imaging Sciences, 2009, 2(1): 183–202
https://doi.org/10.1137/080716542
|
51 |
K Qiu, A Dogandzic. Variance-component based sparse signal reconstruction and model selection. IEEE Transactions on Signal Processing, 2010, 58(6): 2935–2952
https://doi.org/10.1109/TSP.2010.2044828
|
52 |
S Guo, Z Wang, Q Ruan. Enhancing sparsity via lp (0<p<1) minimization for robust face recognition. Neurocomputing, 2013, 99: 592–602
https://doi.org/10.1016/j.neucom.2012.05.028
|
53 |
R Chartrand. Exact reconstruction of sparse signals via nonconvex minimization. IEEE Signal Processing Letters, 2007, 14(10): 707–710
https://doi.org/10.1109/LSP.2007.898300
|
54 |
J Zeng, Z Xu, B Zhang, W Hong, Y Wu. Accelerated L1/2 regularization based SAR imaging via BCR and reduced Newton skills. Signal Processing, 2013, 93(7): 1831–1844
https://doi.org/10.1016/j.sigpro.2012.12.017
|
55 |
S Foucart, M J Lai. Sparsest solutions of underdetermined linear systems via lq-minimization for 0<q≤1. Applied and Computational Harmonic Analysis, 2009, 26(3): 395–407
|
56 |
I Daubechies, R DeVore, M Fornasier, C S Güntürk. Iteratively reweighted least squares minimization for sparse recovery. Communications on Pure and Applied Mathematics, 2010, 63(1): 1–38
https://doi.org/10.1002/cpa.20303
|
57 |
Z Xu, X Chang, F Xu, H Zhang. L1/2 regularization: a thresholding representation theory and a fast solver. IEEE Transactions on Neural Networks and Learning Systems, 2012, 23(7): 1013–1027
https://doi.org/10.1109/TNNLS.2012.2197412
|
58 |
B J Chen, M Chang, C J Lin. Load forecasting using support vector machines: a study on EUNITE competition 2001. IEEE Transactions on Power Systems, 2004, 19(4): 1821–1830
https://doi.org/10.1109/TPWRS.2004.835679
|
59 |
S Makridakis, M Hibon. The M3-Competition: results, conclusions and implications. International Journal of Forecasting, 2000, 16(4): 451–476
https://doi.org/10.1016/S0169-2070(00)00057-1
|
60 |
S Makridakis, E Spiliotis, V Assimakopoulos. The accuracy of machine learning (ML) forecasting methods versus statistical ones: extending the results of the M3-Competition. Working Paper, University of Nicosia, Institute for the Future, Greece, 2017
|
61 |
S Makridakis, E Spiliotis, V Assimakopoulos. Statistical and machine learning forecasting methods: concerns and ways forward. PloS One, 2018, 13(3): e0194889
https://doi.org/10.1371/journal.pone.0194889
|
62 |
S B Taieb, A F Atiya. A bias and variance analysis for multistep-ahead time series forecasting. IEEE Transactions on Neural Networks and Learning Systems, 2015, 27(1): 62–76
https://doi.org/10.1109/TNNLS.2015.2411629
|
|
Viewed |
|
|
|
Full text
|
|
|
|
|
Abstract
|
|
|
|
|
Cited |
|
|
|
|
|
Shared |
|
|
|
|
|
Discussed |
|
|
|
|