Significant progress has been made in machine learning with large amounts of clean labels and static data. However, in many real-world applications, the data often changes with time and it is difficult to obtain massive clean annotations, that is, noisy labels and time series are faced simultaneously. For example, in product-buyer evaluation, each sample records the daily time behavior of users, but the long transaction period brings difficulties to analysis, and salespeople often erroneously annotate the user’s purchase behavior. Such a novel setting, to our best knowledge, has not been thoroughly studied yet, and there is still a lack of effective machine learning methods. In this paper, we present a systematic approach RTS both theoretically and empirically, consisting of two components, Noise-Tolerant Time Series Representation and Purified Oversampling Learning. Specifically, we propose reducing label noise’s destructive impact to obtain robust feature representations and potential clean samples. Then, a novel learning method based on the purified data and time series oversampling is adopted to train an unbiased model. Theoretical analysis proves that our proposal can improve the quality of the noisy data set. Empirical experiments on diverse tasks, such as the house-buyer evaluation task from real-world applications and various benchmark tasks, clearly demonstrate that our new algorithm robustly outperforms many competitive methods.
Z H Zhou . Machine Learning. Singapore: Springer, 2021
2
He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. In: Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition. 2016, 770−778
3
G, Adomavicius A Tuzhilin . Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions. IEEE Transactions on Knowledge and Data Engineering, 2005, 17( 6): 734–749
4
I Kononenko . Machine learning for medical diagnosis: history, state of the art and perspective. Artificial Intelligence in Medicine, 2001, 23( 1): 89–109
5
Cao H, Li X L, Woon Y K, Ng S K. SPO: structure preserving oversampling for imbalanced time series classification. In: Proceedings of the 11th IEEE International Conference on Data Mining. 2011, 1008−1013
6
L Z, Guo F, Kuang Z X, Liu Y F, Li N, Ma X H Qie . IWE-Net: instance weight network for locating negative comments and its application to improve traffic user experience. In: Proceedings of the 34th AAAI Conference on Artificial Intelligence. 2020, 4052−4059
7
B, Frenay M Verleysen . Classification in the presence of label noise: a survey. IEEE Transactions on Neural Networks and Learning Systems, 2014, 25( 5): 845–869
8
G, Atkinson V Metsis . A survey of methods for detection and correction of noisy labels in time series data. In: Proceedings of the 17th International Conference on Artificial Intelligence Applications and Innovations. 2021, 479−493
9
T, Wei H, Wang W, Tu Y F Li . Robust model selection for positive and unlabeled learning with constraints. Science China Information Science, 2022, 65( 11): 212101
10
C, Pelletier S, Valero J, Inglada N, Champion C M, Sicre G Dedieu . Effect of training class label noise on classification performances for land cover mapping with satellite image time series. Remote Sensing, 2017, 9( 2): 173
11
A, Castellani S, Schmitt B Hammer . Estimating the electrical power output of industrial devices with end-to-end time-series classification in the presence of label noise. In: Proceedings of the Joint European Conference on Machine Learning and Knowledge Discovery in Databases. 2021, 469−484
12
Atkinson G, Metsis V. Identifying label noise in time-series datasets. In: Proceedings of 2020 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of 2020 ACM International Symposium on Wearable Computers. 2020, 238−243
13
H, Cao X L, Li D Y K, Woon S K Ng . Integrated oversampling for imbalanced time series classification. IEEE Transactions on Knowledge and Data Engineering, 2013, 25( 12): 2809–2822
14
B, Kim J H, Choi J Choo . Augmenting imbalanced time-series data via adversarial perturbation in latent space. In: Proceedings of the 13th Asian Conference on Machine Learning. 2021, 1633−1644
15
H, Huang C, Xu S, Yoo W, Yan T, Wang F Xue . Imbalanced time series classification for flight data analyzing with nonlinear granger causality learning. In: Proceedings of the 29th ACM International Conference on Information & Knowledge Management. 2020, 2533−2540
16
Y, Geng X Luo . Cost-sensitive convolutional neural networks for imbalanced time series classification. Intelligent Data Analysis, 2019, 23( 2): 357–370
17
Ward M, Malmsten K, Salamy H, Min C H. Data balanced bagging ensemble of convolutional- LSTM neural networks for time series data classification with an imbalanced dataset. In: Proceedings of 2021 IEEE International Symposium on Circuits and Systems. 2021, 1−5
18
T, Wei J X, Shi W W, Tu Y F Li . Robust long-tailed learning under label noise. 2021, arXiv preprint arXiv: 2108.11569
19
T, Wei J X, Shi Y F, Li M L Zhang . Prototypical classifier for robust class-imbalanced learning. In: Proceedings of the 26th Pacific-Asia Conference on Knowledge Discovery and Data Mining. 2022, 44−57
20
X J, Gui W, Wang Z H Tian . Towards understanding deep learning from noisy labels with small-loss criterion. In: Proceedings of the 30th International Joint Conference on Artificial Intelligence. 2021, 2469−2475
21
M, Lukasik S, Bhojanapalli A K, Menon S Kumar . Does label smoothing mitigate label noise?. In: Proceedings of the 37th International Conference on Machine Learning. 2020, 598
22
S, Laine T Aila . Temporal ensembling for semi-supervised learning. In: Proceedings of the 5th International Conference on Learning Representations. 2017
23
B, Han Q, Yao T, Liu G, Niu I W, Tsang J T, Kwok M Sugiyama . A survey of label-noise representation learning: past, present and future. 2021, arXiv preprint arXiv: 2011.04406
24
B, Han Q, Yao X, Yu G, Niu M, Xu W, Hu I W, Tsang M Sugiyama . Co-teaching: robust training of deep neural networks with extremely noisy labels. In: Proceedings of the 32nd International Conference on Neural Information Processing Systems. 2018, 8536−8546
25
Y F, Li D M Liang . Safe semi-supervised learning: a brief introduction. Frontiers of Computer Science, 2019, 13( 4): 669–676
26
Jia L H, Guo L Z, Zhou Z, Li Y F. Lamda-ssl: a comprehensive semi-supervised learning toolkit. Science China Information Science, 2023
27
Dau H A, Bagnall A J, Kamgar K, Yeh C M, Zhu Y, Gharghabi S, Ratanamahatana C A, Keogh E J. The UCR time series archive. IEEE/CAA Journal of Automatica Sinica, 2019, 6(6): 1293–1305
28
D P, Kingma J Ba . Adam: a method for stochastic optimization. In: Proceedings of the 3rd International Conference on Learning Representations. 2015
29
R, Tavenard J, Faouzi G, Vandewiele F, Divo G, Androz C, Holtz M, Payne R, Yurchak M, Rußwurm K, Kolar E Woods . Tslearn, a machine learning toolkit for time series data. The Journal of Machine Learning Research, 2020, 21( 1): 118
30
B, Han G, Niu X, Yu Q, Yao M, Xu I W, Tsang M Sugiyama . SIGUA: forgetting may make learning with noisy labels more robust. In: Proceedings of the 37th International Conference on Machine Learning. 2020, 4006−4016
31
N V, Chawla K W, Bowyer L O, Hall W P Kegelmeyer . SMOTE: synthetic minority over-sampling technique. Journal of Artificial Intelligence Research, 2002, 16( 1): 321–357
32
K, Cao C, Wei A, Gaidon N, Arechiga T Ma . Learning imbalanced datasets with label-distribution-aware margin loss. In: Proceedings of the 33rd International Conference on Neural Information Processing Systems. 2019, 140
33
K H, Brodersen C S, Ong K E, Stephan J M Buhmann . The balanced accuracy and its posterior distribution. In: Proceedings of the 20th International Conference on Pattern Recognition. 2010, 3121−3124
