A parallel and robust object tracking approach synthesizing adaptive Bayesian learning and improved incremental subspace learning
Kang LI1,2, Fazhi HE1(), Haiping YU1, Xiao CHEN1
1. State Key Laboratory of Software Engineering, School of Computer Science,Wuhan University,Wuhan 430072, China 2. School of Computer Science and Information Engineering, Hubei University,Wuhan 430062, China
This paper presents a novel tracking algorithm which integrates two complementary trackers. Firstly, an improved Bayesian tracker(B-tracker) with adaptive learning rate is presented. The classification score of B-tracker reflects tracking reliability, and a low score usually results from large appearance change. Therefore, if the score is low, we decrease the learning rate to update the classifier fast so that B-tracker can adapt to the variation and vice versa. In this way, B-tracker is more suitable than its traditional version to solve appearance change problem. Secondly, we present an improved incremental subspace learning method tracker(Stracker). We propose to calculate projected coordinates using maximum posterior probability, which results in a more accurate reconstruction error than traditional subspace learning tracker. Instead of updating at every time, we present a stopstrategy to deal with occlusion problem. Finally, we present an integrated framework(BAST), in which the pair of trackers run in parallel and return two candidate target states separately. For each candidate state, we define a tracking reliability metrics to measure whether the candidate state is reliable or not, and the reliable candidate state will be chosen as the target state at the end of each frame. Experimental results on challenging sequences show that the proposed approach is very robust and effective in comparison to the state-of-the-art trackers.
A Ali, A Jalil, J Niu, X Zhao, S Rathore, J Ahmed, M A Iftikhar. Visual object tracking–classical and contemporary approaches. Frontiers of Computer Science, 2016, 10(1): 167–188 https://doi.org/10.1007/s11704-015-4246-3
2
Y Wang, Q Zhao. Patchwise tracking via spatio-temporal constraintbased sparse representation and multiple-instance learning-based SVM. In: Proceedings of International Conference on Neural Information Processing. 2015, 264–271 https://doi.org/10.1007/978-3-319-26532-2_29
3
K Li, F He, X Chen. Real-time object tracking via compressive feature selection. Frontiers of Computer Science, 2016, 10(4): 689–701 https://doi.org/10.1007/s11704-016-5106-5
Y Wu, M Pei, M Yang, J Yuan, Y Jia. Robust discriminative tracking via landmark-based label propagation. IEEE Transactions on Image Processing, 2015, 24(5): 1510–1523 https://doi.org/10.1109/TIP.2015.2405479
6
L Wang, T Liu, G Wang, K L Chan, Q Yang. Video tracking using learned hierarchical features. IEEE Transactions on Image Processing, 2015, 24(4): 1424–1435 https://doi.org/10.1109/TIP.2015.2403231
7
K Zhang, Q Liu, Y Wu, M H Yang. Robust visual tracking via convolutional networks without training. IEEE Transactions on Image Processing, 2016, 25(4): 1779–1792 https://doi.org/10.1109/TIP.2016.2531283
8
C Xu, W Tao, Z Meng, Z Feng. Robust visual tracking via online multiple instance learning with fisher information. Pattern Recognition, 2015, 48(12): 3917–3926 https://doi.org/10.1016/j.patcog.2015.06.004
9
G Wang, X Qin, F Zhong, Y Liu, H Li, Q Peng, M Yang. Visual tracking via sparse and local linear coding. IEEE Transactions on Image Processing, 2015, 24(11): 3796–3809 https://doi.org/10.1109/TIP.2015.2445291
10
X Sun, H Yao, S Zhang, D Li . Non-rigid object contour tracking via a novel supervised level set model. IEEE Transactions on Image Processing, 2015, 24(11): 3386–3399 https://doi.org/10.1109/TIP.2015.2447213
11
Y Sui, S Zhang, L Zhang. Robust visual tracking via sparsity-induced subspace learning. IEEE Transactions on Image Processing, 2015, 24(12): 4686–4700 https://doi.org/10.1109/TIP.2015.2462076
12
S I Jang, K Choi, K A Toh, A B J Teoh, J Kim. Object tracking based on an online learning network with total error rate minimization. Pattern Recognition, 2015, 48(1): 126–139 https://doi.org/10.1016/j.patcog.2014.07.020
13
J Sun, F He, Y Chen, X Chen. A multiple template approach for robust tracking of fast motion target. Applied Mathematics-A Journal of Chinese Universities, 2016, 31(2): 177–197 https://doi.org/10.1007/s11766-016-3378-z
14
H Hong-tu, B Du-yan, Z Yu-fei, M Shi-ping, G Shan, L Chang. Robust visual tracking based on product sparse coding. Pattern Recognition Letters, 2015, 56: 52–59 https://doi.org/10.1016/j.patrec.2015.01.014
15
C Chen, S Li, H Qin, A Hao. Real-time and robust object tracking in video via low-rank coherency analysis in feature space. Pattern Recognition, 2015, 48(9): 2885–2905 https://doi.org/10.1016/j.patcog.2015.01.025
16
T Zhang, S Liu, N Ahuja, M H Yang, B Ghanem. Robust visual tracking via consistent low-rank sparse learning. International Journal of Computer Vision, 2015, 111(2): 171–190 https://doi.org/10.1007/s11263-014-0738-0
17
X Zhang, W Hu, N Xie, H Bao, S Maybank. A robust tracking system for low frame rate video. International Journal of Computer Vision, 2015, 115(3): 279–304 https://doi.org/10.1007/s11263-015-0819-8
18
Y Zhou, X Bai , W Liu, L J Latecki. Similarity fusion for visual tracking. International Journal of Computer Vision, 2016, 118(3): 337–363 https://doi.org/10.1007/s11263-015-0879-9
19
D Zhang, F He, S Han, L Zou, Y Wu, Y Chen. An efficient approach to directly compute the exact Hausdorff distance for 3D point sets. Integrated Computer-Aided Engineering, 2017, 24(3), 261–277 https://doi.org/10.3233/ICA-170544
20
X Li, C Shen, A Dick, Z M Zhang, Y Zhuang. Online metric-weighted linear representations for robust visual tracking. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2016, 38(5): 931–950 https://doi.org/10.1109/TPAMI.2015.2469276
21
T Zhang, S Liu, C Xu, S Yan, B Ghanem, N Ahuja, M H Yang. Structural sparse tracking. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2015, 150–158 https://doi.org/10.1109/CVPR.2015.7298610
22
K Li, F He, H P Yu. Robust visual tracking based on convolutional features with illumination and occlusion handling. Journal of Computer Science and Technology, 2018, 33(1): 223–236 https://doi.org/10.1007/s11390-017-1764-5
23
T Liu, G Wang, Q Yang. Real-time part-based visual tracking via adaptive correlation filters. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 2015, 4902–4912 https://doi.org/10.1109/CVPR.2015.7299124
24
Y L Chen, F Z He , Y Q Wu, N Hou. A local start search algorithm to compute exact Hausdorff distance for arbitrary point sets. Pattern Recognition, 2017, 67: 139–148 https://doi.org/10.1016/j.patcog.2017.02.013
25
Z Zhang, K Hong Wong. Pyramid-based visual tracking using sparsity represented mean transform. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2014, 1226–1233 https://doi.org/10.1109/CVPR.2014.160
26
T Zhang, K Jia, C Xu, Y Ma, N Ahuja. Partial occlusion handling for visual tracking via robust part matching. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2014, 1258–1265 https://doi.org/10.1109/CVPR.2014.164
27
H P Yu, F He, Y Pan. A novel region-based active contour model via local patch similarity measure for image segmentation. Multimedia Tools and Applications, 2018, 77(18): 24097–24119 https://doi.org/10.1007/s11042-018-5697-y
28
M Danelljan, F Shahbaz Khan, M Felsberg, J Van de Weijer. Adaptive color attributes for real-time visual tracking. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2014, 1090–1097 https://doi.org/10.1109/CVPR.2014.143
29
M Yang, M T Pei, Y W Wu, Y Jia. Learning online structural appearance model for robust object tracking. Science China Information Sciences, 2015, 58(3): 1–14 https://doi.org/10.1007/s11432-014-5177-6
30
A W Smeulders, D M Chu, R Cucchiara, S Calderara, A Dehghan, M Shah. Visual tracking: an experimental survey. IEEE Transactions on Pattern Analysis andMachine Intelligence, 2014, 36(7): 1442–1468
31
H Zhang, S Hu, G Yang. Video object tracking based on appearance models learning. Journal of Computer Research and Development, 2015, 52(1): 177–190 https://doi.org/10.1360/crad20070125
32
L Cehovin, A Leonardis, M Kristan. Visual object tracking performance measures revisited. IEEE Transactions on Image Processing, 2016, 25(3): 1261–1274 https://doi.org/10.1109/TIP.2016.2520370
33
Y Wu, J Lim, M H Yang. Online object tracking: a benchmark. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2013, 2411–2418 https://doi.org/10.1109/CVPR.2013.312
34
B Ni, F He, Y Pan, Z Yuan. Using shapes correlation for active contour segmentation of uterine fibroid ultrasound images in computeraided therapy. AppliedMathematics-A Journal of Chinese Universities, 2016, 31(1): 37–52 https://doi.org/10.1007/s11766-016-3340-0
35
X Yan, F He, N Hou, H Ai. An efficient particle swarm optimization for large scale hardware/software co-design system. International Journal of Cooperative Information Systems, 2018, 27(1): 1741001 https://doi.org/10.1142/S0218843017410015
36
Q Yu, T B Dinh, G Medioni. Online tracking and reacquisition using co-trained generative and discriminative trackers. In: Proceedings of European Conference on Computer Vision. 2008, 678–691 https://doi.org/10.1007/978-3-540-88688-4_50
37
D Zhang, F He, S Han, X Li. Quantitative optimization of interoperability during feature-based data exchange. Integrated Computer-Aided Engineering, 2016, 23(1): 31–51 https://doi.org/10.3233/ICA-150499
38
J Kwon, K M Lee. Visual tracking decomposition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2010, 1269–1276 https://doi.org/10.1109/CVPR.2010.5539821
39
D A Ross, J Lim, R S Lin, M H Yang. Incremental learning for robust visual tracking. International Journal of Computer Vision, 2008, 77(1): 125–141 https://doi.org/10.1007/s11263-007-0075-7
40
P N Belhumeur, D J Kriegman. What is the set of images of an object under all possible illumination conditions? International Journal of Computer Vision, 1998, 28(3): 245–260 https://doi.org/10.1023/A:1008005721484
41
X Mei, H Ling. Robust visual tracking using L1 minimization. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 2009, 1436–1443
42
C Bao, Y Wu, H Ling, H Ji. Real time robust L1 tracker using accelerated proximal gradient approach. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2012, 1830–1837
43
X Jia, H Lu, M H Yang. Visual tracking via adaptive structural local sparse appearance model. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2012, 1822–1829
44
W Zhong, H Lu, M H Yang. Robust object tracking via sparsity-based collaborative model. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2012, 1838–1845 https://doi.org/10.1109/CVPR.2012.6247882
45
D Wang, H Lu, M H Yang. Online object tracking with sparse prototypes. IEEE Transactions on Image Processing, 2013, 22(1): 314–325 https://doi.org/10.1109/TIP.2012.2202677
46
N Wang, J Wang, D Y Yeung. Online robust non-negative dictionary learning for visual tracking. In: Proceedings of the IEEE International Conference on Computer Vision. 2013, 657–664 https://doi.org/10.1109/ICCV.2013.87
47
S Zhang, H Yao, X Sun, X Lu. Sparse coding based visual tracking: review and experimental comparison. Pattern Recognition, 2013, 46(7): 1772–1788 https://doi.org/10.1016/j.patcog.2012.10.006
48
B Babenko, M H Yang, S Belongie. Visual tracking with online multiple instance learning. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2009, 983–990 https://doi.org/10.1109/CVPR.2009.5206737
49
N Wang, J Shi, D Y Yeung, J Jia. Understanding and diagnosing visual tracking systems. In: Proceedings of the IEEE International Conference on Computer Vision. 2015, 3101–3109 https://doi.org/10.1109/ICCV.2015.355
50
S Hare, S Golodetz, A Saffari, V Vineet, M M Cheng, S L Hicks, P H Torr. Struck: structured output tracking with kernels. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2016, 38(10): 2096–2109 https://doi.org/10.1109/TPAMI.2015.2509974
Z Kalal, J Matas, K Mikolajczyk. PN learning: bootstrapping binary classifiers by structural constraints. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2010, 49–56
53
Z Kalal, K Mikolajczyk, J Matas. Tracking-learning-detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2012, 34(7): 1409–1422 https://doi.org/10.1109/TPAMI.2011.239
54
H Grabner, M Grabner, H Bischof. Realtime tracking via on-line boosting. In: Proceedings of British Machine Vision Conference. 2006, 47–56
55
M S Arulampalam, S Maskell, N Gordon, T Clapp. A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking. IEEE Transactions on Signal Processing, 2002, 50(2): 174–188 https://doi.org/10.1109/78.978374
56
K Li, F He, H P Ye, X Chen. A correlative classiffiers approach based on particle filter and sample set for tracking occluded target. Applied Mathematics-A Journal of Chinese Universities, 2017, 32(3): 294–312 https://doi.org/10.1007/s11766-017-3466-8
57
A Levey, M Lindenbaum. Sequential Karhunen-Loeve basis extraction and its application to images. IEEE Transactions on Image Processing, 2000, 9(8): 1371–1374 https://doi.org/10.1109/83.855432
58
D Wang, H C Lu, M H Yang. Least soft-thresold squares tracking. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2013, 2371–2378
59
D Wang, H Lu. Visual tracking via probability continuous outlier model. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2014, 3478–3485 https://doi.org/10.1109/CVPR.2014.445
60
X Jia, H Lu, M H Yang. Visual tracking via adaptive structural local sparse appearance model. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2012, 1822–1829
61
T B Dinh, N Vo, G Medioni. Context tracker: exploring supporters and distracters in unconstrained environments. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2011, 1177–1184 https://doi.org/10.1109/CVPR.2011.5995733
62
P Viola, M Jones. Rapid object detection using a boosted cascade of simple features. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2001, 511–518 https://doi.org/10.1109/CVPR.2001.990517
63
Y Zhou, F He, Y Qiu. Optimization of parallel iterated local search algorithms on graphics processing unit. The Journal of Supercomputing, 2016, 72(6): 2394–2416 https://doi.org/10.1007/s11227-016-1738-3
64
Y Zhou, F He, Y Qiu. Dynamic strategy based parallel ant colony optimization on GPUs for TSPs. Science China Information Sciences, 2017, 60(6): 068102 https://doi.org/10.1007/s11432-015-0594-2
65
Y Wu, F He, D Zhang, X Li. Service-oriented feature-based data exchange for cloud-based design and manufacturing. IEEE Transactions on Services Computing, 2015, 11(2): 341–353 https://doi.org/10.1109/TSC.2015.2501981
66
Y Zhou, F He, N Hou. Parallel ant colony optimization on multi-core simdcpus. Future Generation Computer Systems, 2018, 79(2): 473–487 https://doi.org/10.1016/j.future.2017.09.073
67
X Yan, F He, Y Chen. A novel hardware/software partitioning method based on position disturbed particle swarm optimization with invasive weed optimization. Journal of Computer Science and Technology, 2017, 32(2): 340–355 https://doi.org/10.1007/s11390-017-1714-2
68
X Lv, F He, W Cai. Supporting selective undo of string-wise operations for collaborative editing systems. Future Generation Computer Systems, 2018, 82: 41–62 https://doi.org/10.1016/j.future.2017.11.046
69
X Lv, F He, W Cai, Y Cheng. A string-wise CRDT algorithm for smart and large-scale collaborative editing systems. Advanced Engineering Informatics, 2017, 33: 397–409 https://doi.org/10.1016/j.aei.2016.10.005
70
H Zhu, Y Nie, T Yue, X Cao. The role of prior in image based 3D modeling: a survey. Frontiers of Computer Science, 2017, 11(2): 175–191 https://doi.org/10.1007/s11704-016-5520-8