|
|
Task assignment for social-oriented crowdsourcing |
Gang WU1,2( ), Zhiyong CHEN1, Jia LIU1, Donghong HAN1, Baiyou QIAO1 |
1. School of Computer Science and Engineering, Northeastern University, Shenyang 110004, China 2. State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing 210023, China |
|
|
Abstract Crowdsourcing has become an efficient measure to solve machine-hard problems by embracing group wisdom, in which tasks are disseminated and assigned to a group of workers in the way of open competition. The social relationships formed during this process may in turn contribute to the completion of future tasks. In this sense, it is necessary to take social factors into consideration in the research of crowdsourcing. However, there is little work on the interactions between social relationships and crowdsourcing currently. In this paper, we propose to study such interactions in those social-oriented crowdsourcing systems from the perspective of task assignment. A prototype system is built to help users publish, assign, accept, and accomplish location-based crowdsourcing tasks as well as promoting the development and utilization of social relationships during the crowdsourcing. Especially, in order to exploit the potential relationships between crowdsourcing workers and tasks, we propose a “worker-task” accuracy estimation algorithm based on a graph model that joints the factorized matrixes of both the user social networks and the history “worker-task” matrix. With the worker-task accuracy estimation matrix, a group of optimal worker candidates is efficiently chosen for a task, and a greedy task assignment algorithm is proposed to further the matching of worker-task pairs among multiple crowdsourcing tasks so as to maximize the overall accuracy. Compared with the similarity based task assignment algorithm, experimental results show that the average recommendation success rate increased by 3.67%; the average task completion rate increased by 6.17%; the number of new friends added per week increased from 7.4 to 10.5; and the average task acceptance time decreased by 8.5 seconds.
|
Keywords
crowdsourcing
social networks
task assignment
|
Corresponding Author(s):
Gang WU
|
Just Accepted Date: 24 October 2019
Issue Date: 01 December 2020
|
|
1 |
J Howe. The rise of crowdsourcing. Wired Magazine, 2006, 14(6): 1–4
|
2 |
E Law, L v Ahn. Human computation. Synthesis Lectures on Artificial Intelligence and Machine Learning, 2011, 5(3): 1–121
https://doi.org/10.2200/S00371ED1V01Y201107AIM013
|
3 |
D C Brabham. Crowdsourcing as a model for problem solving: an introduction and cases. Convergence, 2008, 14(1): 75–90
https://doi.org/10.1177/1354856507084420
|
4 |
P Stone, R Brooks, E Brynjolfsson, R Calo, O Etzioni, G Hager, J Hirschberg, S Kalyanakrishnan, E Kamar, S Kraus, K Leyton-Brown, D Parkes, W Press, A Saxenian, J Shah, M Tambe, A Teller. Artificial intelligence and life in 2030. Technical Report, One Hundred Year Study on Artificial Intelligence: Report of the 2015-2016 Study Panel, Stanford University, Stanford, CA, 2016
|
5 |
K J Boudreau, K R Lakhani. Using the crowd as an innovation partner. Harvard Business Review, 2013, 91(4): 60–68
|
6 |
I King, M R Lyu, H Ma. Introduction to social recommendation. In: Proceedings of the 19th International Conference on World WideWeb. 2010, 1355–1356
https://doi.org/10.1145/1772690.1772927
|
7 |
J L Tang, X Hu, H Liu. Social recommendation: a review. Social Network Analysis and Mining, 2013, 3(4): 1113–1133
https://doi.org/10.1007/s13278-013-0141-9
|
8 |
O Bandiera, I Barankay, I Rasul. Social incentives in the workplace. The Review of Economic Studies, 2010, 77(2): 417–458
https://doi.org/10.1111/j.1467-937X.2009.00574.x
|
9 |
R Salakhutdinov, A Mnih. Probabilistic matrix factorization. In: Proceedings of the 20th International Conference on Neural Information Processing Systems. 2007, 1257–1264
|
10 |
V Ambati, S Vogel, J Carbonell. Towards task recommendation in microtask markets. In: Proceedings of the 11th AAAI Conference on Human Computation. 2011, 80–83
|
11 |
M C Yuen, I King, K S Leung. Taskrec: probabilistic matrix factorization in task recommendation in crowdsourcing systems. In: Proceedings of the 19th International Conference on Neural Information Processing. 2012, 516–525
https://doi.org/10.1007/978-3-642-34481-7_63
|
12 |
J Fan, G L Li, B C Ooi, K l Tan, J H Feng. icrowd: an adaptive crowdsourcing framework. In: Proceedings of the ACM International Conference on Management of Data. 2015, 1015–1030
https://doi.org/10.1145/2723372.2750550
|
13 |
C J Ho, J W Vaughan. Online task assignment in crowdsourcing markets. In: Proceedings of the 26th AAAI Conference on Artificial Intelligence. 2012, 45–51
|
14 |
Y D Zheng, J N Wang, G L Li, R Cheng, J H Feng. QASCA: a qualityaware task assignment system for crowdsourcing applications. In: Proceedings of the ACM International Conference on Management of Data. 2015, 1031–1046
https://doi.org/10.1145/2723372.2749430
|
15 |
L Wang, Z W Yu, Q Han, B Guo, H Y Xiong. Multi-objective optimization based allocation of heterogeneous spatial crowdsourcing tasks. IEEE Transactions on Mobile Computing, 2018, 17(7): 1637–1650
https://doi.org/10.1109/TMC.2017.2771259
|
16 |
S R B Gummidi, X K Xie, T B Pedersen. A survey of spatial crowdsourcing. ACM Transactions on Database Systems, 2019, 44(2): 1–46
https://doi.org/10.1145/3291933
|
17 |
Y X Tong, Y Yuan, Y R Cheng, L Chen, G R Wang. Survey on spatiotemporal crowdsourced data management techniques. Journal of Software, 2017, 28(1): 35–58 (in Chinese)
|
18 |
Y X Tong, J Y She, B Ding, L B Wang, L Chen. Online mobile micro-task allocation in spatial crowdsourcing. In: Proceedings of the 32nd IEEE International Conference on Data Engineering. 2016, 49–60
https://doi.org/10.1109/ICDE.2016.7498228
|
19 |
Y X Tong, J Y She, B L Ding, L Chen, T Y Wo, K Xu. Online minimum matching in real-time spatial data: experiments and analysis. Proceedings of the VLDB Endowment, 2016, 9(12): 1053–1064
https://doi.org/10.14778/2994509.2994523
|
20 |
Y X Tong, J Y She, R Meng. Bottleneck-aware arrangement over eventbased social networks: the max-min approach. World Wide Web, 2016, 19(6): 1151–1177
https://doi.org/10.1007/s11280-015-0377-6
|
21 |
Y X Tong, C C Cao, L Chen. TCS: efficient topic discovery over crowdoriented service data. In: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2014, 861–870
https://doi.org/10.1145/2623330.2623647
|
22 |
T S Song, Y X Tong, L B Wang, J Y She, B Yao, L Chen, K Xu. Trichromatic online matching in real-time spatial crowdsourcing. In: Proceedings of the 33rd IEEE International Conference on Data Engineering. 2017, 1009–1020
https://doi.org/10.1109/ICDE.2017.147
|
23 |
D X Deng, C Shahabi, U Demiryurek. Maximizing the number of worker’s self-selected tasks in spatial crowdsourcing. In: Proceedings of the 21st ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems. 2013, 324–333
https://doi.org/10.1145/2525314.2525370
|
24 |
J H Feng, G L Li, J H Feng. A survey on crowdsourcing. Chinese Journal of Computers, 2015, 38(9): 1713–1726 (in Chinese)
|
25 |
H Ma, H X Yang, M R Lyu, I King. Sorec: social recommendation using probabilistic matrix factorization. In: Proceedings of the 17th ACM Conference on Information and Knowledge Management. 2008, 931–940
https://doi.org/10.1145/1458082.1458205
|
26 |
M Jamali, M Ester. A matrix factorization technique with trust propagation for recommendation in social networks. In: Proceedings of the 4th ACM Conference on Recommender Systems. 2010, 135–142
https://doi.org/10.1145/1864708.1864736
|
27 |
W Y Wang, Z P He, P Shi, W W Wu, Y C Jiang, B An, Z F Hao, B Chen. Strategic social team crowdsourcing: forming a team of truthful workers for crowdsourcing in social networks. IEEE Transactions on Mobile Computing, 2019, 18(6): 1419–1432
https://doi.org/10.1109/TMC.2018.2860978
|
28 |
X Cao, G Cong, C S Jensen, J J Ng, B C Ooi, N T Phan, D Wu. Swors: a system for the efficient retrieval of relevant spatial Web objects. Proceedings of the VLDB Endowment, 2012, 5(12): 1914–1917
https://doi.org/10.14778/2367502.2367536
|
29 |
A Barabasi, R Albert. Emergence of scaling in random networks. Science, 1999, 286(5439): 509–512
https://doi.org/10.1126/science.286.5439.509
|
|
Viewed |
|
|
|
Full text
|
|
|
|
|
Abstract
|
|
|
|
|
Cited |
|
|
|
|
|
Shared |
|
|
|
|
|
Discussed |
|
|
|
|