Please wait a minute...
Shopping Cart Email List Chinese
Advanced Search Fig/Tab
Frontiers of Computer Science

ISSN 2095-2228

ISSN 2095-2236(Online)

CN 10-1014/TP

Postal Subscription Code 80-970

2018 Impact Factor: 1.129

Featured Articles  |  Most Downloaded  |  Most Reading
Online Submission Subscribe to Our RSS Content Feed
Front. Comput. Sci.    2019, Vol. 13 Issue (3) : 489-499    https://doi.org/10.1007/s11704-018-6614-2
RESEARCH ARTICLE
A novel index system describing program runtime characteristics for workload consolidation
Lin WANG1,2, Depei QIAN2,3, Rui WANG2(), Zhongzhi LUAN2, Hailong YANG2, Huaxiang ZHANG1,4
1. School of Information Science and Engineering, Shandong Normal University, Jinan 250014, China
2. School of Computer Science and Engineering, Beihang University, Beijing 100191, China
3. School of Data and Computer Science, Sun Yat-sen University, Guangzhou 510275, China
4. Institute of Data Science and Technology, Shandong Normal University, Jinan 250014, China
 Download: PDF(778 KB)  
 Export: BibTeX | EndNote | Reference Manager | ProCite | RefWorks
Abstract

Workload consolidation is a common method to improve the resource utilization in clusters or data centers. In order to achieve efficient workload consolidation, the runtime characteristics of a program should be taken into consideration in scheduling. In this paper, we propose a novel index system for efficiently describing the program runtime characteristics. With the help of this index system, programs can be classified by the following runtime characteristics: 1) dependence to multi-dimensional resources including CPU, disk I/O, memory and network I/O; and 2) impact and vulnerability to resource sharing embodied by resource usage and resource sensitivity. In order to verify the effectiveness of this novel index system in workload consolidation, a scheduling strategy, Sche-index, using the new index system for workload consolidation is proposed. Experiment results show that compared with traditional least-loaded scheduling strategy, Sche-index can improve both program performance and system resource utilization significantly.
Keywords index system      runtime characteristics      workload consolidation      cluster scheduling     
Corresponding Author(s): Rui WANG   
Just Accepted Date: 27 December 2017   Online First Date: 15 November 2018    Issue Date: 24 April 2019
 Cite this article:   
Lin WANG,Depei QIAN,Rui WANG, et al. A novel index system describing program runtime characteristics for workload consolidation[J]. Front. Comput. Sci., 2019, 13(3): 489-499.
 URL:  
https://academic.hep.com.cn/fcs/EN/10.1007/s11704-018-6614-2
https://academic.hep.com.cn/fcs/EN/Y2019/V13/I3/489
1 DGmach, JRolia, LCherkasova. Resource and virtualization costs up in the cloud: models and design choices. In: Proceedings of the 41st IEEE/IFIP International Conference on Dependable Systems & Networks. 2011, 395–402
https://doi.org/10.1109/DSN.2011.5958252
2 R WAhmad, AGani, S H AHamid, M Shiraz, AYousafzai, FXia. A survey on virtual machine migration and server consolidation frameworks for cloud data centers. Journal of Network and Computer Applications, 2015, 52: 11–25
https://doi.org/10.1016/j.jnca.2015.02.002
3 XLi, RWang, ZLuan, Y Liu, DQian. Coordinating workload balancing and power switching in renewable energy powered data center. Frontiers of Computer Science, 2016, 10(3): 574–587
https://doi.org/10.1007/s11704-015-5018-9
4 MStansberry, J Kudritzki. Uptime institute 2012 data center industry survey. Uptime Institute, 2012
5 SZhuravlev, S Blagodurov, AFedorova. Addressing shared resource contention in multicore processors via scheduling. In: Proceedings of the 15th International Conference on Architectural Support for Programming Languages and Operating Systems. 2010, 129–141
https://doi.org/10.1145/1736020.1736036
6 MMoreto, F J Cazorla, ARamirez, RSakellariou, MValero. FlexDCP: a QoS framework for CMP architectures. ACM SIGOPS Operating Systems Review, 2009, 43(2): 86–96
https://doi.org/10.1145/1531793.1531806
7 TDwyer, A Fedorova, SBlagodurov, MRoth, FGaud, JPei. A practical method for estimating performance degradation on multicore processors, and its application to HPC workloads. In: Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis. 2012, 83–94
https://doi.org/10.1109/SC.2012.11
8 SPacheco-Sanchez, G Casale, BScotney, SMcClean, GParr, SDawson. Markovian workload characterization for QoS prediction in the cloud. In: Proceedings of the IEEE International Conference on Cloud Computing. 2011, 147–154
https://doi.org/10.1109/CLOUD.2011.100
9 SBlagodurov, DGmach, MArlitt, Y Chen, CHyser, AFedorova. Maximizing server utilization while meeting critical SLAs via weight-based collocation management. In: Proceedings of the 2013 IFIP/IEEE International Symposium on Integrated Network Management. 2013, 277–285
10 ABeloglazov, RBuyya. Adaptive threshold-based approach for energy-efficient consolidation of virtual machines in cloud data centers. In: Proceedings of the 8th International Workshop on Middleware for Grids, Clouds and e-Science. 2010, 1–4
https://doi.org/10.1145/1890799.1890803
11 QChen, HYang, JMars, L Tang. Baymax: QoS awareness and increased utilization for non-preemptive accelerators in warehouse scale computers. In: Proceedings of the 21st International Conference on Architectural Support for Programming Languages and Operating Systems. 2016, 681–696
https://doi.org/10.1145/2872362.2872368
12 MLiu, TLi. Optimizing virtual machine consolidation performance on NUMA server architecture for cloud workloads. In: Proceedings of the 41st International Symposium on Computer Architecture. 2014, 325–336
https://doi.org/10.1109/ISCA.2014.6853224
13 VMayer-Schönberger, KCukier. Big Data: A Revolution That will Transform How We Live, Work, and Think. Boston: Houghton Mifflin Harcourt, 2013
14 SDi, DKondo, FCappello. Characterizing cloud applications on a Google data center. In: Proceedings of the 42nd International Conference on Parallel Processing. 2013, 468–473
https://doi.org/10.1109/ICPP.2013.56
15 MSchwarzkopf, A Konwinski, MAbd-El-Malek, JWilkes. Omega: flexible, scalable schedulers for large compute clusters. In: Proceedings of the 8th ACM European Conference on Computer Systems. 2013, 351–364
https://doi.org/10.1145/2465351.2465386
16 JWang, JWen, YHan, J Zhang, CLi, ZXiong. Achieving high throughput and TCP Reno fairness in delay-based TCP over large networks. Frontiers of Computer Science, 2014, 8(3): 426–439
https://doi.org/10.1007/s11704-014-3443-9
17 J LHenning. SPEC CPU2006 benchmark descriptions. ACM SIGARCH Computer Architecture News, 2006, 34(4): 1–17
https://doi.org/10.1145/1186736.1186737
18 CBienia, SKumar, J PSingh, K Li. The PARSEC benchmark suite: characterization and architectural implications. In: Proceedings of the 17th International Conference on Parallel Architectures and Compilation Techniques. 2008, 72–81
https://doi.org/10.1145/1454115.1454128
19 MFerdman, AAdileh, OKocberber. Clearing the clouds: a study of emerging scale-out workloads on modern hardware. ACM SIGPLAN Notices, 2012, 47(4): 37–48
20 JMars, LTang. Whare-map: heterogeneity in homogeneous warehouse-scale computers. ACM SIGARCH Computer Architecture News, 2013, 41(3): 619–630
https://doi.org/10.1145/2508148.2485975
21 D HBailey, E Barszcz, J TBarton. The NAS parallel benchmarks. The International Journal of Supercomputing Applications, 1991, 5(3): 63–73
https://doi.org/10.1177/109434209100500306
22 AKopytov. SysBench manual. MySQL AB, 2012, 2–3
23 CDelimitrou, C Kozyrakis. Paragon: QoS-aware scheduling for heterogeneous datacenters. ACM SIGPLAN Notices, 2013, 48(4): 77–88
https://doi.org/10.1145/2499368.2451125
24 JMars, LTang, RHundt, K Skadron, M LSoffa. Bubble-up: increasing utilization in modern warehouse scale computers via sensible colocations. In: Proceedings of the 44th Annual IEEE/ACMInternational Symposium on Microarchitecture. 2011, 248–259
https://doi.org/10.1145/2155620.2155650
25 CDelimitrou, C Kozyrakis. Quasar: resource efficient and QoS-aware cluster management. ACM SIGPLAN Notices, 2014, 49(4): 127–144
26 CDelimitrou, D Sanchez, CKozyrakis. Tarcil: reconciling scheduling speed and quality in large shared clusters. In: Proceedings of the 6th ACM Symposium on Cloud Computing. 2015, 97–110
https://doi.org/10.1145/2806777.2806779
27 DLo, LCheng, RGovindaraju, PRanganathan, C Kozyrakis. Heracles: improving resource efficiency at scale. ACM SIGARCH Computer Architecture News, 2015, 43(3): 450–462
https://doi.org/10.1145/2872887.2749475
28 JHan, SJeon, YChoi, J Huh. Interference management for distributed parallel applications in consolidated clusters. In: Proceedings of the 21st International Conference on Architectural Support for Programming Languages and Operating Systems. 2016, 443–456
https://doi.org/10.1145/2872362.2872388
29 JMars, N Vachharajani, RHundt, M LSoffa. Contention aware execution: online contention detection and response. In: Proceedings of the 8th Annual IEEE/ACM International Symposium on Code Generation and Optimization. 2010, 257–265
https://doi.org/10.1145/1772954.1772991
30 LTang, JMars, M LSoffa. Contentiousness vs. sensitivity: improving contention aware runtime systems on multicore architectures. In: Proceedings of the 1st International Workshop on Adaptive Self-Tuning Computing Systems for the Exaflop Era. 2011, 12–21
https://doi.org/10.1145/2000417.2000419
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed