Title
Heterogeneity and dynamicity of clouds at scale: Google trace analysis
Abstract
To better understand the challenges in developing effective cloud-based resource schedulers, we analyze the first publicly available trace data from a sizable multi-purpose cluster. The most notable workload characteristic is heterogeneity: in resource types (e.g., cores:RAM per machine) and their usage (e.g., duration and resources needed). Such heterogeneity reduces the effectiveness of traditional slot- and core-based scheduling. Furthermore, some tasks are constrained as to the kind of machine types they can use, increasing the complexity of resource assignment and complicating task migration. The workload is also highly dynamic, varying over time and most workload features, and is driven by many short jobs that demand quick scheduling decisions. While few simplifying assumptions apply, we find that many longer-running jobs have relatively stable resource utilizations, which can help adaptive resource schedulers.
Year
DOI
Venue
2012
10.1145/2391229.2391236
SoCC
Keywords
Field
DocType
core-based scheduling,effective cloud-based resource schedulers,google trace analysis,resource assignment,workload feature,machine type,resource type,notable workload characteristic,adaptive resource schedulers,quick scheduling decision,stable resource utilization,serializability,consistency
Serializability,Workload,Computer science,Trace analysis,Scheduling (computing),Resource assignment,Real-time computing,Cloud computing,Distributed computing
Conference
Citations 
PageRank 
References 
349
10.70
18
Authors
5
Search Limit
100349
Name
Order
Citations
PageRank
Charles Reiss136913.25
Alexey Tumanov255424.61
Gregory R. Ganger34560383.16
Randy H. Katz4168193018.89
Michael A. Kozuch5178282.65