A Caltech Library Service

Speculation-Aware Resource Allocation for Cluster Schedulers


Ren, Xiaoqi (2015) Speculation-Aware Resource Allocation for Cluster Schedulers. Master's thesis, California Institute of Technology. doi:10.7907/Z9R49NRJ.


Real-time demand response is essential for handling the uncertainties of renewable generation. Traditionally, demand response has been focused on large industrial and commercial loads, however it is expected that a large number of small residential loads such as air conditioners, dish washers, and electric vehicles will also participate in the coming years. The electricity consumption of these smaller loads, which we call deferrable loads, can be shifted over time, and thus be used (in aggregate) to compensate for the random fluctuations in renewable generation.

In this thesis, we propose a real-time distributed deferrable load control algorithm to reduce the variance of aggregate load (load minus renewable generation) by shifting the power consumption of deferrable loads to periods with high renewable generation. The algorithm is model predictive in nature, i.e., at every time step, the algorithm minimizes the expected variance to go with updated predictions. We prove that suboptimality of this model predictive algorithm vanishes as time horizon expands in the average case analysis. Further, we prove strong concentration results on the distribution of the load variance obtained by model predictive deferrable load control. These concentration results highlight that the typical performance of model predictive deferrable load control is tightly concentrated around the average-case performance. Finally, we evaluate the algorithm via trace-based simulations.

Item Type:Thesis (Master's thesis)
Subject Keywords:data cluster; job scheduling
Degree Grantor:California Institute of Technology
Division:Engineering and Applied Science
Major Option:Computer Science
Thesis Availability:Public (worldwide access)
Research Advisor(s):
  • Wierman, Adam C.
Thesis Committee:
  • Wierman, Adam C. (chair)
Defense Date:2014
Record Number:CaltechTHESIS:09252014-063715278
Persistent URL:
Ren, Xiaoqi0000-0002-1121-9046
Default Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:8664
Deposited By: Xiaoqi Ren
Deposited On:30 Sep 2014 17:27
Last Modified:09 Jul 2020 23:53

Thesis Files

PDF - Final Version
See Usage Policy.


Repository Staff Only: item control page