OS-assisted task preemption for Hadoop

Pastorelli, Mario; Dell'Amico, Matteo; Michiardi, Pietro
DCPERF 2014, 4th International Workshop on Data Center Performance, June 30-July 3rd, 2014, Madrid, Spain / Also published on ArXiv

This work introduces a new task preemption primitive for Hadoop, that allows tasks to be suspended and resumed exploiting existing memory management mechanisms readily
available in modern operating systems. Our technique fills the gap that exists between the two extremes cases of killing tasks (which waste work) or waiting for their completion (which introduces latency): experimental results indicate superior performance and very small overheads when compared to existing alternatives.

DOI
Type:
Conférence
City:
Madrid
Date:
2014-02-10
Department:
Data Science
Eurecom Ref:
4223
Copyright:
© 2014 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.

PERMALINK : https://www.eurecom.fr/publication/4223