Graduate School and Research Center in Digital Sciences

A system design for elastically scaling transaction processing engines in virtualized servers

Anadiotis, Angelos-Christos; Appuswamy, Raja; Ailamakiy, Anastasia; Bronshtein, Ilan; Avni, Hillel; Dominguez-Sal, David; Goikhman, Shay; Levy, Eliezer

VLDB 2020, 46th International Conference on Very Large Data Bases, 31 August-4 September 2020, Tokyo, Japan (Virtual Conference) / To be published in Proceedings of the VLDB Endowment, Volume 13, N°12, August 2020

Online Transaction Processing (OLTP) deployments are migrating from on-premise to cloud settings in order to exploit the elasticity of cloud infrastructure which allows them to adapt to workload variations. However, cloud adaptation comes at the cost of redesigning the engine, which has led to the introduction of several, new, cloud-based transaction processing systems mainly focusing on: (i) the transaction coordination protocol, (ii) the data partitioning strategy, and, (iii) the resource isolation across multiple tenants. As a result, standalone OLTP engines cannot be easily deployed with an elastic setting in the cloud and they need to migrate to another, specialized deployment. In this paper, we focus on workload variations that can be addressed by modern multi-socket, multi-core servers and we present a system design for providing ne-grained elasticity to multi-tenant, scale-up OLTP deployments. We introduce novel components to the virtualization software stack hat enable on-demand addition and removal of computing and memory resources. We provide a bi-directional, lowoverhead communication stack between the virtual machine and the hypervisor, which allows the former to adapt to variations coming both from the workload and the resource availability. We show that our system achieves NUMAaware, millisecond-level, stateful and ne-grained elasticity, while it is not intrusive to the design of state-of-the-art, inmemory OLTP engines. We evaluate our system through novel use cases demonstrating that scale-up elasticity increases resource utilization, while allowing tenants to pay for actual use of resources and not just their reservation. 

Document Bibtex

Title:A system design for elastically scaling transaction processing engines in virtualized servers
Type:Conference
Language:English
City:
Date:
Department:Data Science
Eurecom ref:6326
Copyright: VLDB
Bibtex: @inproceedings{EURECOM+6326, year = {2020}, title = {{A} system design for elastically scaling transaction processing engines in virtualized servers}, author = {{A}nadiotis, {A}ngelos-{C}hristos and {A}ppuswamy, {R}aja and {A}ilamakiy, {A}nastasia and {B}ronshtein, {I}lan and {A}vni, {H}illel and {D}ominguez-{S}al, {D}avid and {G}oikhman, {S}hay and {L}evy, {E}liezer}, booktitle = {{VLDB} 2020, 46th {I}nternational {C}onference on {V}ery {L}arge {D}ata {B}ases, 31 {A}ugust-4 {S}eptember 2020, {T}okyo, {J}apan ({V}irtual {C}onference) / {T}o be published in {P}roceedings of the {VLDB} {E}ndowment, {V}olume 13, {N}°12, {A}ugust 2020}, address = {}, month = {08}, url = {http://www.eurecom.fr/publication/6326} }
See also: