On using deep reinforcement learning for multi-domain SFC placement

Toumi, Nassima; Bagaa, Miloud; Ksentini, Adlen
GLOBECOM 2021, IEEE Global Communications Conference, 7-11 December 2021, Madrid, Spain

Service Function Chaining (SFC) has emerged as a promising technology for 5G and beyond. It leverages Network Function Virtualization (NFV) and Software Defined Networking (SDN) and allows the decomposition of a given service into a set of blocks that successively process data. The SFC placement issue has been extensively studied in the literature, and different solutions have been proposed using mathematical models and
heuristics. More recently, Reinforcement Learning (RL) has emerged as a tool for decision-making that allows agents to elaborate policies based on the environment’s feedback. In this paper, we study the benefits of using Deep Reinforcement Learning
methods for the multi-domain SFC placement problem. We propose a Deep Deterministic Policy Gradient (DDPG) approach, where Linear Physical Programming is employed to generate rewards that reflect the solution’s quality in terms of cost and latency. Through our experiments, we are able to demonstrate the efficiency of our approach with results that satisfy the SLA requirements.

DOI
Type:
Conference
City:
Madrid
Date:
2021-12-07
Department:
Communication systems
Eurecom Ref:
6674
Copyright:
© 2021 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.

PERMALINK : https://www.eurecom.fr/publication/6674