NIApr 13
Network Slice Embedding over Space Division Multiplexed Elastic Optical NetworksDivya Khanure, Riti Gour, Congzhou Li et al.
Network slicing over space division multiplexed elastic optical networks (SDM EONs) enables efficient multiservice provisioning on a shared optical substrate. However, embedding such slices requires coordinated spectrum and compute resource management under dynamic traffic, which most existing RMCSA studies treat independently. This paper focuses on the network slice embedding problem over space division multiplexed elastic optical networks (SDM EONs), aiming to develop efficient resource allocation strategies that ensure both high utilization and reliable service performance. While prior studies have investigated routing, modulation format, core, and spectrum allocation (RMCSA), they typically consider these dimensions separately from compute placement. To address this gap, this paper proposes a Waypoint Assisted Multi Segment Slice Mapping (WMSM) scheme, which integrates compute placement with spectrum allocation in a sequential but coupled manner to enable more flexible resource placement and improved spectrum efficiency. Numerical results show that WMSM improves acceptance ratios by up to 27% under high load conditions, while achieving up to 47% lower total provisioning cost relative to the baseline strategy. These results highlight the benefits of integrated compute spectrum provisioning and provide design insights for scalable, compute aware optical slice mapping.
LGFeb 18, 2020
ResiliNet: Failure-Resilient Inference in Distributed Neural NetworksAshkan Yousefpour, Brian Q. Nguyen, Siddartha Devic et al.
Federated Learning aims to train distributed deep models without sharing the raw data with the centralized server. Similarly, in distributed inference of neural networks, by partitioning the network and distributing it across several physical nodes, activations and gradients are exchanged between physical nodes, rather than raw data. Nevertheless, when a neural network is partitioned and distributed among physical nodes, failure of physical nodes causes the failure of the neural units that are placed on those nodes, which results in a significant performance drop. Current approaches focus on resiliency of training in distributed neural networks. However, resiliency of inference in distributed neural networks is less explored. We introduce ResiliNet, a scheme for making inference in distributed neural networks resilient to physical node failures. ResiliNet combines two concepts to provide resiliency: skip hyperconnection, a concept for skipping nodes in distributed neural networks similar to skip connection in resnets, and a novel technique called failout, which is introduced in this paper. Failout simulates physical node failure conditions during training using dropout, and is specifically designed to improve the resiliency of distributed neural networks. The results of the experiments and ablation studies using three datasets confirm the ability of ResiliNet to provide inference resiliency for distributed neural networks.
NISep 3, 2019
Guardians of the Deep Fog: Failure-Resilient DNN Inference from Edge to CloudAshkan Yousefpour, Siddartha Devic, Brian Q. Nguyen et al.
Partitioning and distributing deep neural networks (DNNs) over physical nodes such as edge, fog, or cloud nodes, could enhance sensor fusion, and reduce bandwidth and inference latency. However, when a DNN is distributed over physical nodes, failure of the physical nodes causes the failure of the DNN units that are placed on these nodes. The performance of the inference task will be unpredictable, and most likely, poor, if the distributed DNN is not specifically designed and properly trained for failures. Motivated by this, we introduce deepFogGuard, a DNN architecture augmentation scheme for making the distributed DNN inference task failure-resilient. To articulate deepFogGuard, we introduce the elements and a model for the resiliency of distributed DNN inference. Inspired by the concept of residual connections in DNNs, we introduce skip hyperconnections in distributed DNNs, which are the basis of deepFogGuard's design to provide resiliency. Next, our extensive experiments using two existing datasets for the sensing and vision applications confirm the ability of deepFogGuard to provide resiliency for distributed DNNs in edge-cloud networks.