16.0LGMar 23, 2023
TinyML: Tools, Applications, Challenges, and Future Research DirectionsRakhee Kallimani, Krishna Pai, Prasoon Raghuwanshi et al.
In recent years, Artificial Intelligence (AI) and Machine learning (ML) have gained significant interest from both, industry and academia. Notably, conventional ML techniques require enormous amounts of power to meet the desired accuracy, which has limited their use mainly to high-capability devices such as network nodes. However, with many advancements in technologies such as the Internet of Things (IoT) and edge computing, it is desirable to incorporate ML techniques into resource-constrained embedded devices for distributed and ubiquitous intelligence. This has motivated the emergence of the TinyML paradigm which is an embedded ML technique that enables ML applications on multiple cheap, resource- and power-constrained devices. However, during this transition towards appropriate implementation of the TinyML technology, multiple challenges such as processing capacity optimization, improved reliability, and maintenance of learning models' accuracy require timely solutions. In this article, various avenues available for TinyML implementation are reviewed. Firstly, a background of TinyML is provided, followed by detailed discussions on various tools supporting TinyML. Then, state-of-art applications of TinyML using advanced technologies are detailed. Lastly, various research challenges and future directions are identified.
6.6SYMay 8
Goal-Oriented Sensor Reporting Scheduling for Non-linear Dynamic System MonitoringPrasoon Raghuwanshi, Onel Luis Alcaraz López, I-Hong Hou et al.
Goal-oriented communication (GoC) is a form of semantic communication where the effectiveness of information transmission is measured by its impact on achieving the desired goal. In Internet-of-Things (IoT) networks, GoC can enable sensors to selectively transmit data relevant to intended goals of the receiver, thereby facilitating timely decision-making, reducing network congestion, and enhancing spectral efficiency. In this paper, we consider an IoT scenario where an edge node polls sensors monitoring the state of a non-linear dynamic system (NLDS) to respond to the queries of several clients. This work delves into the foregoing GoC problem and solution, which we termed goal-oriented scheduling (GoS). The latter utilizes deep reinforcement learning (DRL) with meticulously devised action space, state space, and reward function. A long short-term memory network is used to estimate the inter-query duration and the corresponding estimation standard deviation. This empowers the proposed DRL scheduler to make judicious decisions, even when no queries are posed, which would later lead to the minimization of the mean square error (MSE) of the query responses. Numerical analysis demonstrates that the proposed GoS obtains a smaller MSE compared to the benchmark scheduling methods while being of lower complexity. Moreover, this is attained without polling sensors during 77%-88% of the testing phase, thus, resulting beneficial in terms of energy efficiency.
3.2OCJul 23, 2024
Neural Network-Based Bandit: A Medium Access Control for the IIoT Alarm ScenarioPrasoon Raghuwanshi, Onel Luis Alcaraz López, Neelesh B. Mehta et al.
Efficient Random Access (RA) is critical for enabling reliable communication in Industrial Internet of Things (IIoT) networks. Herein, we propose a deep reinforcement learning based distributed RA scheme, entitled Neural Network-Based Bandit (NNBB), for the IIoT alarm scenario. In such a scenario, the devices may detect a common critical event, and the goal is to ensure the alarm information is delivered successfully from at least one device. The proposed NNBB scheme is implemented at each device, where it trains itself online and establishes implicit inter-device coordination to achieve the common goal. Devices can transmit simultaneously on multiple orthogonal channels and each possible transmission pattern constitutes a possible action for the NNBB, which uses a deep neural network to determine the action. Our simulation results show that as the number of devices in the network increases, so does the performance gain of the NNBB compared to the Multi-Armed Bandit (MAB) RA benchmark. For instance, NNBB experiences a 7% success rate drop when there are four channels and the number of devices increases from 10 to 60, while MAB faces a 25% drop.
7.0SYJun 29
TinyML for On-Device and Edge Analytics in Wireless Networks: A Survey of Deployments, Opportunities, and Concept-Drift MitigationPrasoon Raghuwanshi, Vimal Bhatia, Sridhar Iyer et al.
Ubiquitous intelligence is essential for enabling real-time, adaptive, autonomous, and scalable operations in the next generation of wireless networks. However, this poses significant challenges in data management and energy consumption on the end-device/edge side, specially under dynamic environmental conditions. This has driven the adoption of tiny machine learning (tinyML), which offers data-driven optimization at the end-device/edge side. In this work, we survey and thoroughly discuss various tapped/untapped deployment possibilities of tinyML in wireless networks. We identify existing frameworks, accustomed to design tinyML algorithms, that could be utilized to solve a range of wireless network problems. We present a federated learning-based tinyML model update procedure, for both battery-powered and batteryless end-devices, to resolve the concept drift problem faced by tinyML models. Furthermore, we discuss the update-aware checkpointing, fault-tolerant bootloader, and intermittent-aware modify operation, which could support federated learning-based tinyML model update in the case of batteryless end-devices. Overall, this paper spells out several areas where end-device/edge intelligence can be utilized in the next generation of wireless systems, as well as ways to mitigate the concept drift problem faced in the case of end-device intelligence.