15.9ROMay 31
AI-IoT-Robotics Integration: Survey of Frameworks, Emerging Trends, and the Path Toward Connected RoboticsRanulfo Bezerra, Satoshi Tadokoro, Kazunori Ohno
The convergence of Artificial Intelligence, the Internet of Things, and Robotics is no longer a futuristic vision; it is rapidly becoming the foundation of real-time, intelligent, and context-aware systems. AI enables perception and reasoning, IoT provides scalable sensing and communication, and robotics delivers embodied actuation. Despite significant progress in pairwise combinations such as AIoT and the Internet of Robotic Things (IoRT), there remains a lack of unified design frameworks that fully integrate all three. This survey synthesizes the state-of-the-art across these domains, emphasizing the emerging role of Small Language Models (SLMs) at the edge and Large Language Models (LLMs) in the cloud for distributed cognition and autonomous decision-making. We propose a modular system architecture that aligns with these trends, analyze persistent gaps in interoperability and feedback control, and classify existing work by integration depth. Our review highlights how hybrid SLM-LLM systems, when coupled with IoT infrastructure and robotic agents, can address challenges in real-time adaptation, scalability, and reliability. This work offers a conceptual and technical roadmap for designing next-generation AI-IoT-Robotic ecosystems that are modular, interpretable, and capable of learning within dynamic environments, paving the way for the emerging paradigm of Connected Robotics and Physical AI.
CVJun 9, 2024
Region of Interest Loss for Anonymizing Learned Image CompressionChristoph Liebender, Ranulfo Bezerra, Kazunori Ohno et al.
The use of AI in public spaces continually raises concerns about privacy and the protection of sensitive data. An example is the deployment of detection and recognition methods on humans, where images are provided by surveillance cameras. This results in the acquisition of great amounts of sensitive data, since the capture and transmission of images taken by such cameras happens unaltered, for them to be received by a server on the network. However, many applications do not explicitly require the identity of a given person in a scene; An anonymized representation containing information of the person's position while preserving the context of them in the scene suffices. We show how using a customized loss function on region of interests (ROI) can achieve sufficient anonymization such that human faces become unrecognizable while persons are kept detectable, by training an end-to-end optimized autoencoder for learned image compression that utilizes the flexibility of the learned analysis and reconstruction transforms for the task of mutating parts of the compression result. This approach enables compression and anonymization in one step on the capture device, instead of transmitting sensitive, nonanonymized data over the network. Additionally, we evaluate how this anonymization impacts the average precision of pre-trained foundation models on detecting faces (MTCNN) and humans (YOLOv8) in comparison to non-ANN based methods, while considering compression rate and latency.
ROFeb 9, 2022
Inflated Bendable Eversion Cantilever Mechanism with Inner Skeleton for Increased Payload HoldingTomoya Takahashi, Masahiro Watanabe, Kenjiro Tadakuma et al.
Inflatable structures used in soft robotics applications exhibit unique characteristics. In particular, the tip-extension structure, which grows from the tip, can grow without friction against the environment. However, these inflatable structures are inferior to rigid mechanisms in terms of their load-bearing capacity. The stiffness of the tip-extension structure can be increased by pressurization, but the structure cannot maintain its curved shape and compliance. In this study, we proposed a mechanism that combines a skeleton structure consisting of multi-joint links with functions to increase rigidity while keeping low pressure and realizing the functions of bending and shape fixation. We devised a design method for rigid articulated links and combined it with a membrane structure that utilizes the advantages of the tip-extension structure. The experimental results show that the payload of the designed structure increases compared to that of the membrane-only structure. The findings of this research can be applied to long robots that can be extended in the air without drooping and to mechanisms that can wrap around the human body.
ROMar 11, 2020
Hundred Drones Land in a MinuteDaiki Fujikura, Kenjiro Tadakuma, Masahiro Watanabe et al.
Currently, drone research and development has received significant attention worldwide. Particularly, delivery services employ drones as it is a viable method to improve delivery efficiency by using a several unmanned drones. Research has been conducted to realize complete automation of drone control for such services. However, regarding the takeoff and landing port of the drones, conventional methods have focused on the landing operation of a single drone, and the continuous landing of multiple drones has not been realized. To address this issue, we propose a completely novel port system, "EAGLES Port," that allows several drones to continuously land and takeoff in a short time. Experiments verified that the landing time efficiency of the proposed port is ideally 7.5 times higher than that of conventional vertical landing systems. Moreover, the system can tolerate 270 mm of horizontal positional error, +-30 deg of angular error in the drone's approach (+-40 deg with the proposed gate mechanism), and up to 1.9 m/s of drone's approach speed. This technology significantly contributes to the scalability of drone usage. Therefore, it is critical for the development of a future drone port for the landing of automated drone swarms.
ROMar 11, 2020
Retraction Mechanism of Soft Torus Robot with a Hydrostatic SkeletonTomoya Takahashi, Masahiro Watanabe, Kenjiro Tadakuma et al.
Soft robots have attracted much attention in recent years owing to their high adaptability. Long articulated soft robots enable diverse operations, and tip-extending robots that navigate their environment through growth are highly effective in robotic search applications. Because the robot membrane extends from the tip, these robots can lengthen without friction from the environment. However, the flexibility of the membrane inhibits tip retraction. Two methods have been proposed to resolve this issue; increasing the pressure of the internal fluid to reinforce rigidity, and mounting an actuator at the tip. The disadvantage of the former is that the increase is limited by the membrane pressure resistance, while the second method adds to the robot complexity. In this paper, we present a tip-retraction mechanism without bending motion that takes advantage of the friction from the external environment. Water is used as the internal fluid to increase ground pressure with the environment. We explore the failure pattern of the retraction motion and propose plausible solutions by using hydrostatic skeleton robot. Additionally, we develop a prototype robot that successfully retracts by using the proposed methodology. Our solution can contribute to the advancement of mechanical design in the soft robotics field with applications to soft snakes and manipulators.
RODec 3, 2019
Internally-Balanced Magnetic Mechanisms Using Magnetic Spring for Producing Large Amplified Clamping ForceTori Shimizu, Kenjiro Tadakuma, Masahiro Watanabe et al.
To detach a permanent magnet with a controlled force much smaller than its original attractive force, the Internally-Balanced Magnetic Unit (IB Magnet) was invented and has been applied to magnetic devices such as wall-climbing robots, ceil-dangling drones, and modular swarm robots. In contrast to its drastic reduction rate on the control force, the IB Magnet has two major problems on its nonlinear spring which cancels out the internal force on the magnet: complicated design procedure and trade-off relationship between balancing precision and mechanism volume. This paper proposes a principle of a new balancing method for the IB Magnet which uses a like-pole pair of magnets as a magnetic spring, whose repulsive force ideally equals the attractive force of an unlike-pole pair exactly. To verify the proposed principle, the authors realized a prototype model of the IB Magnet using magnetic spring and verified through experiments its reduction rate is comparable to those of conventional IB Magnets. Moreover, the authors discussed and realized a robotic clamp as an application example containing proposed IB Magnets as its internal mechanism.
RODec 3, 2019
Radial-Layer Jamming Mechanism for String ConfigurationRio Mukaide, Kenjiro Tadakuma, Masahiro Watanabe et al.
Grippers can be attached to objects in a rigid mode, and they are therefore used in various applications, for example granular jamming gripper. This paper introduces a cutting-edge radial layer jamming mechanism with is tunable stiffness, which is critical for the development of grippers. The layer jamming mechanism generates friction between the layers of multi cylindrical walls by pulling wire. This paper describes the principles of three types of proposed tendon-driven jamming mechanism, in addition to their prototypes of string configuration and the experiments conducted on the holding torques of their joints. Due to the string configuration, the surface and three-dimensional (3D) shape. This mechanism can be implemented in various applications.
ROJul 22, 2019
Floating Displacement-Force Conversion Mechanism as a Robotic MechanismKenjiro Tadakuma, Tori Shimizu, Sosuke Hayashi et al.
To attach and detach permanent magnets with an operation force smaller than their attractive force, Internally-Balanced Magnetic Unit (IB Magnet) has been developed. The unit utilizes a nonlinear spring with an inverse characteristic of magnetic attraction to produce a balancing force for canceling the internal force applied on the magnet. This paper extends the concept of shifting the equilibrium point of a system with a small operation force to linear systems such as conventional springs. Aligning a linear system and its inverse characteristic spring in series enables a mechanism to convert displacement into force generated by a spring with theoretically zero operation force. To verify the proposed principle, the authors realized a prototype model of inverse characteristic linear spring with an uncircular pulley. Experiments showed that the generating force of a linear spring can be controlled by a small and steady operation force.