Building AI Service Repositories for On-Demand Service Orchestration in 6G AI-RAN
This work addresses the need for practical orchestration frameworks in 6G networks, though it appears incremental as it builds on existing concepts with a new toolchain.
The paper tackled the problem of inefficient AI service orchestration in 6G AI-RAN by introducing an open-source, LLM-assisted toolchain that automates service packaging, deployment, and runtime profiling, demonstrating significant automation benefits and reduced manual coding efforts in a case study.
Efficient orchestration of AI services in 6G AI-RAN requires well-structured, ready-to-deploy AI service repositories combined with orchestration methods adaptive to diverse runtime contexts across radio access, edge, and cloud layers. Current literature lacks comprehensive frameworks for constructing such repositories and generally overlooks key practical orchestration factors. This paper systematically identifies and categorizes critical attributes influencing AI service orchestration in 6G networks and introduces an open-source, LLM-assisted toolchain that automates service packaging, deployment, and runtime profiling. We validate the proposed toolchain through the Cranfield AI Service repository case study, demonstrating significant automation benefits, reduced manual coding efforts, and the necessity of infrastructure-specific profiling, paving the way for more practical orchestration frameworks.