The Future of Consumer Edge-AI Computing
This addresses the problem of scaling AI capabilities for consumers by proposing a foundational shift from on-device to edge-serving systems, which is incremental as it builds on existing edge computing trends.
The paper tackles the challenge of insufficient isolated hardware for complex AI tasks at the consumer edge by introducing EdgeAI-Hub devices to reorganize compute resources and data access, aiming to enable shared resources and cross-device collaboration without compromising privacy or quality of experience.
In the last decade, Deep Learning has rapidly infiltrated the consumer end, mainly thanks to hardware acceleration across devices. However, as we look towards the future, it is evident that isolated hardware will be insufficient. Increasingly complex AI tasks demand shared resources, cross-device collaboration, and multiple data types, all without compromising user privacy or quality of experience. To address this, we introduce a novel paradigm centered around EdgeAI-Hub devices, designed to reorganise and optimise compute resources and data access at the consumer edge. To this end, we lay a holistic foundation for the transition from on-device to Edge-AI serving systems in consumer environments, detailing their components, structure, challenges and opportunities.