An Intelligent AI glasses System with Multi-Agent Architecture for Real-Time Voice Processing and Task Execution
This is an incremental system integration for wearable AI applications.
The paper tackles real-time voice processing and task execution by developing an AI glasses system with a dual-agent architecture, achieving successful multilingual voice command processing and cross-platform task execution.
This paper presents an AI glasses system that integrates real-time voice processing, artificial intelligence(AI) agents, and cross-network streaming capabilities. The system employs dual-agent architecture where Agent 01 handles Automatic Speech Recognition (ASR) and Agent 02 manages AI processing through local Large Language Models (LLMs), Model Context Protocol (MCP) tools, and Retrieval-Augmented Generation (RAG). The system supports real-time RTSP streaming for voice and video data transmission, eye tracking data collection, and remote task execution through RabbitMQ messaging. Implementation demonstrates successful voice command processing with multilingual support and cross-platform task execution capabilities.