HyperCLOVA X 8B Omni
This work addresses the need for practical omni assistants by consolidating multimodal tasks into a single model, though it is incremental as it builds on existing multimodal approaches.
The authors tackled the problem of creating a unified model for any-to-any multimodal understanding and generation across text, audio, and vision, resulting in HyperCLOVA X 8B Omni, which demonstrates competitive performance against similarly sized models in both Korean and English.
In this report, we present HyperCLOVA X 8B Omni, the first any-to-any omnimodal model in the HyperCLOVA X family that supports text, audio, and vision as both inputs and outputs. By consolidating multimodal understanding and generation into a single model rather than separate modality-specific pipelines, HyperCLOVA X 8B Omni serves as an 8B-scale omni-pathfinding point toward practical any-to-any omni assistants. At a high level, the model unifies modalities through a shared next-token prediction interface over an interleaved multimodal sequence, while vision and audio encoders inject continuous embeddings for fine-grained understanding and grounding. Empirical evaluations demonstrate competitive performance against comparably sized models across diverse input-output combinations spanning text, audio, and vision, in both Korean and English. We anticipate that the open-weight release of HyperCLOVA X 8B Omni will support a wide range of research and deployment scenarios.