OpenThaiGPT 1.6 and R1: Thai-Centric Open Source and Reasoning Large Language Models
This work addresses the need for improved Thai language AI models, representing an incremental advancement in domain-specific LLMs.
The researchers developed OpenThaiGPT 1.6 and R1, Thai-centric large language models, to enhance generalization and reasoning capabilities, achieving superior performance on Thai language benchmarks and competitive results against larger open-source Thai LLMs.
We present OpenThaiGPT 1.6 and R1 (OTG-1.6 and OTG-R1), Thai-centric Large Language Models (LLMs) developed through distinct methodologies to enhance generalization and reasoning capabilities. OTG-1.6 employs Task Arithmetic model merging for broad generalization, while OTG-R1 integrates multi-stage training with the Less-Is-More Reasoning Hypothesis (LIMO) for advanced reasoning. Benchmark evaluations demonstrate superior performance across Thai language tasks, achieving competitive results against larger-scale open-source Thai LLMs. This paper details the proposed models, training processes, benchmarks, and results, highlighting improvements over previous models and establishing new performance standards for Thai-centric LLMs.