Amadeus-Verbo Technical Report: The powerful Qwen2.5 family models trained in Portuguese
This work addresses the need for accessible large language models in Brazilian Portuguese, though it is incremental as it applies existing fine-tuning methods to a new language context.
The report introduces the Amadeus Verbo family of large language models for Brazilian Portuguese, including models from 0.5B to 72B parameters, and demonstrates that fine-tuning foundation models can democratize open-source LLM development in Portuguese when data and resources are available.
This report introduces the experience of developing Amadeus Verbo, a family of large language models for Brazilian Portuguese. To handle diverse use cases, Amadeus Verbo includes base-tuned, merged, and instruction-tuned models in sizes of 0.5B, 1.5B, 3B, 7B, 14B, 32B, and 72B parameters. Thus, the main objective is to show how easy it is to fine-tune foundation models to democratize the open-source development of Brazilian Portuguese LLMs when data and resources are available. Amadeus-Verbo family models are all available at HuggingFace at https://huggingface.co/collections/amadeusai/amadeus-verbo-qwen25-67cf2e7aae69ce2b3bcdcfda.