Chinese-Vicuna: A Chinese Instruction-following Llama-based Model
This provides a resource-efficient solution for researchers and developers in low-resource environments, enabling cost-effective Chinese LLM applications in domains like healthcare and law, though it is incremental as it builds on existing methods.
The authors tackled the problem of limited Chinese instruction-following capabilities by fine-tuning LLaMA with LoRA, achieving competitive performance in tasks like translation and domain-specific Q&A, with deployment on consumer GPUs like RTX-2080Ti for 7B models.
Chinese-Vicuna is an open-source, resource-efficient language model designed to bridge the gap in Chinese instruction-following capabilities by fine-tuning Meta's LLaMA architecture using Low-Rank Adaptation (LoRA). Targeting low-resource environments, it enables cost-effective deployment on consumer GPUs (e.g., RTX-2080Ti for 7B models) and supports domain-specific adaptation in fields like healthcare and law. By integrating hybrid datasets (BELLE and Guanaco) and 4-bit quantization (QLoRA), the model achieves competitive performance in tasks such as translation, code generation, and domain-specific Q\&A. The project provides a comprehensive toolkit for model conversion, CPU inference, and multi-turn dialogue interfaces, emphasizing accessibility for researchers and developers. Evaluations indicate competitive performance across medical tasks, multi-turn dialogue coherence, and real-time legal updates. Chinese-Vicuna's modular design, open-source ecosystem, and community-driven enhancements position it as a versatile foundation for Chinese LLM applications.