compute-efficient continual pre-training with LoRA

Newer alternatives

Recent methods in the same sub-problem, not yet superseded in the knowledge base.

• Shift-Dependent AsymmetryShift-Dependent Asymmetry: Orthogonal Inverse Low-Rank Adaptation for Federated Medical Segmentation
  Jun 7, 2026
• GLoRABeyond Factor Aggregation: Gauge-Aware Low-Rank Server Representations for Federated LoRA
  May 7, 2026
• HiLoRAHiLoRA: Hierarchical Low-Rank Adaptation for Personalized Federated Learning
  Mar 3, 2026
• FedRot-LoRAFedRot-LoRA: Mitigating Rotational Misalignment in Federated LoRA
  Feb 27, 2026
• ADF-LoRAADF-LoRA: Alternating Low-Rank Aggregation for Decentralized Federated Fine-Tuning
  Nov 23, 2025
• compute-efficient continual pre-training with LoRALow-Resource Dialect Adaptation of Large Language Models: A French Dialect Case-Study
  Oct 26, 2025
• personalized federated fine-tuning method with orthogonal LoRA adaptersPersonalized Federated Fine-Tuning of Vision Foundation Models for Healthcare
  Oct 14, 2025
• FLoRA-NACommunication-Efficient and Accurate Approach for Aggregation in Federated Low-Rank Adaptation
  Sep 30, 2025