美西螈
原名:axolotl
Axolotl:YAML 格式的 LLM 微调工具,支持 LoRA、DPO 和 GRPO 算法。
- 分类
- 开发提效
- 版本
- v1.0.0
- 作者
- 弈韬(@ra1nzzz)
- 下载
- 1
- 收藏
- 0
- 发布
- 2026-08-25
- 更新
- 2026-09-15
- TRACE 评分
- 4 / 5
内容概览
Expert guidance for fine-tuning LLMs with Axolotl — YAML configs, 100+ models, LoRA/QLoRA, DPO/KTO/ORPO/GRPO, multimodal support. Assistance with axolotl development, generated from official documentation. This skill should be triggered when: - Working with axolotl - Asking about axolotl features or APIs - Implementing axolotl solutions - Debugging axolotl code - Learning axolotl best practices Pattern 1: To validate that acceptable data transfer speeds exist for your training job, running NCCL Tests can help pinpoint bottlenecks, for example: Pattern 2: Configure your model to use FSDP in the Axolotl yaml. For example: Pattern 3: The context parallel size should be a divisor of the total number of GPUs. For example: Pattern 4: For example: - With 8 GPUs and no sequence parallelism: 8 different batches processed per step - With 8 GPUs and context parallel size=4: Only 2 different batches…