美西螈

原名:axolotl

Axolotl:YAML 格式的 LLM 微调工具,支持 LoRA、DPO 和 GRPO 算法。

分类
开发提效
版本
v1.0.0
作者
弈韬(@ra1nzzz)
下载
1
收藏
0
发布
2026-08-25
更新
2026-09-15
TRACE 评分
4 / 5

内容概览

Expert guidance for fine-tuning LLMs with Axolotl — YAML configs, 100+ models, LoRA/QLoRA, DPO/KTO/ORPO/GRPO, multimodal support. Assistance with axolotl development, generated from official documentation. This skill should be triggered when: - Working with axolotl - Asking about axolotl features or APIs - Implementing axolotl solutions - Debugging axolotl code - Learning axolotl best practices Pattern 1: To validate that acceptable data transfer speeds exist for your training job, running NCCL Tests can help pinpoint bottlenecks, for example: Pattern 2: Configure your model to use FSDP in the Axolotl yaml. For example: Pattern 3: The context parallel size should be a divisor of the total number of GPUs. For example: Pattern 4: For example: - With 8 GPUs and no sequence parallelism: 8 different batches processed per step - With 8 GPUs and context parallel size=4: Only 2 different batches…

查看 SKILL 详情