Torchtune is the official PyTorch library for fine-tuning LLMs: readable single-file recipes for LoRA, QLoRA and full fine-tuning, from single GPU to multi-node.
| Category | Fine-tuning |
| Type | Fine-tuning library |
| License | BSD-3-Clause |
| Runs locally | Yes |
| Built with | Python |
| Skill level | Intermediate |
| Best for | PyTorch users who want clean, hackable recipes |
Other open-source fine-tuning tools worth comparing:
UnslothFine-tune LLMs 2x faster on one GPU
AxolotlConfig-driven fine-tuning for many models
LLaMA-FactoryFine-tune 100+ models with a UI
PEFTLoRA and friends from Hugging Face
TRLAlign LLMs (SFT, DPO, PPO)
Llama CookbookOfficial recipes to fine-tune Llama
ms-swiftFine-tune 500+ LLMs and VLMsTorchtune is free and open-source (BSD-3-Clause license), so you can use, self-host and modify it at no cost.
Yes. Torchtune is designed to run on your own machine or server, keeping your data private.
Popular open-source alternatives include Unsloth, Axolotl, LLaMA-Factory. See the comparisons above to choose.
Browse the full directory of open-source AI tools, models and projects — updated daily.
Browse all tools →