Open Source LLM Fine-Tuning Projects

Tools and frameworks for fine-tuning large language models (LLMs) on custom datasets. Covers supervised fine-tuning (SFT), instruction tuning, reinforcement learning from human feedback (RLHF), Direct Preference Optimization (DPO), GRPO, and parameter-efficient methods like LoRA and QLoRA. Includes both local training frameworks and managed fine-tuning services.

Unsloth

Open-source platform for fine-tuning and running LLMs locally — 2x faster training with 70% less VRAM. Supports LoRA, QLoRA, DPO, GRPO.

Alternative to:

LM Studio