unslothai/unsloth
A desktop app that lets you run and train AI models on your own computer, no coding required
Unsloth is a desktop app for running and fine-tuning a wide range of models, including LLMs like Qwen and DeepSeek and image generators like FLUX, directly on your own machine. It works on Windows, macOS, and Linux, and can be started with a single install script or a downloadable installer. It also offers a web UI (Unsloth Studio) and a code-based package (Unsloth Core) for more technical use.
What it does
- Available in three forms: a no-setup desktop app, a web UI (Studio), and a code-based package (Core)
- Supports fine-tuning methods including LoRA, QLoRA, full fine-tuning, reinforcement learning (RL), GRPO, and DPO, claimed to run 2x faster and use 70% less VRAM than standard setups
- Connects local models to AI agent tools like Claude Code and Codex with a single command, letting them act as the agent's brain
- Runs across NVIDIA, AMD, Intel, Apple Silicon, and CPU hardware, with remote access support via Cloudflare tunnels
- Trained models can be exported or deployed in formats like GGUF, NVFP4, and FP8
Why it matters
It lowers the barrier for developers and researchers who want to run and customize large AI models locally instead of relying on cloud APIs. This means working with the latest open-source models without ongoing API costs or sending data outside your own machine.
Terms in this repo
- LoRA/QLoRA · lightweight fine-tuning methods that adjust only part of a model, requiring far less compute
- GGUF · a compressed model file format designed to run on ordinary computers
- GRPO/DPO · reinforcement-learning-based methods for improving a model's responses using feedback or rules
- VRAM · the memory on a graphics card; running out of it can prevent a model from training or running
- MCP (Model Context Protocol) · a standard that lets AI models connect to files, apps, and external tools
Repository description (English)
Local UI to run and train LLMs and diffusion models, including Qwen3.8, Kimi K3, MiniMax-H3, Gemma 4, DeepSeek-V4, FLUX and more.
Open on GitHubTrending repos
- vorssaint/vorssaint-utilsOne free menu bar app replaces a dozen paid Mac utilities
- Alishahryar1/free-claude-codeA local proxy that lets coding AI agents run on 49 free or cheap model providers instead of one paid service
- freestylefly/awesome-gpt-image-2A library of 532 reverse-engineered prompts that turn GPT-Image2 into a predictable image-making tool
- block/buzzAn open-source workspace where humans and AI agents chat, code, and review in the same rooms
- NousResearch/hermes-agentNous Research's Hermes is an AI agent that gets smarter the more you use it
- virgiliojr94/book-to-skillA tool that turns technical book PDFs into on-demand reference skills for AI coding agents
- VoltAgent/awesome-agent-skillsA single hub collecting over 1000 'how-to' manuals that make AI coding assistants act like experts
- anthropics/claude-plugins-communityA shared shelf where anyone's Claude add-ons get listed for install