One email each morning — yesterday's AI, sortedGet it in your inbox

METAL LAB

unslothai/unsloth

73,954+3,338 this weekPython

A desktop app that lets you run and train AI models on your own computer, no coding required

Unsloth is a desktop app for running and fine-tuning a wide range of models, including LLMs like Qwen and DeepSeek and image generators like FLUX, directly on your own machine. It works on Windows, macOS, and Linux, and can be started with a single install script or a downloadable installer. It also offers a web UI (Unsloth Studio) and a code-based package (Unsloth Core) for more technical use.

What it does

  1. Available in three forms: a no-setup desktop app, a web UI (Studio), and a code-based package (Core)
  2. Supports fine-tuning methods including LoRA, QLoRA, full fine-tuning, reinforcement learning (RL), GRPO, and DPO, claimed to run 2x faster and use 70% less VRAM than standard setups
  3. Connects local models to AI agent tools like Claude Code and Codex with a single command, letting them act as the agent's brain
  4. Runs across NVIDIA, AMD, Intel, Apple Silicon, and CPU hardware, with remote access support via Cloudflare tunnels
  5. Trained models can be exported or deployed in formats like GGUF, NVFP4, and FP8

Why it matters

It lowers the barrier for developers and researchers who want to run and customize large AI models locally instead of relying on cloud APIs. This means working with the latest open-source models without ongoing API costs or sending data outside your own machine.

Terms in this repo

  • LoRA/QLoRA · lightweight fine-tuning methods that adjust only part of a model, requiring far less compute
  • GGUF · a compressed model file format designed to run on ordinary computers
  • GRPO/DPO · reinforcement-learning-based methods for improving a model's responses using feedback or rules
  • VRAM · the memory on a graphics card; running out of it can prevent a model from training or running
  • MCP (Model Context Protocol) · a standard that lets AI models connect to files, apps, and external tools

Repository description (English)

Local UI to run and train LLMs and diffusion models, including Qwen3.8, Kimi K3, MiniMax-H3, Gemma 4, DeepSeek-V4, FLUX and more.

Open on GitHub

Trending repos

All repos →

Latest from METAL LAB