One email each morning — yesterday's AI, sortedGet it in your inbox

METAL LAB

lightningpixel/modly

6,954+1,797 this weekTypeScript

A desktop app that turns a single photo into a 3D model using only your own GPU

Modly is a desktop application that converts photos into 3D meshes using open source AI models that run entirely on the user's own GPU, with no cloud server involved. It works on Windows, Linux, and Apple Silicon macOS, and supports swapping in different 3D generation models like Hunyuan3D and TripoSG through an extension system. Users build workflows by connecting steps such as image input, mesh generation, and adding results to a scene.

What it does

  1. Takes an image, runs an open source AI model locally to generate a 3D mesh, and keeps all computation on the local GPU instead of sending data to an external server
  2. Supports multiple interchangeable 3D generation models as GitHub-based extensions, including Hunyuan3D 2 Mini, TripoSG, and Trellis2 GGUF
  3. Lets users smooth and decimate imported meshes directly inside the app, writing optimized results back into the workspace
  4. Ships a stdlib-only Python CLI so scripts or AI agents can control the running desktop app and get machine-readable JSON results without touching the UI
  5. Validates workflow wiring before running so invalid graphs surface warnings instead of erasing the current mesh view

Why it matters

It gives people a way to generate 3D assets locally on their own hardware without paying for or sending images to a cloud 3D-generation service, which matters for game development, prototyping, or 3D printing workflows. The extension system and automation CLI also make it easier to swap in newer 3D generation models or wire the app into scripted pipelines.

Terms in this repo

  • mesh · a data structure representing a 3D object's surface as points and triangles
  • decimate · reduce the number of polygons in a 3D model to lower file size and processing cost
  • extension · a plugin distributed as a separate GitHub repository that adds a new AI model or feature to Modly
  • CLI · a command-line tool for controlling software via text commands instead of clicking a UI
  • GGUF · a compressed file format used to store AI model weights in a smaller size

Repository description (English)

runs entirely on your GPU

Open on GitHub

Trending repos

All repos →

Latest from METAL LAB