google-ai-edge/LiteRT-LM
LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.
Open on GitHubOne email each morning — yesterday's AI, sortedGet it in your inbox