Tencent/AI-Infra-Guard
Tencent open-sources a security scanner that checks AI services, agents, and MCP servers all at once
AI-Infra-Guard (A.I.G) is an AI red teaming platform from Tencent Zhuque Lab that scans AI infrastructure for known vulnerabilities, evaluates agent and MCP server risks, checks agent skills, and tests LLMs against jailbreak attacks. It can run as a Docker web app or as separate CLI tools plugged into CI/CD pipelines. It's released as open source under Apache 2.0.
What it does
- Point it at a running AI service address (vLLM, Ollama, ComfyUI, n8n, etc.) and it fingerprints the software to match against over 100 supported frameworks and more than 2,000 known CVE vulnerabilities
- MCP servers and Agent Skills can be scanned from source code or a remote URL alone, covering 14 major risk categories; on the project's own SkillTrustBench benchmark spanning 9 risk types (T01-T09), the top-performing model reached an F1 score of 0.9848
- Jailbreak Evaluation tests LLM safety using multiple attack methods, including multi-turn attacks like Many-Shot, PAIR, GOAT, and ActorAttack that try to manipulate a model over several conversation turns
- Skill, MCP, and Agent scanning are each packaged as standalone pip-installable CLI tools so they can be embedded directly into enterprise CI/CD pipelines
- The maintainers explicitly warn the tool has no authentication mechanism and is meant for internal enterprise or individual use, not public-facing deployment
Why it matters
Teams running their own AI services or building agent/MCP-based workflows get a free way to self-check for known vulnerabilities and permission-abuse risks before shipping. Citations in 19 academic papers and a Black Hat Europe presentation suggest the tool has become a reference point within the AI security research community.
Terms in this repo
- MCP (Model Context Protocol) · A standard connector protocol that lets AI models plug into external tools and data
- CVE · A publicly registered identifier for a known software vulnerability
- Jailbreak · An attack that bypasses an AI model's safety guardrails to elicit forbidden outputs
- Red Teaming · Proactively probing a system for weaknesses by simulating an attacker's perspective
- F1 score · A detection accuracy metric combining precision and recall, closer to 1 is better
Repository description (English)
A full-stack AI Red Teaming platform securing AI ecosystems via Agent Scan, Skills Scan, MCP scan, AI Infra scan and LLM jailbreak evaluation.
Open on GitHubTrending repos
- cathrynlavery/diagram-designA skill that makes AI coding tools draw magazine-quality diagrams instead of generic rounded boxes
- public-apis/public-apisA giant crowd-curated directory of free APIs for developers
- semantica-agi/semanticaAn open-source graph infrastructure that lets AI agents show their work, not just their answers
- cactus-compute/needleA 14MB AI model small enough to run tool-calling on a phone or watch, without internet
- unslothai/unslothA desktop app that lets you run and train AI models on your own computer, no coding required
- macro-inc/macroAn all-in-one workspace where email, chat, docs, tasks, and CRM are cross-linked and share one AI memory
- harry0703/MoneyPrinterTurboAn open-source tool that turns a single topic or keyword into a finished short video, complete with script, footage, subtitles, and music
- basecamp/omarchyA ready-made, opinionated Linux setup built by DHH
Latest from METAL LAB
- Grok leaks conversations, location data via commands hidden in ciphertext
- Cursor lets agents handle long-running tasks with new "/goal" command
- NVIDIA releases Switchyard, an LLM routing proxy for coding agents
- Caveman Cuts Claude Code Token Usage by 33% Using Caveman-Speak
- Apple Keeps 2027 Target for Camera AirPods, Qwen3.8-27B Makes 80 Tool Calls Locally