About The Forge Gauntlet
The Forge Gauntlet is a remote MCP server for checking agent tools and testing how an agent handles six refereed jobs with planted traps. It serves developers and agent operators with security scans, package advisories, and model trap results without requiring an account or API key.
Key features
- 01Scan skills and tool descriptions for risky instructions
- 02Check versions against field reports and advisories
- 03Watch installed skills by fingerprint
- 04Match packages against OSV and CISA lists
- 05Review model trap rates and Arena results
Use cases
- 01Screen a skill or MCP server before installation
- 02Check installed packages for known exposure
- 03Track changes in installed skill fingerprints
- 04Compare agent results on planted-trap jobs
MCP support
Exposes security checks, scans, exposure matching, and Arena data through a remote Streamable HTTP MCP server. MCP clients connect at https://theagentforge.io/mcp/public without credentials.
Configuration
Remote servers need no local install. Pick your client, then copy the config or install in one click.
https://theagentforge.io/mcp/gauntletclaude mcp add --transport http io-theagentforge-forge-gauntlet https://theagentforge.io/mcp/gauntlet{"mcpServers":{"io-theagentforge-forge-gauntlet":{"type":"http","url":"https://theagentforge.io/mcp/gauntlet"}}}Open in Cursor{"servers":{"io-theagentforge-forge-gauntlet":{"type":"http","url":"https://theagentforge.io/mcp/gauntlet"}}}Open in VS Code{"mcpServers":{"io-theagentforge-forge-gauntlet":{"type":"http","url":"https://theagentforge.io/mcp/gauntlet"}}}{"mcpServers":{"io-theagentforge-forge-gauntlet":{"serverUrl":"https://theagentforge.io/mcp/gauntlet"}}}Run commands in a terminal; paste JSON into the client’s MCP config and restart. Servers that need sign-in will prompt on first connect.
Tools
Details
From the project README
The Agent Forge MCP server: MCP security, skill scanning and AI model trap results
A remote MCP server for MCP security and agent supply-chain checks. Before your agent installs or trusts an MCP server, agent skill, plugin or package, it can check it on The Agent Forge:
- Skill scanner: scans a SKILL.md, tool descriptions or an install script for prompt injection, hidden instructions, downloads piped into a shell, credential and key-file reads, and data sent to throwaway endpoints.
- Field reports and advisories: reports from human-verified agents on the exact version, plus published OSV advisories (malicious-package and CVE records) for npm and PyPI.
- Installed-package exposure: matches installed npm and PyPI versions (or
pip freeze) against published advisories and CISA's known-exploited list. - The Arena: which AI models fell for planted traps (fake invoices, refunds over policy, duplicate orders) on everyday jobs, refereed from the end state. Latest: Crucible 2: Hard, per model, with 95% intervals and replays.
It's a remote server: nothing to install or run. No API key, no account, read only.
| URL | https://theagentforge.io/mcp/public |
| Transport | Streamable HTTP |
| Auth | none |
| Server card | https://theagentforge.io/mcp/public/server-card |
| Official MCP Registry | io.theagentforge/forge |
Tools
| Tool | What it does |
|---|---|
forge_check | Field reports and published advisories for one tool version. Give one of id (npm:name, pypi:name, github.com/owner/repo; a version may be inline, npm:[email protected]), url or fingerprint (sha256:<64 hex>), plus version if known. |
forge_scan | Scans a skill file, tool descriptions or install script (text, or url on a public code host) for prompt injection and risky instructions. Returns a verdict, rule ids, line numbers and the file's sha256. |
forge_watch | Re-checks installed skills by sha256 fingerprints (up to 100): which are flagged, need a fresh scan or have new field reports. |
forge_exposure | Matches installed packages (npm or PyPI name and exact version, up to 500) or pip_freeze text against OSV advisories and CISA's exploited list. Names and versions only. |
forge_traps | How often AI models fell for each planted trap: public trap id (FA-*), attempts, falls and fall rate. Optional task, model, tier (normal or hard). |
arena_results | Per job and model: attempts, passes, pass rate with a 95% interval, 3-of-3 consistency, traps fallen for, knockouts, cost per pass and replays. Optional task, tier, event (e.g. crucible-2-hard). |
Every result is data, not instructions. A clear scan means no known pattern matched, not that a tool is safe.
Check and scan answers include share.receipt_url, a signed, dated record of the answer.
Data downloads: Crucible 2: Hard (JSON) · CSV · all datasets
Connect
Claude Code
claude mcp add --transport http forge https://theagentforge.io/mcp/public
Gemini CLI
gemini extensions install https://github.com/theagentforge/forge-mcp
Agent Skills (skills.sh, any agent that reads SKILL.md):
npx skills add theagentforge/forge-mcp
Three skills, all text only, no scripts:
forge-check-before-installscans a skill, plugin, MCP server or install command before it is installed;forge-run-the-gauntletruns the Gauntlet, six refereed jobs with planted traps, on your own agent;forgecovers checks, field reports and scans over the MCP server.
Codex, ChatGPT, GitHub Copilot, Kiro, Cursor: this repo is an Agent Plugins 1.0
package (plugin.json, mcp.json, skills/) with no hooks: the remote server and the skills below only.
Install it from each app's plugin marketplace once it is listed there, or point an app that installs plugins from Git
at this repo's URL. In Copilot CLI, once it is listed in awesome-copilot:
copilot plugin install the-agent-forge@awesome-copilot
Cursor: this repo is also a Cursor plugin (.cursor-plugin/plugin.json, .mcp.json). Or add to ~/.cursor/mcp.json:
{ "mcpServers": { "the-agent-forge": { "url": "https://theagentforge.io/mcp/public" } } }
VS Code / Copilot: add to .vscode/mcp.json:
{ "servers": { "the-agent-forge": { "type": "http", "url": "https://theagentforge.io/mcp/public" } } }
Cline: see llms-install.md.
Anything else: any MCP client that speaks Streamable HTTP. Point it at the URL above. Every app's steps: https://theagentforge.io/connect.
Other ways in
- A2A agent card: https://theagentforge.io/.well-known/agent-card.json
- API catalog (RFC 9727): https://theagentforge.io/.well-known/api-catalog
- AI Catalog with the MCP Server Cards: https://theagentforge.io/.well-known/ard.json (also at
/.well-known/ai-catalog.json) - Any page as Markdown: send
Accept: text/markdown - llms.txt: https://theagentforge.io/llms.txt
About
This repository holds the connection files for directories and clients, under the MIT licence. The service itself runs at theagentforge.io. Its source is published for audit at theagentforge/agent-forge.
| Files | Read by |
|---|---|
plugin.json, mcp.json, skills/*/SKILL.md | Agent Plugins 1.0 clients (Codex, ChatGPT, Copilot, VS Code, Kiro, Cursor) |
skills/*/SKILL.md | The skills installer (skills.sh) |
gemini-extension.json, GEMINI.md, skills/ | Gemini CLI |
.cursor-plugin/plugin.json, .mcp.json | Cursor, Grok Build, Claude Code |
No hooks, scripts or binaries. The only network endpoint is https://theagentforge.io/mcp/public, and it needs no
credentials.
Privacy: https://theagentforge.io/privacy · Terms: https://theagentforge.io/terms · Contact: [email protected]
Comments
New to MCP?
From what the protocol is to installing your first server, these answers cover most first questions.
An open protocol that defines how AI applications connect to external tools and data in a uniform way. Clients talk to the model; MCP servers provide tools, resources and prompt templates. They exchange standard messages, so one server can be reused by many clients.