IA-QA — 152 QA & Dev Tools for AI Agents
RemoteAbout IA-QA — 152 QA & Dev Tools for AI Agents
IA-QA is a hosted MCP server offering QA and LLM-testing utilities for AI agents. Its 152 tools cover security, evaluation, RAG, web audits, and data handling, with smaller endpoints for clients that limit loaded tools.
Key features
- 01152 QA and LLM-testing tools
- 02Security and injection scans
- 03Evaluation and RAG tests
- 04Web and MCP server audits
- 05JSON, YAML, and CSV utilities
Use cases
- 01Scan prompts for injection, PII, or secrets
- 02Evaluate hallucinations and model responses
- 03Test RAG relevance and reranking
- 04Validate data formats and schemas
MCP support
Exposes its tools over Streamable HTTP at a full endpoint and three smaller packs. MCP clients can connect without an account or API key.
Configuration
Remote servers need no local install. Pick your client, then copy the config or install in one click.
https://www.ia-qa.com/mcpclaude mcp add --transport http jcjamet-ia-qa-toolbox https://www.ia-qa.com/mcp{"mcpServers":{"jcjamet-ia-qa-toolbox":{"type":"http","url":"https://www.ia-qa.com/mcp"}}}Open in Cursor{"servers":{"jcjamet-ia-qa-toolbox":{"type":"http","url":"https://www.ia-qa.com/mcp"}}}Open in VS Code{"mcpServers":{"jcjamet-ia-qa-toolbox":{"type":"http","url":"https://www.ia-qa.com/mcp"}}}{"mcpServers":{"jcjamet-ia-qa-toolbox":{"serverUrl":"https://www.ia-qa.com/mcp"}}}Run commands in a terminal; paste JSON into the client’s MCP config and restart. Servers that need sign-in will prompt on first connect.
Tools
Details
From the project READMEIA-QA MCP server
Free QA and LLM-testing tools for AI agents, served over MCP (Streamable HTTP). No account, no API key. Every tool returns a verdict an agent can act on: pass/fail, a score, a diff.
- Website: https://www.ia-qa.com · MCP page: https://www.ia-qa.com/mcp-server ·
llms.txt: https://www.ia-qa.com/llms.txt - Official MCP Registry:
io.github.JcJamet/ia-qa-toolboxand the three packs below
This repository describes the hosted server; it holds no server code. The live tool list is always GET https://www.ia-qa.com/mcp.
Endpoints
| Endpoint | Tools listed | For |
|---|---|---|
https://www.ia-qa.com/mcp | all 152 | clients with no tool limit |
https://www.ia-qa.com/mcp/security | 30 | prompt injection, PII and secret scans, TLS/header/CORS audits, MCP server checks |
https://www.ia-qa.com/mcp/eval | 38 | hallucination, eval contracts, semantic and RAG tests, tokens and models |
https://www.ia-qa.com/mcp/data | 36 | JSON/YAML/CSV, schema validation, encoding, text and time utilities |
Clients cap how many tools they load (VS Code Copilot 128 per request, Cursor about 40). A pack lists only its tools; for a tool outside it, add the full server or the pack that lists it — find_tool searches everything and says which pack lists each tool.
Install
Claude Code
claude mcp add --transport http ia-qa https://www.ia-qa.com/mcp
# or one pack:
claude mcp add --transport http ia-qa-security https://www.ia-qa.com/mcp/security
Cursor — .cursor/mcp.json (this project) or ~/.cursor/mcp.json (all projects) (use a pack: Cursor loads about 40 tools)
{
"mcpServers": {
"ia-qa-security": {
"url": "https://www.ia-qa.com/mcp/security"
}
}
}
VS Code (GitHub Copilot, agent mode) — .vscode/mcp.json
{
"servers": {
"ia-qa": {
"type": "http",
"url": "https://www.ia-qa.com/mcp"
}
}
}
Claude Desktop — Settings → Connectors → Add custom connector, URL https://www.ia-qa.com/mcp (or a pack URL).
Any other MCP client — Streamable HTTP at one of the URLs above. More clients, and a prompt you can paste into any agent: https://www.ia-qa.com/mcp-server
What leaves your machine
Every call runs on ia-qa.com: whatever you pass to a tool is sent there — including a provider API key given to one of the few bring-your-own-key tools. The call journal stores no IP address: a monthly pseudonym (an HMAC, not reversible) to count distinct callers within a month, and each entry is deleted 400 days after the call. Rate limit: 60 requests per minute per IP.
For tools that must run next to your app (selector self-healing, app discovery), use the local packages instead — nothing is sent to ia-qa.com: @ia-qa/pal, @ia-qa/self-healing, @ia-qa/qa-discovery.
Packs
security — https://www.ia-qa.com/mcp/security
prompt_injection_scan · shield_analyze · guardrail_test · toxicity_scan · bias_detect · redact_pii · secret_scan · detect_secrets · security_headers_check · ssl_certificate_check · cors_test · cors_checker · cookie_security_audit · web_security_audit · validate_url · decode_jwt · generate_hmac · hash_text · generate_password · mcp_server_evaluate · mcp_server_health_check · mcp_schema_lint · validate_mcp_response · function_call_validate · validate_agent_trajectory · latency_benchmark · parse_http_headers · http_status_lookup · find_tool · rate_tool
eval — https://www.ia-qa.com/mcp/eval
get_testing_guidelines · run_eval_contract · run_semantic_tests · generate_eval_yaml · generate_ci_workflow · metamorphic_check · needle_haystack_generate · test_skill · hallucination_check · similarity_score · consistency_check · llm_output_validator · llm_format_check · llm_json_schema_check · response_quality_score · compare_responses · analyze_responses · prompt_test_suite · cot_analyzer · conversation_analyze · ab_test_report · embedding_similarity · rag_relevance_rank · rerank_evaluate · bm25_score · build_rag_prompt · count_tokens · token_budget_calculator · context_window_check · list_llm_models · model_info · compare_models · estimate_llm_cost · llm_generate · run_vlm_test_suite · extract_json_from_text · find_tool · rate_tool
data — https://www.ia-qa.com/mcp/data
format_json · json_schema_validate · json_diff · extract_json_path · flatten_json · json_to_yaml · yaml_to_json · xml_to_json · parse_csv · json_to_csv · mock_from_schema · json_schema_generate · openapi_validate · timestamp_convert · cron_parse · validate_email · regex_test · diff_text · text_stats · case_convert · generate_slug · base64_encode · base64_decode · url_encode · url_decode · generate_uuid · hash_text · number_base_convert · color_convert · lorem_ipsum · decode_jwt · env_parse · count_code_lines · lint_commit_message · find_tool · rate_tool
All 152 tools, by category: TOOLS.md.
Generated from the server's own definitions on 2026-10-26. The live list (GET https://www.ia-qa.com/mcp) wins if this page disagrees.
Comments
New to MCP?
From what the protocol is to installing your first server, these answers cover most first questions.
An open protocol that defines how AI applications connect to external tools and data in a uniform way. Clients talk to the model; MCP servers provide tools, resources and prompt templates. They exchange standard messages, so one server can be reused by many clients.