mcpField
B
batchwatch-mcp

batchwatch-mcp

Local
batchwatch.devCloud & Infra0Updated 8w ago

About batchwatch-mcp

batchwatch-mcp lets AI agents query measured batch-queue waits and conditions to inform whether a job should be batched. It passes through batchwatch API evidence rather than making estimates or decisions.

Key features

  1. 01Batch suitability verdicts
  2. 02Wait-time distributions
  3. 03Current queue conditions
  4. 04Provider and model data coverage
  5. 05Public queue status
  6. 06Pass-through API responses

Use cases

  1. 01Check whether a model queue meets a wait limit
  2. 02Compare likely wait distributions before routing a job
  3. 03Inspect current queue conditions against recent norms

MCP support

Exposes six batchwatch API read routes as MCP tools for agents. It forwards provider responses and returns errors on API failure instead of fabricating data.

Configuration

Local server config is the same for every client. Copy it into your client’s MCP config file.

mcp.json · Universal config
{
"mcpServers": {
"batchwatch-batchwatch": {
"command": "npx",
"args": [
"-y",
"batchwatch-mcp"
]
}
}
}
Run commandnpx -y batchwatch-mcp

Local servers need a runtime on your machine (e.g. Node.js 18+). Config file locations differ by client; see your client’s docs.

Packages
npmbatchwatch-mcp0.1.1

Tools

6

Saved tool list · updated 2w ago

ParameterTypeRequiredDescription
riskenumNoWhich percentile to judge against. p90 is the cautious planning number.p50 | p90
modelstringYesExact model name, e.g. "gpt-5.6-sol". Required.
max_waitstringNoHow long you can tolerate waiting, e.g. "15m", "2h", "24h". This is the whole question — send it.
providerenumNoDefaults to openai.openai | anthropic | google | mistral
input_tokensintegerNoOptional. Prompt tokens, used to compute the cost saving. Omit if unknown — do NOT send 0.
output_tokensintegerNoOptional. Completion tokens, or max_tokens as an upper bound.

Details

From the project README

batchwatch MCP server

Let an AI agent ask batchwatch "should I batch this job?" instead of guessing.

When a developer asks Claude, Cursor, Cline or any MCP-speaking agent "should I send this to the batch queue or run it synchronously?", this server lets the agent call batchwatch and get the real queue evidence — the measured wait distribution, the current conditions, a graded confidence, and how fresh the data is.

It wraps batchwatch's existing read routes as MCP tools. It is a thin, faithful proxy: it makes no decision and invents no numbers. Every answer is the provider's own JSON, passed through verbatim, carrying the n, confidence, why, basis and freshness the API already returns. If the API is down or slow, the tool returns an error — never a fabricated figure.

Access & tiers — the same gate as the rest of batchwatch

Because it is a faithful proxy, the server runs on the same tiers as the batchwatch API — there is no separate MCP plan and no MCP fast lane. Each tool carries your BATCHWATCH_TOKEN and earns exactly the tier that key earns anywhere else:

  • No token → you read the public data, delayed 15 minutes. You still get every answer — the distribution, the conditions, the verdict — as fresh as the open API serves them.
  • A token → the agent earns that key's tier and its freshness, volume and live behaviour. Live figures are what let an agent route real traffic on the answer, and they are bought here the same way they are bought at the API.

One access model, gated in one place — the batchwatch tier system (see the Tiers, delay, quota and the free trial reference in the batchwatch API docs).

Tools

Each tool maps to a real route in src/index.js (there is deliberately no tradeoff tool — /v1/tradeoff is named in the KRAVSPEC but not built yet, and a tool for a route that does not answer would be exactly the fabricated capability this project refuses to ship).

ToolRouteWhat it answers
should_i_batchGET /v1/should-i-batchGiven a model and your own max_wait, does the batch queue currently honour it? The verdict.
estimate_batchtimeGET /v1/estimate-batchtimeHow long is my job likely to wait? A distribution, never a single ETA.
conditionsGET /v1/conditionsCurrent conditions vs the recent norm — "is it me or them?"
distributionGET /v1/distributionThe full measured wait distribution (the raw evidence).
coverageGET /v1/coverageWhich provider+model combos have data, and how answerable each is.
waitGET /v1/waitThe public "is the queue moving now?" reading (delayed without a key).

batchwatch reports distributions and current conditions, not point ETAs. A personal history of 3-minute medians once produced a 480-minute job; "your job finishes at 14:32" is a lie the one time it matters. The tools' descriptions say so, so the calling model uses the answer correctly.

Install & run

cd mcp
npm install
node index.js       # speaks MCP over stdio

Requires Node ≥ 18 (uses the built-in fetch).

Configuration (environment)
VarDefaultMeaning
BATCHWATCH_URLhttps://batchwatch.devAPI base.
BATCHWATCH_TOKEN(unset)Optional API key. Without it the data is delayed, not absent — you still get answers, just older ones.
BATCHWATCH_TIMEOUT_MS8000Per-call timeout. On timeout the tool errors; it never guesses.
Wiring into a client

Claude Desktop / Cursor / Cline mcpServers entry:

{
  "mcpServers": {
    "batchwatch": {
      "command": "node",
      "args": ["/absolute/path/to/batchwatch/mcp/index.js"],
      "env": { "BATCHWATCH_TOKEN": "tk_your_key_optional" }
    }
  }
}

Tests

npm test                      # offline unit tests (mocked fetch) — deterministic
BATCHWATCH_LIVE=1 npm test    # also runs the live smoke against BATCHWATCH_URL

The unit tests assert the load-bearing properties: omitted numeric fields are never sent as 0; the provider JSON is passed through unchanged; only the real routes are exposed (no tradeoff); and an API error yields an error, never a number.

Publishing (registry reach — the point of #57)

The highest-leverage distribution channel for a 2026 dev tool is being the answer an agent reaches for by default. Once this is published so agents can install it, batchwatch wins the call instead of merely being mentioned. Targets: the Anthropic MCP registry, Smithery, and mcp.so. The package is publish-ready (bin: batchwatch-mcp, zero build step); registry submission is tracked on Vikunja task #57.

Why this exists

batchwatch measures how long jobs actually wait in LLM providers' async batch queues. Batch is half price, but "done within 24 hours" cannot be planned around, so most callers pay full price out of habit. This server puts the queue evidence one tool-call away from the agent that is about to make that choice.

Comments

Markdown supported

New to MCP?

From what the protocol is to installing your first server, these answers cover most first questions.

An open protocol that defines how AI applications connect to external tools and data in a uniform way. Clients talk to the model; MCP servers provide tools, resources and prompt templates. They exchange standard messages, so one server can be reused by many clients.