mcpField
O
omni-cache

omni-cache

github.com/cheaper-inferenceCloud & DevOps82.3k1.0k installsUpdated today
Repository

About omni-cache

omni-cache is an API skill for managing the LLM response cache, including statistics, entries, and reasoning caches. It is for service operators who need to inspect cache data or clear it through authenticated endpoints.

Key features

  1. 01Retrieve cache statistics
  2. 02Inspect statistics across cache layers
  3. 03List cache entries and reasoning data
  4. 04Clear caches, entries, or statistics
  5. 05Use Bearer-token or session-cookie authentication

Use cases

  1. 01Review cache usage and detailed statistics
  2. 02Clear cached responses during maintenance
  3. 03Inspect or clear reasoning-cache data

Install

Copy the command and run it in a terminal.

$npx skills add https://github.com/cheaper-inference/omniroute --skill omni-cache

After installing, type/omni-cachein Claude Code to confirm it loaded.

Details

From the project README

Overview

Manage the LLM response cache. View cache statistics, clear entries, configure TTL policies, and control semantic-similarity caching thresholds.

Authentication

All requests require a valid Bearer token or session cookie. Obtain a token via POST /api/auth/login or configure REQUIRE_API_KEY=false for local development.

Endpoints

GET /api/cache

Get cache statistics

curl http://localhost:20128/api/cache \
  -H "Authorization: Bearer $OMNIROUTE_TOKEN"
DELETE /api/cache

Clear all caches

curl -X DELETE http://localhost:20128/api/cache \
  -H "Authorization: Bearer $OMNIROUTE_TOKEN"
GET /api/cache/stats

Get detailed cache statistics

Returns detailed statistics for all cache layers.

curl http://localhost:20128/api/cache/stats \
  -H "Authorization: Bearer $OMNIROUTE_TOKEN"
DELETE /api/cache/stats

Clear cache statistics

curl -X DELETE http://localhost:20128/api/cache/stats \
  -H "Authorization: Bearer $OMNIROUTE_TOKEN"
GET /api/cache/entries

GET cache › entries

curl http://localhost:20128/api/cache/entries \
  -H "Authorization: Bearer $OMNIROUTE_TOKEN"
DELETE /api/cache/entries

DELETE cache › entries

curl -X DELETE http://localhost:20128/api/cache/entries \
  -H "Authorization: Bearer $OMNIROUTE_TOKEN"
GET /api/cache/reasoning

GET cache › reasoning

curl http://localhost:20128/api/cache/reasoning \
  -H "Authorization: Bearer $OMNIROUTE_TOKEN"
DELETE /api/cache/reasoning

DELETE cache › reasoning

curl -X DELETE http://localhost:20128/api/cache/reasoning \
  -H "Authorization: Bearer $OMNIROUTE_TOKEN"

Payloads

See the full OpenAPI specification at GET /api/openapi/spec or docs/openapi.yaml for detailed request/response schemas.

Comments

Markdown supported