mcpField
C
cli-batches

cli-batches

github.com/cheaper-inferenceData & databases82.3k1.0k installsUpdated today
Repository

About cli-batches

cli-batches documents omniroute CLI commands for submitting and monitoring batch inference jobs, managing files, and retrieving outputs or errors. It is for users running batch pipelines from the command line, including in CI/CD workflows.

Key features

  1. 01Create, submit, list, and cancel batches
  2. 02Wait for batch jobs to finish
  3. 03Retrieve batch outputs and errors
  4. 04Upload, list, inspect, and delete files

Use cases

  1. 01Submit JSONL batch inference jobs
  2. 02Monitor jobs and wait for completion
  3. 03Save batch outputs or errors to files
  4. 04Manage input files in a CI/CD pipeline

Install

Copy the command and run it in a terminal.

$npx skills add https://github.com/cheaper-inference/omniroute --skill cli-batches

After installing, type/cli-batchesin Claude Code to confirm it loaded.

Details

From the project README

Overview

Submit and monitor batch inference jobs from the CLI. Upload and manage files for batch processing, retrieve results, and integrate batch pipelines with CI/CD workflows.

Quick install

npm install -g omniroute   # or: npx omniroute
omniroute --version

Subcommands

batches

Example:

omniroute batches
batches list

Flags:

  • --status <s>
  • --limit <n>

Example:

omniroute batches list
batches get <batchId>

Example:

omniroute batches get <batchId>
batches create

Flags:

  • --input-file <fileId>
  • --endpoint <e>
  • --completion-window <w>
  • --metadata <kv>

Example:

omniroute batches create
batches submit

Flags:

  • --jsonl <path>
  • --endpoint <e>
  • --wait

Example:

omniroute batches submit
batches cancel <batchId>

Flags:

  • --yes

Example:

omniroute batches cancel <batchId>
batches wait <batchId>

Flags:

  • --timeout <ms>

Example:

omniroute batches wait <batchId>
batches output <batchId>

Flags:

  • --out <path>

Example:

omniroute batches output <batchId>
batches errors <batchId>

Flags:

  • --out <path>

Example:

omniroute batches errors <batchId>
files

Example:

omniroute files
files list

Flags:

  • --purpose <p>
  • --limit <n>

Example:

omniroute files list
files get <fileId>

Example:

omniroute files get <fileId>
files upload <path>

Flags:

  • --purpose <p>

Example:

omniroute files upload <path>
files content <fileId>

Flags:

  • --out <path>

Example:

omniroute files content <fileId>
files delete <fileId>

Flags:

  • --yes

Example:

omniroute files delete <fileId>

Comments

Markdown supported