mcpField
N
novita-ai

novita-ai

github.com/novitalabsCloud & DevOps678 installsUpdated 5w ago
Repository

About novita-ai

novita-ai is a skill for using the Novita AI platform, covering model APIs, GPUs, Agent Sandbox, and guidance for related frameworks and clients. It routes tasks to relevant references and requires live verification of dynamic information.

Key features

  1. 01Use LLM, image, video, and audio APIs
  2. 02Work with GPU instances and serverless GPUs
  3. 03Manage Agent Sandbox through SDK or CLI
  4. 04Consult framework, client, and observability guides
  5. 05Route tasks to relevant references

Use cases

  1. 01Build applications using Novita AI model APIs
  2. 02Generate or process image, video, and audio tasks
  3. 03Set up isolated code execution for agents
  4. 04Find guidance on GPUs, Sandbox, or APIs

Install

Copy the command and run it in a terminal.

$npx skills add https://github.com/novitalabs/novita-skills --skill novita-ai

After installing, type/novita-aiin Claude Code to confirm it loaded.

Bundled files

References and scripts installed along with SKILL.md.

references/
audio-api.md
common-issues.md
gpu-api.md
gpu-guide.md
image-api.md
integrations-clients.md
integrations-frameworks.md
integrations-observability-agents.md
integrations.md
llm-api.md
llm-guide.md
quick-start.md
video-api.md

Details

From the project README

Novita AI

The AI-Native Cloud for builders and agents: run models, scale GPUs, and build AI agents on one platform.

This file is the agent route. It must work when installed as a skill and when read directly from: https://raw.githubusercontent.com/novitalabs/novita-skills/main/skills/novita-ai/SKILL.md

Rules

  • Use NOVITA_API_KEY; never paste secrets into source or answers.
  • Use NOVITA_MODEL or the model already selected by the user/application.
  • Do not recommend or invent a default model. If none is selected, list models or ask the user to choose.
  • Verify dynamic data live before giving hard values: models, pricing, rate limits, quota, latency, GPU inventory, and sandbox limits.
  • Pick one route first. Read more than one reference only when the task spans products.
  • In raw-read mode, fetch the matching raw reference URL from the route table.
  • Return runnable code or commands with explicit placeholders such as <MODEL_NAME>, <TASK_ID>, and <INPUT_FILE>.
  • Use trusted local media files for image, video, and audio inputs unless the user explicitly provides a safe URL.

Constants

ItemValue
API basehttps://api.novita.ai
OpenAI-compatible basehttps://api.novita.ai/openai
OpenAI-compatible v1 basehttps://api.novita.ai/openai/v1
API keyNOVITA_API_KEY
ModelNOVITA_MODEL
Model cataloghttps://novita.ai/models
Pricinghttps://novita.ai/pricing
Consolehttps://novita.ai/console
API keyshttps://novita.ai/settings/key-management

Route Table

User intentInstalled referenceRaw-read URLLive source
First API call, API key, base URLreferences/quick-start.mdhttps://raw.githubusercontent.com/novitalabs/novita-skills/main/skills/novita-ai/references/quick-start.mdhttps://novita.ai/settings/key-management
Chat, OpenAI SDK, streaming, tools, JSON, vision, batchreferences/llm-guide.mdhttps://raw.githubusercontent.com/novitalabs/novita-skills/main/skills/novita-ai/references/llm-guide.mdhttps://novita.ai/docs/api-reference/model-apis-llm-create-chat-completion
LLM parameters, embeddings, rerank, files, batch endpointsreferences/llm-api.mdhttps://raw.githubusercontent.com/novitalabs/novita-skills/main/skills/novita-ai/references/llm-api.mdhttps://novita.ai/docs/api-reference/model-apis-llm-create-chat-completion
Image generation/editing, background, inpaint, upscalereferences/image-api.mdhttps://raw.githubusercontent.com/novitalabs/novita-skills/main/skills/novita-ai/references/image-api.mdhttps://novita.ai/docs
Video generation/editing, video task pollingreferences/video-api.mdhttps://raw.githubusercontent.com/novitalabs/novita-skills/main/skills/novita-ai/references/video-api.mdhttps://novita.ai/docs
TTS, ASR, voice cloningreferences/audio-api.mdhttps://raw.githubusercontent.com/novitalabs/novita-skills/main/skills/novita-ai/references/audio-api.mdhttps://novita.ai/docs
GPU instances, serverless GPU, templates, storagereferences/gpu-guide.md or references/gpu-api.mdhttps://raw.githubusercontent.com/novitalabs/novita-skills/main/skills/novita-ai/references/gpu-guide.mdhttps://novita.ai/docs/guides/gpu-instance-overview
Agent Sandbox SDK, E2B compatibility, pricingbuilt-in Sandbox section; details in novita-sandbox referencehttps://raw.githubusercontent.com/novitalabs/novita-skills/main/skills/novita-sandbox/references/sandbox-guide.mdhttps://novita.ai/docs/guides/sandbox-overview
Agent Sandbox CLI: create, list, connect, kill, logs, clone, commit, template build, deploy agentbuilt-in Sandbox section; details in novita-sandbox skillhttps://raw.githubusercontent.com/novitalabs/novita-skills/main/skills/novita-sandbox/SKILL.mdhttps://novita.ai/docs/guides/sandbox-sdk-and-cli
LangChain, LlamaIndex, OpenAI Agents SDKreferences/integrations-frameworks.mdhttps://raw.githubusercontent.com/novitalabs/novita-skills/main/skills/novita-ai/references/integrations-frameworks.mdhttps://novita.ai/docs/guides/langchain
Cursor, Continue, Claude Code, Dify, LobeChat, ChatBoxreferences/integrations-clients.mdhttps://raw.githubusercontent.com/novitalabs/novita-skills/main/skills/novita-ai/references/integrations-clients.mdhttps://novita.ai/docs
LiteLLM, Portkey, Langfuse, Browser Use, Skyvern, Axolotlreferences/integrations-observability-agents.mdhttps://raw.githubusercontent.com/novitalabs/novita-skills/main/skills/novita-ai/references/integrations-observability-agents.mdhttps://novita.ai/docs
Auth, billing, quota, rate limits, request failuresreferences/common-issues.mdhttps://raw.githubusercontent.com/novitalabs/novita-skills/main/skills/novita-ai/references/common-issues.mdhttps://novita.ai/docs/guides/faq

Model Selection

Use this order:

  1. User-provided model.
  2. Existing project config or NOVITA_MODEL.
  3. Live catalog query, then ask the user or choose only when the user gave selection criteria.
curl https://api.novita.ai/openai/v1/models \
  -H "Authorization: Bearer $NOVITA_API_KEY"

Minimal LLM Call

import os
from openai import OpenAI

client = OpenAI(
    base_url="https://api.novita.ai/openai",
    api_key=os.environ["NOVITA_API_KEY"],
)

response = client.chat.completions.create(
    model=os.environ["NOVITA_MODEL"],
    messages=[{"role": "user", "content": "Hello"}],
    max_tokens=512,
)

print(response.choices[0].message.content)
curl https://api.novita.ai/openai/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $NOVITA_API_KEY" \
  -d '{
    "model": "'"$NOVITA_MODEL"'",
    "messages": [{"role": "user", "content": "Hello"}],
    "max_tokens": 512
  }'

Async Tasks

Image and video APIs often return task_id. Poll results:

curl "https://api.novita.ai/v3/async/task-result?task_id=<TASK_ID>" \
  -H "Authorization: Bearer $NOVITA_API_KEY"

Agent Sandbox

Use Sandbox for isolated code execution, file operations, templates, long-running agent environments, and E2B-compatible workflows. Handle common Sandbox tasks here; use novita-sandbox only for deeper CLI detail.

SDK Baseline
pip install novita-sandbox
export NOVITA_API_KEY=<YOUR_API_KEY>
from novita_sandbox.code_interpreter import Sandbox

sandbox = Sandbox.create()
execution = sandbox.run_code("print('hello world')")
print(execution.logs)
sandbox.kill()

Generate JavaScript/TypeScript equivalents when the user is working in Node.js.

CLI Baseline

Check Node.js and install or update the CLI:

if ! command -v node >/dev/null 2>&1; then
  echo "Install Node.js first"
elif ! command -v novita-sandbox-cli >/dev/null 2>&1; then
  npm install -g novita-sandbox-cli@beta
else
  novita-sandbox-cli --version
fi

Authenticate when needed:

novita-sandbox-cli auth info || novita-sandbox-cli auth login
CLI Workflows
# Template
novita-sandbox-cli template init
novita-sandbox-cli template build -n <TEMPLATE_NAME>
novita-sandbox-cli template list

# Sandbox lifecycle. Use --detach inside AI agents; interactive terminals usually fail there.
novita-sandbox-cli sandbox create <TEMPLATE_ID> --detach
novita-sandbox-cli sandbox list
novita-sandbox-cli sandbox logs <SANDBOX_ID> -f
novita-sandbox-cli sandbox metrics <SANDBOX_ID> -f
novita-sandbox-cli sandbox clone <SANDBOX_ID> --count <N>
novita-sandbox-cli sandbox commit <SANDBOX_ID> --alias <ALIAS>
novita-sandbox-cli sandbox kill <SANDBOX_ID>

# Deploy and invoke an agent. Pass env vars explicitly; sandbox processes do not inherit local shell env.
novita-sandbox-cli agent configure -n <AGENT_NAME> -e <ENTRYPOINT>
novita-sandbox-cli agent launch
novita-sandbox-cli agent invoke '{"prompt":"hello"}' --stream --env NOVITA_API_KEY=$NOVITA_API_KEY

For exact flags, template versioning, E2B compatibility, pricing, and quota behavior, read the Sandbox route in the table above.

Error Defaults

  • 401 / 403: check key, account status, and Authorization: Bearer ....
  • 404 / model not found: verify exact model ID from the live catalog.
  • 429: reduce concurrency, back off, inspect rate limits and account tier.
  • Insufficient credits: check billing and balance.
  • Long-running media: use async polling or webhooks.

Comments

Markdown supported