frontierharness-eval

Name: frontierharness-eval
Author: frontier-harness-eval/eval

frontier-harness-evalTesting & quality105 installs

About frontierharness-eval

Benchmark a third-party coding-agent harness against FrontierHarness Eval using Runta runtimes. Provisions a clean runtime bound to the GitHub repo under evaluation, installs the Harbor and Pier stacks needed for Terminal-Bench and DeepSWE tasks, freezes a golden checkpoint, runs tasks from identical fresh restores while saving trajectories as evidence, generates a comparison diagram, and builds a shareable report. Use when evaluating, benchmarking, scoring, or comparing a coding agent harness, or when the user mentions FrontierHarness, DeepSWE, Terminal-Bench, Harbor, Pier, golden checkpoints, or harness trajectories.

Install

Copy the command and run it in a terminal.

$npx skills add https://frontier-harness-eval/eval --skill frontierharness-eval

After installing, type/frontierharness-evalin Claude Code to confirm it loaded.

Bundled files

References and scripts installed along with SKILL.md.

isolated-evaluation-repairs.md

PROMPT.md

reference.md

smoke-tasks.txt

scripts/

build-report.mjs

calculate-cost.py

cost_accounting.py

dependency_commands.py

generate-chart.mjs

normalize-results.mjs

pricing.json

providers.sh

provision-golden-checkpoint.sh

recover-relay-observed-usage.py

restore-system-runc.sh

run-trials-shared-runtime.sh

run-trials.sh

transport.sh

trial-worker.sh

usage_details.py

website-cost.mjs

Comments

Markdown supported

Details

Author: frontier-harness-eval/eval
Category: Testing & quality
Installs: 105

Report

More skills

All skills

hyperframes-cli

github.com/heygen-com

1.4M

HyperFrames CLI dev loop. Use when running npx hyperframes init, add, catalog, capture, lint, validate, inspect, layout, snapshot, compare, grade-compare, preview, play, render, publish, feedback, lambda, doctor, browser, info, upgrade, skills, compositions, docs, benchmark, telemetry, transcribe, tts, or remove-background, or when troubleshooting the HyperFrames build/render environment. Entry point for AWS Lambda cloud rendering (hyperframes lambda deploy / render / progress / destroy / policies / sites).

tdd

github.com/mattpocock

1.2M

Test-driven development. Use when the user wants to build features or fix bugs test-first, mentions "red-green-refactor", or wants integration tests.

anti-ui-slop

uizze.com

932.8k

Stop coding agents from shipping generic UI. Use UIZZE's 800,000+ real web and iOS screens to build product-specific interfaces, define a design contract, cover required states, and run a hard finish gate. Use when designing, implementing, redesigning, critiquing, or pre-ship reviewing a web or iOS interface in Codex, Claude Code, Cursor, Copilot, or another coding agent. Trigger with "anti-ui-slop", "stop UI slop", "ground this UI in real screens", or "run the UI finish gate".

diagnosing-bugs

github.com/mattpocock

871.8k

Diagnosis loop for hard bugs and performance regressions. Use when the user says "diagnose"/"debug this", or reports something broken/throwing/failing/slow.