About spider-king
Spider King is a skill for recovering web protocols and building bounded collectors, aimed at practitioners investigating HTTP behavior and client-side signing or decoding. It emphasizes evidence-led investigation and browser-free Python replay or collection, while excluding native apps and mini-programs.
Key features
- 01Evidence-led protocol investigation
- 02HTTP request and state analysis
- 03Focused signing and decoding helpers
- 04Browser-free Python replay and collectors
- 05Delivery gates for evidence and code
Use cases
- 01Analyzing supplied HAR or request data
- 02Recovering a web endpoint's request flow
- 03Rebuilding a fixed-trace signer or decoder
- 04Packaging a bounded Python collector
Install
Copy the command and run it in a terminal.
npx skills add https:/ / github.com/ aoyunyang/ spider-king-skill --skill spider-kingAfter installing, type/spider-kingin Claude Code to confirm it loaded.
Bundled files
References and scripts installed along with SKILL.md.
LICENSEREADME.mdagents/openai.yamlreferences/anti-debug-playbook.mdasync-export-job-playbook.mdanti-bot-class-playbook.mdcase-reuse-playbook.mdchallenge-artifact-harvest-playbook.mdchallenge-state-envelope-playbook.mdanti-patterns-playbook.mdcrypto-patterns.mddevice-trust-sidecar-playbook.mddelivery-gate-playbook.mddecoy-and-real-request-playbook.mddual-writer-param-playbook.mdenvironment-patch-playbook.mddoctrine-index.mdembedded-browser-runtime-playbook.mdcookie-provenance-playbook.mdenv-diff-playbook.mdevidence-corroboration-gate.mdexperience-card-schema.mdreferences/examples/douyin-bdms-pure/algorithm-notes.mdreferences/examples/douyin-bdms-pure/fixtures/primitives-vectors.jsonreferences/examples/douyin-bdms-pure/scripts/verify_primitives.pypure_abogus_template.pyreferences/experience-cards/signer-egress-stub-must-match-callsite.jsonserver-clock-must-enter-observed-writer.jsonstandard-primitive-concat-before-custom-port.jsonreferences/experience-fixtures/page-local-exception-matrix.jsonDetails
From the project READMESpider King
Mission
Turn hostile web clients into stable protocol collectors.
This is a pure-web protocol-recovery skill, not a browser-automation skill and not an APK/mini-program reverse skill. Use browser tooling only to gather web evidence. Deliver raw HTTP plus narrow local sign, bootstrap, decode, or transport helpers. If the primary target is APK, native app, or mini-program, state out-of-scope instead of inventing a web dual-browser first-pass.
Non-Negotiables
-
Before any tool choice on a fresh task, run the Auto Judge Card in this file and
references/mcp-routing-playbook.md: decide intake, whether a browser is needed, which baseline host to use, and which debugger-trace means to use (js-reverseand/orsilent-value-capture). Do not open tools first and rationalize later. -
Start every fresh web target classified as
live-targetwith sequential evidence for both roles before claiming that the page/runtime is understood:fingerprint-baselinethendebugger-trace. The only narrower claim is thetransport-only direct-endpoint exceptioninreferences/startup-triage-playbook.md: it may accept a collector for one exact endpoint without claiming page/runtime understanding, and only after its strict negative-control and business-oracle gates pass. -
Default means are baseline
chrome-devtoolsthen debugger-tracejs-reverse. If DP/initiator work is already required,js-reversemay own both roles on one host; do not launch a second Chrome. Recordlaunchvsattachand never pretend launch is attach. Upgrade the baseline host to Camoufox or another managed profile only on proved fingerprint pressure or clean-baseline failure; never default Camoufox for ordinary low-risk work or because CDPnavigator.webdriveris true. -
Satisfy
debugger-tracewith correlated initiator/mutation proof fromjs-reverse, correlatedsilent-value-capturecards underreferences/silent-value-capture-playbook.md, or both. Preferjs-reversewhen attach exists. -
If attach is missing, record
debugger_attach_gapand continue debugger-trace viasilent-value-capturewhen a backend is available instead of abandoning the role. If a needed silent backend is also missing, recordsilent_value_capture_gapand continue offline or lower the delivery shape. -
Silent-value-capture never replaces baseline and never owns
compact-replayorcollectordelivery. APK, native app, and mini-program primary tasks remain out of scope and must not invent paired-browser proof as ceremony. If a required role cannot be satisfied by any available means, report the blocker before claiming the live target is understood. -
Keep browser and engine-capture evidence collection target-serial: at most one browser or engine-capture family may be
TARGET_ACTIVE, and never place two target owners in the same parallel tool batch. Apply the handoff gate inreferences/tool-playbook.md; park or retain baseline before granting silent-value engine capture; preserve unique unreplayable state withRETAINED_EXCEPTIONinstead of destroying it for cleanup. -
For
compact-replayandcollector, deliver a browser-free Python run path. Never use browser automation, Playwright, Selenium, CDP page-driving, page-context fetch, browser profiles, manual browser state, silent-value-capture backends, or engine instrumentation as the final replay path or fallback. -
Prefer pure Python for HTTP, orchestration, parsing, retries, persistence, and output. Keep JS/WASM only as a tiny local helper when a verified Python port would be riskier; a local bootstrap may emulate host semantics, but Python owns live HTTP and the report states browser-free/runtime-free truth. Replay identity locks to the installed curl impersonate chrome major; do not copy a newer live Chrome major onto a lower impersonate or restart risk-control reverse for that drift.
-
Recover one stable business request before pagination, concurrency, submission, or runtime shrinking. Unknown risk-control reverses the rejected request first; unproven extra routes are at most one per round and only after omission changes the oracle.
-
When a local JS/WASM/SDK helper is called repeatedly in one browser-shaped workflow, treat process/VM/context identity and hidden mutable state as moving parts; prove persistent-world versus fresh-world behavior before shrinking or widening the helper, and do not reuse a self-invalidating instance as a pager.
-
Back every conclusion with the evidence its declared shape requires. Require repeated live replay only when claiming current live acceptance. Keep raw sensitive values local; redact credentials, tokens, personal data, and cookie values from chat, reports, and version control.
-
Never hardcode rotating state before proving its writer, slot, scope, expiry, and refresh path; preserve one session chain for bootstrap-heavy flows until cross-session reuse is proven.
-
Stop only when the declared shape passes its capability-specific gate or a real external blocker is proved. Do not label
evidenceorlocal-proofas a collector, and do not disguise incomplete automation as a temporary collector. -
compact-replayandcollectordelivery include a PyCharm right-click runnable Python entrypoint, normally project-rootmain.pyorcollector/main.py, with no required terminal arguments.evidenceandlocal-proofdo not require an entrypoint unless the requested artifact is executable code. -
Route only MCP families confirmed in the current tool registry/schema; disk source trees are not availability. Passive wire stores may coexist with
TARGET_ACTIVEbut do not replace live first-pass evidence, andcompact-replay/collectorremain free of browser runtime, page driving, profiles, capture backends, and engine instrumentation. -
Before hardening a gate-family label, widening runtime, or handing work to an installed specialist, pass
references/evidence-corroboration-gate.md. One status code, cookie name, token name, old note, or plausible helper output is only a hypothesis. -
When a trusted positive sample passes and the local path fails, use
references/positive-sample-ablation-playbook.mdafter sample hygiene. Name unfinished live failures withreferences/failure-surface-taxonomy.mdinstead of implying collector completion. When stuck, pick one Stuck next action from that file; do not bulk-add unproven extra routes.
For failure-shaped counterexamples, read references/anti-patterns-playbook.md. Before packaging a result, apply only the matching capability gate from references/delivery-gate-playbook.md. Graded degrade: import/NameError is our bug (alarm on stderr); external timeout is fallback. Print key responses to stderr; keep stdout machine JSON.
Lightweight Dispatch
Use these labels internally to keep the first move small. Do not force a rigid machine header in normal user replies.
| Shape | Deliverable |
|---|---|
evidence | real request, initiator, state source, mutation point, or precise blocker |
local-proof | fixed vectors, decoded sample, restored source, or callable helper without live egress |
compact-replay | one bounded right-click runnable replay for a proved request |
collector | repeatable browser-free Python collector with bounds |
Default to the smallest shape that answers the user. User-provided HAR, packet capture, request text, JS/WASM, cookie/token sample, fixed vector, or existing project artifact starts as evidence or local-proof; do not open a browser just to satisfy live-target ceremony. evidence and local-proof must not auto-start dual-role browser ceremony. A bare URL by itself does not authorize browser navigation, live replay, writes, account/session use, dependency installation, or broad collection.
Route names describe the current capability owner, not the gate family: evidence-reuse, chromium-recon, browser-hook, static-ast, env-patch, iv8-local-runtime, verifier, transport, pure-python-rebuild, or python-collector. Run one route until it returns evidence or a named blocker. If two routes look plausible, pick the smaller offline route first and record what proof would justify escalation.
Before any route writes files, sends live egress, executes target-supplied code, uses account/session state, installs dependencies, or changes runtime state, apply the compact contract in references/provider-work-order.md.
Fast Routes and Ownership
Use a focused route when the goal is already narrow. Do not restart full unknown-target discovery for these cases.
| Current goal | Route |
|---|---|
| Paste-ready browser observation Hook at a known boundary | references/profiles/browser-hook-snippets/index.md |
| Structured Babel AST restoration of a supplied JS file | references/profiles/static-ast/index.md |
| Known entry + invocation + fixed browser output in Node/VM | references/profiles/env-patch/index.md |
| JSVMP/SDK loads but XHR or fetch signing stays silent or path-dependent | references/profiles/env-patch/references/jsvmp-interceptor-contract.md; prove activation with positive and negative path controls; if CDP navigator.webdriver is true, delete the configurable prototype property in initScript before Camoufox; HTML zeros with no list XHR are not data |
| Fixed-trace pure-Python signer/decoder rebuild or regression | references/pure-python-rebuild-playbook.md |
| Unknown or multi-layer end-to-end collector | Continue Startup Gate + Universal Reverse Loop below |
| Entry/call-chain location only | Dedicated reverse skill when available; else chrome-devtools / js-reverse initiator evidence |
| Explicit Python + iv8 runtime | iv8 skill when available; if unavailable, report the unmet constraint and use env-patch/local helper only after the user accepts that substitution |
| Narrow installed specialist matches a corroborated blocker | Handoff only when capability snapshot lists that specialist and dual-surface corroboration passes; Spider stays secondary runtime help. If no specialist is installed, stay on the generic loop—do not invent a family shortcut |
| Already-captured HAR, Reqable history, or request text to explain or draft replay | evidence-reuse; read references/mcp-routing-playbook.md before opening browsers |
| Fingerprint or managed profile required before evidence | Auto-judge high fingerprint pressure -> Camoufox/managed host baseline, then attach/js-reverse handoff when debug endpoint exists |
| Enough HAR/request/JS/cookie sample and no fresh live proof needed | artifact-only / evidence-reuse; do not open Camoufox, Chrome, or js-reverse for ceremony |
Focused profile rules:
- Browser-hook, static-ast, and env-patch may skip unknown-target ceremony only for
artifact-onlyor proved known-boundary work, with reversible changes and secret-safe logs; structure-only AST detection may start from supplied source but needs fixed samples for behavioral claims. If fresh interaction is required, classify it aslive-targetand require sequential role evidence; missing bootstrap, session, transport, decode, or pagination state exits the profile to the Universal Reverse Loop. - Process artifacts go under the executing project
js_reverse_cache/tasks/<task-id>/(task.json,network.jsonl,runtime-evidence.jsonl,silent_value/when used,handoff.json,fixtures/,report.md). Delivery proof remainsanalysis/proof_manifest.jsonand related analysis files. Never write task secrets into this skill directory. Applyreferences/project-artifact-contract.mdbefore the first save or promotion.
Auto Route Card
Use this before tool choice. It does not relax any delivery gate. Full signal tables and host-upgrade rules live in references/mcp-routing-playbook.md and references/startup-triage-playbook.md.
Auto Judge Card (signal-driven)
Judge in this order and record the branch before the first target action:
- Intake: enough offline samples and no live acceptance need ->
artifact-only; bare URL or fresh page/session proof -> weblive-target; same target/env/goal ->continuation; APK/app/mini-program primary -> out of scope. - Browser/engine needed?: pure offline explain/restore/fixed-vector work -> no browser; need current request/page/wire proof -> baseline host; known-boundary value or initiator work -> debugger-trace means after baseline handoff (
js-reverseand/orsilent-value-capture). - Baseline host: default
chrome-devtoolsfor ordinary low-risk recon. If DP/initiator work is already required, letjs-reverseown baseline and debugger-trace on one host; do not launch a second Chrome. Upgrade to Camoufox/managed host only on fingerprint pressure or clean-baseline failure; never default Camoufox for ordinary low-risk work. - Debugger-trace means: after a candidate business request exists, select means without abandoning the role:
- attach available -> default
js-reverseon the current host after sequential handoff; recordlaunchmode instead of disguising it as attach - upgrade triggers (observer-toxic hooks, systematic miss, need fixed-input vectors, JSVM public-boundary values missing, page self-check distrusting page-world) -> enable
silent-value-captureimmediately; do not widen page-world hooks first - attach missing -> record
debugger_attach_gap; if a silent-value backend is available, continue debugger-trace viasilent-value-capture; else continue offline - no silent backend when needed -> record
silent_value_capture_gapand continue offline or lower delivery shape; an exact direct endpoint may use the transport-only exception only if every entry condition inreferences/startup-triage-playbook.mdis independently proved
- attach available -> default
- Debugger-trace role complete when any holds: correlated initiator/mutation proof from
js-reverse; or one or more correlatedfixed_input_readysilent-value cards; or both. Prefer public boundary I/O over opcode/whole-program traces; protobufserializeBinaryand wasmencode(i32,i32)count. Never place capture backends incompact-replayorcollector. - Stop browser/engine early: once the real request, mutation point, and rebuild path are proved, leave browser MCP and any silent-value backend, then finish in pure Python.
Default live sequence
capability snapshot (browser mode launch|attach|unavailable, curl impersonate max chrome, silent_backend)
-> Auto Judge
-> fingerprint-baseline (chrome-devtools default; js-reverse may own both roles when DP is already required; Camoufox/managed host only on pressure)
-> sequential handoff (park/retain baseline)
-> debugger-trace means (branch, not a linear tail):
attach? yes -> js-reverse first
+ silent-value-capture on upgrade triggers
attach? no -> debugger_attach_gap
+ silent-value-capture if backend available
else offline continue
-> offline rebuild + delivery gate
Startup Gate
Complete and report this gate before deep analysis. Expanded checklists stay in references/startup-triage-playbook.md.
0. Intake mode
Declare one mode before tool use:
live-target: current web page/endpoint needs fresh browser and wire evidence; use sequential role orderartifact-only: only saved requests/source/tokens/samples; mark live acceptance unprovencontinuation: same target/env/goal; reuse the current gate and reopen only changed surfaces
1. Environment and tools
Snapshot installed MCP families, browser mode (launch|attach|unavailable), known debug endpoint, curl impersonate max chrome from scripts/check_reverse_env.py, optional silent-value backend availability (silent_backend=available|absent), and optional passive wire stores. Route only confirmed tools. Missing optional families or backends are gaps, not ceremony. If silent_backend=absent, do not probe capture backends; after attach/js-reverse gaps, continue offline or lower the delivery shape.
2. Family triage
Tag the smallest dominant gate family (signer-gated, transport-gated, verifier-gated, decode-gated, session-gated) from current evidence, then open only that path.
3. Delivery intent
State the declared shape (evidence, local-proof, compact-replay, collector) and stop at that gate. Do not brand incomplete automation as a temporary collector.
Minimal Intake
Start immediately when the user provides a target page or API URL, site and collection goal, captured request, JS or WASM sample, cookie or token sample, or packet capture. Choose the intake mode before deciding whether browser evidence is required.
Ask only for missing information that changes implementation: target fields, collection scope, output format, login requirement, and whether dedupe, resume, or incremental sync is required.
For read-only evidence or local-proof requests, ask only for the missing sample, vector, trigger action, or source path. Delay project-root, retention, live replay, and request-budget questions until the next action would write, execute target code, or contact the target.
Before implementing a compact-replay or collector, use the conditional implementation brief in references/provider-work-order.md when multiple implementation forms remain viable or the next step would widen the currently resolved runtime, dependency, writable-scope, or live-authority boundary. Do not turn that brief into a mandatory approval ceremony for evidence, local-proof, or an implementation choice the user already made.
Universal Reverse Loop
Use references/workflow-overview.md as the short execution map and references/tool-playbook.md for tool selection. Phase numbers below are the only phase numbering system; multi-stage settle and stage-field bundles are cross-cutting checklists mapped in that file.
Phase 0: Fingerprint
- Capture a clean baseline before broad hooks when observer effect is possible; distinguish decoy from real endpoint, transport from application gate, visible param from wrapper rewrite, bootstrap from data API, a single request from a stateful transcript, and HTML placeholder zeros from list-XHR data, dummy HTTP siblings from WebSocket or text channels, chrome-devtools HTTP logs from WebSocket frames, and non-JSON WebSocket prefix frames from business JSON.
- Identify plain JSON, GraphQL, WebSocket, protobuf, binary envelope, encrypted response, glyph mapping, CSS-in-HTML sprite or offset glyphs, JSVMP, or host-bound runtime early. Prefer protobuf
serializeBinary/ wasmencodeover opcodes; capture binary as hex, not UTF-8 dumps. - Choose the smallest next proof, not the largest bundle dump.
Phase 1: Prove the real request
- Follow redirects and wrapper/compatibility pages, mapping entry, bootstrap, list, detail, submission, verifier, warm-up, telemetry, download, risk-control, and async export/report routes separately.
- Capture exact URL, method, query, body bytes, headers, outbound Cookie header, response shape, and initiator.
- Treat pagination pivots and challenged document replays as part of the protocol contract.
- When the same direct endpoint and business input diverge only by client transport, run the same-input matrix and negative control in
references/transport-pre-gate-playbook.mdhere, before signer or environment work. If it meets everytransport-only direct-endpoint exceptioncondition inreferences/startup-triage-playbook.md, scope acceptance to that endpoint and keep browser-role gaps explicit.
Deliver one confirmed request on the real business path.
Phase 2: Isolate moving state
Answer the static analysis six questions in references/minimal-verifiable-facts-playbook.md before declaring the mutation model known.
Classify every changing part: timestamp, nonce, signed query or body, rotating header or cookie, wrapper field, operation name, cursor, bootstrap artifact, decode key, glyph map, session secret, profile baseline, sparse delta, counter, heartbeat, elapsed-time dependency, media key, page exception, account state, or host semantic.
Also classify helper lifetime, VM/context identity, module instances, closures, caches, queues, lazy initialization, and call-order markers when the same local runtime serves more than one request or step; explicit counter/cookie replay does not prove continuity.
When the surface is an export or signed open platform style API, also bucket fields into business, static app, server-issued, and per-request dynamic classes before designing regeneration. Independently label source class (fixed / plaintext / local-algorithm / server-issued / risk-interactive) and ownership class (python-owned / host-owned / server-owned); never treat source as ownership.
Prove cookie provenance and distinguish server-issued artifacts from locally minted filler. Treat page text about session participation as a hypothesis only until wire behavior confirms it. When login is only the first gate, validate tenant, role, and data-range with a final identity reread before export; see references/multi-context-session-playbook.md. Keep stored jar state separate from the authoritative outbound Cookie header when they diverge. When business replay fails against a browser success packet, recover the request contract with references/session-contract-playbook.md before deepening signer work.
Phase 3: Locate the canonical mutation point
Trace in this order:
- transport wrappers, interceptors,
beforeSend, fetch, Ajax, XHR, worker, or message boundaries; freeze the wire: an emptybeforeSendIIFE is not a signer - bootstrap scripts and inline payloads
- exposed helpers and returned child objects
- WASM exports or inner serializer, packer, signer, or decoder primitives
- server-returned challenges and response-side refresh fields
- frame serializers, protobuf parsers, handshake transcripts, and key schedules
The canonical mutation point is where the wire-shaped payload actually changes, not where business code creates a placeholder.
When a named digest or named AES/GCM/WASM export is present, prove it on fixed inputs and freeze frame, packed-key layout, and inner-field PRNG before trusting a standard library. Prefer environment-selected digest constants and the browser branch over UI or function names; route to references/crypto-patterns.md. When ALU traces show 0x9E3779B9 or a VM packs 4-character little-endian blocks, route to the same file.
Phase 4: Rebuild offline
- Multi-surface verifier rejects after mint-shaped tokens: ablate morph/state-chain first, fill day-card + kill-switches K1-K8, and treat gold-similarity as false progress (
references/verifier-morph-and-state-chain-playbook.md). - Same-family solved skeleton present: migrate host/path/state-chain first (
references/case-reuse-playbook.md); do not reopen a behavior-wall mainline. - Climb one rung at a time: fixed-input parity, narrow boundary observation, pure local reproduction, narrow host bootstrap, then evidence-backed host-surface patching. When stage counts differ from the browser path, follow the multi-stage settle rule in
references/workflow-overview.mdbefore algorithm rewrites. Inside a rung, patch only thefirst_divergenceminimal unit fromreferences/reproducible-evidence-playbook.md, and revalidate evidence freshness on continuation. - For repeated helper calls, run the minimal continuity matrix in
references/runtime-state-continuity-playbook.mdbefore adding browser APIs: one persistent world, one fresh world, and one explicit-state ablation with other inputs held constant where possible. - Before escalating, record the last proved artifact, exact blind spot, why the next rung is smallest, and how browser-free delivery remains intact.
- Read
references/escalation-ladder-playbook.mdbefore widening runtime, patch surface, or transport profile. - When transport evidence proves that the closest maintained backend cannot express the admitted browser profile, read
references/native-transport-profile-playbook.mdbefore building a route-local native adapter. - When an opaque staged artifact still depends on captured runtime inputs, read
references/opaque-runtime-profile-playbook.md; preserve one atomic run, port stage by stage, and distinguish algorithmic generation from snapshot-driven generation or pool replay. Nondeterministic feeds (Math.random/Date.now/ canvas / audio) are session-bound; never run a new-session script against an old feed. - Preserve exact serialization, field slot, framing, JSONP callback, delimiter, compression, cipher, and decode order.
- When porting JS digests to Python, validate uint32 truncation,
ROTLedge cases, and per-byte packing masks on a frozen preimage before live replay. - For string-table-heavy bundles, begin with the non-executing
references/profiles/static-ast/index.mddetector and conservative rewrite, then recover the decoder offline with a two-pass rewrite before deep beautify work; seereferences/obfuscation-guide.mdandreferences/offline-inline-deob-playbook.md. - Regenerate request-shaped artifacts inside the request loop when page, keyword, body, referer, timestamp, or session state can change them.
- If persistent-world and fresh-world behavior differ, keep the narrow local helper alive for the proved sequence and record initialization, lifetime, reset, timeout, cleanup, and runtime version; if the persistent world self-invalidates after the first encrypt, isolate or port that encrypt instead of paging with the burned instance; do not treat a per-call subprocess as a neutral implementation detail.
Phase 5: Prove repeatability and scale
references/workflow-overview.md packages this phase as Phase 5: Deliver (prove repeatability + delivery packaging). Same phase number; not a second system.
- Verify helpers and decoders against fixed-input or fixed-payload vectors.
- Prove one fresh single-page replay on one session chain before scaling or shrinking runtimes.
- Require repeated live replay at least two to three times (verifier gates: 10-20 when claiming stability on hard-gate metric); helper load success or mint-shaped tokens are not acceptance.
- For verifier-gated flows with fingerprint/device companions, read
references/device-trust-sidecar-playbook.mdand name delivery level L0-L3; local SDK runtime patching isreferences/local-sdk-env-patch-playbook.md. - For verifier-gated flows, prove required sidecars, same-world shared-state, one protocol profile, actual request timing, final verifier semantics, and the first downstream consumer on one complete round. Keep the hard order above; record an ablation matrix and a local error-semantic map before scaling retries.
- For verifier-gated flows, prove positive-sample hygiene: clean success samples outrank contaminated automation failures. Environment risk (exit IP, automation marks, consecutive failures) is a separate failure surface from track quality; classify with
references/failure-surface-taxonomy.mdand isolate layers withreferences/positive-sample-ablation-playbook.mdwhen local replay disagrees with a clean success sample. - Prove the next page or cursor, route pivots, refresh behavior, field completeness, and relevant permission boundaries.
- For async exports, prove create with a pre-create task-id snapshot plus condition match, isolate the polled task, and block persistence when downloaded columns are thinner than requested fields; see
references/async-export-job-playbook.md. - Save raw samples early and fail loudly on unexpected response shapes.
Implementation Contract
- Split client, settings, bootstrap, headers and cookies, sign, envelope, decode, extraction, retries, storage, and tests by concern.
- Bind one task project before writing and keep dynamic evidence under
js_reverse_cache/tasks/<task-id>/; do not use OS temp, Desktop drop folders, the skill directory, or hidden browser profiles as primary storage. - Keep stable scaffolding separate from volatile captures and generated runtime blobs.
- Catalog server-issued and locally computed state separately.
- Keep bootstrap-heavy acquisition and replay on one session chain until reuse is proven.
- Keep one baseline pure across UA/Client-Hints, cookies/storage, fingerprint surfaces, and transport/exit; see
references/env-diff-playbook.md. Distinguish a Chrome page-world replica from a local DOM host. Score host-fidelity L0-L4 (native count / sequence LCS / value feed / protocol param-set / eval sha256; not device-trust L0-L3 and not smoke L1-L4); canvas or navigator JS shims cannot be probe-counted. Do not feed foreign fingerprint caches into the run path (references/environment-patch-playbook.md). - Treat wire egress as authoritative when it differs from intermediate getters, callbacks, or cookie jars.
- Test transport admission separately when traffic dies before application semantics.
- Keep deterministic proof mode separate from live-generation mode.
- Keep every final helper self-contained and free of runtime-backed predecessor imports.
- When a final helper is stateful, make its lifecycle explicit and test both continuity and intentional reset; Python still owns live HTTP and the helper must not become a browser substitute.
- Reuse existing solved helpers only through
references/case-reuse-playbook.md: match by exact scope or multiple independent signals, run fixed vectors first, and never promote copied secrets or historical notes as current proof.
Use scripts/scaffold_reverse_project.py for a Python-first project, scripts/protocol_diff.py for request or response deltas, scripts/transport_profile_diff.py for structured TLS and H2 profile deltas, scripts/transform_trace_diff.py for staged runtime parity, and scripts/crypto_fingerprint.py for preliminary encoding or digest hints.
For reusable evidence, read references/reproducible-evidence-playbook.md; use scripts/evidence_normalizer.py to create a redacted ordered package, scripts/transcript_diff.py to locate the first chain divergence, and scripts/practice_lab.py to exercise positive and negative protocol controls offline.
The skill-owned loopback practice lab is deterministic fixture evaluation, not a fresh live target. Probe it with direct HTTP only; do not activate the live sequential Startup Gate (fingerprint-baseline / debugger-trace) for this self-test.
Verification and Reporting
Do not mark complete until every gate relevant to the declared shape passes:
- Startup Gate is current.
- For live claims, the real endpoint, canonical mutation point, and moving state are proven.
- For a fresh web
live-target, both first-pass roles (fingerprint-baselineanddebugger-trace) are recorded with their chosen means or explicit gaps. Gaps block page/runtime-understanding claims; only the strict transport-only direct-endpoint exception may still accept one endpoint-scoped runnable delivery.artifact-onlyweb work states those surfaces as unproven, and non-web primary targets are out of scope instead of inventing web browser proof. - Clean-baseline and observer effect risk are handled when relevant.
- Fixed-input helper or decoder checks pass.
- Non-empty or mint-shaped signs, plausible length, helper load, one HTTP
200, current cookies, stable reject JSON, gold-similarity, or mint-variant counts are not acceptance; morph lock on one gold sample is not a mainline mandate. - Cookie provenance, slot placement, session chain integrity, transport, envelope, decode, stream, pagination, and permission rules are documented when applicable.
- For
compact-replayandcollector, repeated live replay succeeds unless the accepted result is an explicitly bounded offline replay with live acceptance marked unproven. - Any final replay or collector runs without browser automation or browser profiles.
- Output is saved in the requested format.
- Sensitive artifacts are redacted outside a task-local secret store. A persisted normalized evidence package uses the evidence-specific manifest schema in
references/project-artifact-contract.md; runnable replay or collector manifests additionally record capability, session scope, helper, and replay evidence without copying secrets. A no-write conversational evidence result does not require a manifest file.
After each meaningful phase, use the concise phase-delta format from references/report-templates.md and fill browser_mode, curl impersonate, capsule major, business_request, unproven_routes, and next_action; use the full templates only for major decisions and final delivery. For compact-replay and collector, finish with its compact protocol handoff summary rather than creating redundant project documents. Always report family choice, what each available evidence surface proved, real endpoint, moving parts, misleading signals, fixed-input proof, final protocol path, collector/helper split, saved paths, browser-free status, and remaining instability. Add cookie, observer effect, sibling route, envelope-family, decode, session, pagination, or minimal-verifiable-fact details only when relevant.
When a reusable family emerges, preserve 5 to 15 structural facts using references/minimal-verifiable-facts-playbook.md. Keep a one-job lesson task-local; after two independent reproductions, use references/experience-card-schema.md to promote only the invariant, fixture, positive/negative oracles, and applicability boundary.
Reference Router
Load only references that match current evidence, but keep every route directly discoverable here.
Core workflow and maintenance
- focused Hook / env-patch / pure-Python routes: see Fast Routes and Ownership
references/profiles/browser-hook-snippets/index.mdreferences/profiles/static-ast/index.mdreferences/profiles/env-patch/index.mdreferences/runtime-state-continuity-playbook.mdreferences/pure-python-rebuild-playbook.mdreferences/startup-triage-playbook.mdreferences/workflow-overview.md(Phase 0-5 map, multi-stage settle, stage fields)references/tool-playbook.md- low-observer boundary value capture upgrade:
references/silent-value-capture-playbook.md - MCP family choice and signal-driven auto-judge: read
references/mcp-routing-playbook.mdwhen deciding among artifact-only, Camoufox/managed host, chrome-devtools, js-reverse, silent-value-capture, passive wire stores, wire visibility, or environment providers - local attach ports or debug profile path issues:
references/local-mcp-environment.md references/escalation-ladder-playbook.mdreferences/delivery-gate-playbook.mdreferences/anti-patterns-playbook.mdreferences/report-templates.mdreferences/doctrine-index.mdreferences/symptom-heuristics.mdreferences/pattern-atlas.mdreferences/minimal-verifiable-facts-playbook.mdreferences/provider-work-order.mdreferences/specialist-handoff-contract.md- claim upgrade / dual-surface confirmation:
references/evidence-corroboration-gate.md - local-vs-success causal isolation:
references/positive-sample-ablation-playbook.md - multi-surface morph/state-chain verifiers:
references/verifier-morph-and-state-chain-playbook.md - primary failure surface labels and stuck next action:
references/failure-surface-taxonomy.md - anti-bot class (signature-bound / interceptor / pure-obfuscation):
references/anti-bot-class-playbook.md references/project-artifact-contract.mdreferences/case-reuse-playbook.mdreferences/experience-card-schema.md- promoted secret-free cards:
references/experience-cards/page-local-exception-needs-negative-control.json,references/experience-cards/standard-primitive-concat-before-custom-port.json,references/experience-cards/signer-egress-stub-must-match-callsite.json,references/experience-cards/server-clock-must-enter-observed-writer.json
Request path, signers, and obfuscation
- signer stage parity and ordered replay failure ladder:
references/signer-parity-chain-playbook.md - VM/interceptor exit-first, nested standard-ISA memory-image, protobuf serializeBinary / wasm encode(i32,i32) before opcodes, reverse-trace, ALU-overlap ID; compile-body snapshots after param substitution are key material, not call traces;
fromCharCodeheat (million vs 0) diagnoses VM entry:references/jsvmp-analysis-playbook.md - modified standard digests, native-presence IV/Tj/per-round K/packing/compress branch selection (Node eval of a harvested digest is not the browser oracle) before porting constants, constant-pool concat before custom ports, named JSEncrypt/JSBN/RSA under statement-split still needs concat + PKCS#1 (freeze the pad string before gold-token policy; random padding makes inequality expected), missing block avalanche keeps the bundled helper, named AES/GCM that avalanches still needs packed-key / GCM-frame / gold-pair XOR / inner-field PRNG, decoy timestamp/PRNG wrappers versus inner hasher or a server-issued clock that must enter the observed writer (signer argument, query clock, or ajax success; not an inner Date freeze), two-stage mix (placeholder vs host; unpadded vs padded hex; length follows first-mix hex), size-fingerprint DES/3DES/AES/RC4 (short-vector 8-byte CT under a named AES is DES/3DES; host-object catch-paths can reorder cipher keys), TEA/XTEA family constants, key-in-bytecode recovery, uint32 ports, named MD5 timestamp dual-miss keeps the bundled helper, hasher-internal eval/setInterval of recovered R is a stub not a preimage, fixed-sample crypto:
references/crypto-patterns.md - string-table or obfuscator-style recovery, decoder integrity loops, rotating per-fetch write-slot, huge chart/painter wrappers vs tiny list-URL module:
references/obfuscation-guide.md,references/offline-inline-deob-playbook.md - HTML placeholder zeros with no list XHR; dummy HTTP filler does not retire a WebSocket list; chrome-devtools HTTP logs omit WebSockets; skip non-JSON WS prefix frames:
references/decoy-and-real-request-playbook.md,references/structured-transport-playbook.md - empty
beforeSendIIFE is not a signer; freeze the wire body:references/transport-wrapper-playbook.md references/patched-helper-playbook.md- opaque stages, collect-then-patch, nested memory-image, backend bakeoff, same-session nondeterministic feed:
references/opaque-runtime-profile-playbook.md
Cookies, bootstrap state, and sessions
- multi-layer business identity after login:
references/multi-context-session-playbook.md - cookie writer/refresh plus impersonate-jar hostname bind (empty-domain vs host-only split):
references/cookie-provenance-playbook.md references/session-contract-playbook.mdreferences/public-bootstrap-envelope-playbook.md- challenge primary key / same-round punish HTML / rotating document token / 200 filler-JSON punish / answer-accept vs complete latch:
references/challenge-state-envelope-playbook.md - dual writers for one param name, cookie vs query or in-memory global:
references/dual-writer-param-playbook.md - local challenge executor, init/observe/interact/sign, marker lifecycle, formal backend choice, helper identity is arity/I-O not URL; visual-oracle drag origin is box
x1not center; OCR/captcha-platform is diagnostic only, never collector runtime:references/local-challenge-executor-playbook.md - document-complete load-latch mint, cookie-vs-query WAF slots, rotating 202 JS, cookie vs window slot, 200 filler-value punish:
references/server-js-cookie-bootstrap-playbook.md references/side-asset-bootstrap-playbook.md
Host-bound runtime and observation
- heat vs causal host reads, page-world replica vs local DOM host, WebIDL FTS,
window.evalconstructors, Proxy-toxic live collections; expose webpack__wpRequireand skip UI$mount;setTimeoutmust never run the callback synchronously (drive with__drainTimers__); fake canvas/audio can be enough for a cookie-mint helper once impersonate already returns business 200; CDP webdriver configurable delete before Camoufox:references/environment-patch-playbook.md - local vendor fingerprint SDK runtime:
references/local-sdk-env-patch-playbook.md references/embedded-browser-runtime-playbook.md- mixed script charset, unnamed meta content,
page.loadbaseURL, ThreadPool isolate, Node decoy mint vs native host:references/iv8-runtime-cheatsheet.md - public multi-arity export oracle before encrypt-chain rebuild; cookie/redirect still win:
references/challenge-artifact-harvest-playbook.md - observer-toxic wraps on
Number.prototype.toString,TextEncoder.encode, and Proxy of TypedArray / live collections; Function-constructor/evalcompile-body after param substitution is key material; never wrap globalFunction.prototype.apply/call;Array.joincan expose plaintext:references/hook-techniques.md Function("debugger")/Function("while (true) {}")hangs including live js-reverse re-calls, exact-body strip only, a dead!==around one constructor does not clear attach, decoder integrity loops, debugger opcodes, hasher-internal eval/setInterval of recovered R (stub hosts, keep digest), MCP select_page timeout is debugger_attach_gap then offline harvest, JSVMP XHR silence from webdriver is not attach hang:references/anti-debug-playbook.md
Transport, decode, and structured protocols
- async export, report download, task isolation:
references/async-export-job-playbook.md - sibling-200 plus this-route stdlib 403: ablate installed curl impersonate on the same admitted token bytes before restarting signer or canvas reverse:
references/transport-pre-gate-playbook.md references/native-transport-profile-playbook.md- CSS-in-HTML sprite hide-class / in-flow offset / image-byte identity, font or glyph maps, JSON numeric CR/LF strip:
references/response-decode-playbook.md - UTF-8 MCP dumps corrupt protobuf; capture hex at serializer; stale clock-bucket tokens 403; skip non-JSON WebSocket prefix/ack frames:
references/structured-transport-playbook.md references/stateful-stream-e2ee-playbook.md
Verifiers, pagination, exceptions, and recovery
- device-trust companion gates / L0-L3:
references/device-trust-sidecar-playbook.md - local fingerprint SDK env patch:
references/local-sdk-env-patch-playbook.md - gateway/grant/business accept, same-world, profile identity, retry/smoke ladder; source class is orthogonal to ownership class:
references/verifier-replay-playbook.md,references/parameter-ownership-playbook.md - issued challenge image/token must be consumed; unused fetch can poison a session pass-rate; accept-rate and reject-rate may be different metrics:
references/challenge-state-envelope-playbook.md references/verifier-error-localization-playbook.md- multi-surface morph/state-chain gates:
references/verifier-morph-and-state-chain-playbook.md - positive-sample hygiene and post-hygiene behavior calibration:
references/positive-sample-hygiene-playbook.md references/pagination-route-pivot-playbook.mdreferences/page-specific-exception-playbook.md- stuck next action then symptom recipes:
references/troubleshooting-playbook.md
Skill validation
- maintenance, official suite, and independent behavioral review:
references/skill-maintenance.md,references/official-self-test-task-suite.md,references/forward-testing-playbook.md
Maintaining This Skill
Before editing, read references/skill-maintenance.md. Validate against references/official-self-test-task-suite.md and run scripts/validate_skill.py when present. The default validation is static; run scripts/validate_skill.py --run-trusted-self-tests only against the trusted current skill root. Use scripts/validate_skill.py --export-tests <path-outside-skill> when a machine-readable JSON suite is needed; keep the Markdown suite as the single source of truth. Static PASS is not behavioral proof. For a behavioral non-regression claim, follow references/forward-testing-playbook.md and validate an external fresh-runner, independent-reviewer report with scripts/forward_test_report.py; keep the report and response artifacts outside this skill tree.
Put reusable detail in its most specific reference. Keep this entry as the protocol-first execution path and direct router. Preserve generic facts and fixed vectors, never live secrets, copied cookies, account tokens, or site-specific folklore.
Bottom Line
When a site looks browser-only, ask what the real request is, which state really changes, and whether that state can be rebuilt locally.
Most targets collapse once those questions are answered with wire evidence and repeatable replay.