mcpField
S
search-discovery-relevance-review

search-discovery-relevance-review

github.com/sylphxaiDesign & UI142 installsUpdated today
Repository

About search-discovery-relevance-review

A skill for teams reviewing search and discovery quality. It structures questions about relevance, ranking, filters, zero-result handling, and user trust into an audit and improvement plan with evaluation criteria and ownership.

Key features

  1. 01Maps corpus, intents, and ranking surfaces
  2. 02Separates retrieval, filtering, and ranking
  3. 03Defines relevance evaluations and feedback signals
  4. 04Plans zero-result recovery and rollout
  5. 05Produces audits, decision tables, and checklists

Use cases

  1. 01Auditing search relevance
  2. 02Investigating zero-result queries
  3. 03Reviewing ranking changes before launch
  4. 04Assessing personalization and trust risks

Install

Copy the command and run it in a terminal.

$npx skills add https://github.com/sylphxai/skills --skill search-discovery-relevance-review

After installing, type/search-discovery-relevance-reviewin Claude Code to confirm it loaded.

Bundled filesagents/openai.yamlreferences/search-discovery-relevance-patterns.md

Details

From the project README

Search Discovery Relevance Review

Use this skill to convert a search, discovery, relevance quality, filters, ranking drift, zero-results, and user trust question into a concrete artifact with owners, gates, metrics, and recovery paths.

Workflow

  1. Identify searchable corpus, user intents, query types, ranking surfaces, business incentives, cold-start items, and harm from bad relevance.
  2. Read references/search-discovery-relevance-patterns.md.
  3. Separate retrieval, filtering, ranking, personalization, editorial curation, sponsored placement, and moderation eligibility.
  4. Define quality evals, query logs, zero-result recovery, feedback signals, fairness checks, ranking-change rollout, and support/debug tools.
  5. Produce relevance audit, state machine, decision table, event schema, eval set, and launch checklist.

When not to use

  • Do not use for generic advice the base model already handles without this skill's specific artifact contract.

Guardrails

  • Do not mix paid placement, editorial quality, eligibility, and organic ranking without labels and governance.
  • Do not optimize clicks alone when long-term satisfaction, retained value, or abuse matters.
  • Do not hide zero-result or low-confidence states behind random filler results.
  • Do not personalize sensitive categories without privacy, fairness, and user control review.

Output format

Discovery context:
Corpus / intent / ranking surface / trust risk:

Relevance improvement plan:
| Area | Decision | Evidence | Risk | Owner |
| --- | --- | --- | --- | --- |

Signals and evals:
- <item> -> <policy, metric, edge case, support note>

Ranking rollout and recovery:
- <trigger> -> <action, communication, owner>

Comments

Markdown supported