mcpField
P
project-referee

project-referee

github.com/sundial-orgProductivity15362 installsUpdated 15w ago
Repository

About project-referee

Project Referee is a manuscript-review skill for assessing research papers at early, mid, or final stages. It structures feedback around stage-specific criteria, related-work searches, and a reviewer form, with extra guidance for neuro-symbolic papers.

Key features

  1. 01Stage-specific review criteria
  2. 02Assess novelty and feasibility
  3. 03Search for related work
  4. 04Structured reviewer feedback
  5. 05Additional neuro-symbolic criteria

Use cases

  1. 01Review an early research draft
  2. 02Check progress on a mid-stage manuscript
  3. 03Prepare feedback for a final submission
  4. 04Assess an LLM and symbolic-reasoning paper

Install

Copy the command and run it in a terminal.

$npx skills add https://github.com/sundial-org/skills --skill project-referee

After installing, type/project-refereein Claude Code to confirm it loaded.

Bundled filesreferences/neuro-symbolic-review-criteria.mdreferences/reviewer-instructions.md

Details

From the project README

Project Referee

Review Workflow

Step 1: Assess Manuscript Stage

Ask or determine the manuscript stage:

  • Early draft: Focus on novelty, feasibility, relevance, structure
  • Mid-stage draft: Focus on development trajectory, completeness, preliminary results
  • Final submission: Apply full review criteria (see references/reviewer-instructions.md)
Step 2: Stage-Specific Review

Early Draft Protocol:

  1. Assess core contribution novelty and significance
  2. Evaluate method feasibility with current technology
  3. Check alignment with venue scope
  4. Review logical structure and completeness
  5. Identify major missing components
  6. Suggest high-level direction

Mid-Stage Protocol:

  1. Evaluate development progress
  2. Check section completeness
  3. Assess preliminary results against claims
  4. Review literature coverage
  5. Identify specific weaknesses
  6. Provide targeted refinements

Final Submission Protocol: Apply complete review process. See references/reviewer-instructions.md for the full reviewer form.

Step 3: Search for Related Work

Proactively search for missing citations:

  • Recent work in the paper's domain
  • Papers with similar methods or contributions
  • Relevant benchmarks and baselines
  • Use WebSearch to find recent publications
Step 4: Provide Structured Feedback

Use the output format in references/reviewer-instructions.md:

  • Summary, Strengths, Weaknesses, Questions
  • Soundness (1-4), Presentation (1-4), Contribution (1-4)
  • Overall Score (1-10), Confidence (1-5)

Neuro-Symbolic Papers

For papers combining LLMs with symbolic reasoning, see references/neuro-symbolic-review-criteria.md for additional criteria:

  • Symbolic formulation quality
  • Solver selection and integration
  • Faithfulness and verification
  • Comparison to baselines (Logic-LM, LINC)

References

Comments

Markdown supported