mcpField
D
data-processing

data-processing

github.com/0xdarkmatterData & databases78109 installsUpdated 2w ago
Repository

About data-processing

A command-line data-processing skill for working with structured JSON, YAML, and TOML. It covers jq and yq patterns for querying, filtering, transforming, and editing files and data from common development workflows.

Key features

  1. 01JSON queries with jq
  2. 02YAML and TOML processing with yq
  3. 03Array filtering and transformation
  4. 04Configuration-file editing
  5. 05Format conversion and output options

Use cases

  1. 01Extracting dependencies from package.json
  2. 02Inspecting Docker Compose or Kubernetes configuration
  3. 03Filtering API response data
  4. 04Editing YAML configuration files

Install

Copy the command and run it in a terminal.

$npx skills add https://github.com/0xdarkmatter/claude-mods --skill data-processing

After installing, type/data-processingin Claude Code to confirm it loaded.

Bundled files

References and scripts installed along with SKILL.md.

assets/
.gitkeep
references/
config-files.md
jq-patterns.md
yq-patterns.md
scripts/
.gitkeep

Details

From the project README

Data Processing

Query, filter, and transform structured data (JSON, YAML, TOML) efficiently from the command line.

Tools

ToolCommandUse For
jqjq '.key' file.jsonJSON processing
yqyq '.key' file.yamlYAML/TOML processing

jq Essentials

# Extract single field
jq '.name' package.json

# Extract nested field
jq '.scripts.build' package.json

# Extract from array
jq '.dependencies[0]' package.json

# Extract multiple fields
jq '{name, version}' package.json

# Navigate deeply nested
jq '.data.users[0].profile.email' response.json

# Filter by condition
jq '.users[] | select(.active == true)' data.json

# Transform each element
jq '.users | map({id, name})' data.json

# Count elements
jq '.users | length' data.json

# Raw string output
jq -r '.name' package.json

yq Essentials

# Extract field
yq '.name' config.yaml

# Extract nested
yq '.services.web.image' docker-compose.yml

# List all keys
yq 'keys' config.yaml

# List all service names (Docker Compose)
yq '.services | keys' docker-compose.yml

# Get container images (K8s)
yq '.spec.template.spec.containers[].image' deployment.yaml

# Update value (in-place)
yq -i '.version = "2.0.0"' config.yaml

# TOML to JSON
yq -p toml -o json '.' config.toml

Quick Reference

Taskjqyq
Get fieldjq '.key'yq '.key'
Array elementjq '.[0]'yq '.[0]'
Filter arrayjq '.[] | select(.x)'yq '.[] | select(.x)'
Transformjq 'map(.x)'yq 'map(.x)'
Countjq 'length'yq 'length'
Keysjq 'keys'yq 'keys'
Pretty printjq '.'yq '.'
Compactjq -cyq -o json -I0
Raw outputjq -ryq -r
In-place edit-yq -i

When to Use

  • Reading package.json dependencies
  • Parsing Docker Compose configurations
  • Analyzing Kubernetes manifests
  • Processing GitHub Actions workflows
  • Extracting data from API responses
  • Filtering large JSON datasets
  • Config file manipulation
  • Data format conversion

Additional Resources

For complete pattern libraries, load:

  • ./references/jq-patterns.md - Arrays, filtering, transformation, aggregation, output formatting
  • ./references/yq-patterns.md - Docker Compose, K8s, GitHub Actions, TOML, YAML modification
  • ./references/config-files.md - package.json, tsconfig, eslint/prettier patterns

Comments

Markdown supported