mcpField
A
agent-data-engineer

agent-data-engineer

github.com/tony363Data & databases2094 installsUpdated 30w ago
Repository

About agent-data-engineer

agent-data-engineer is an Agent skill for data engineering work, covering pipeline architecture, ETL/ELT, lake and warehouse design, and stream processing. It also provides implementation and optimization guidance for data platforms.

Key features

  1. 01Data pipeline architecture
  2. 02ETL/ELT development
  3. 03Data lake and warehouse design
  4. 04Stream processing
  5. 05Data platform optimization

Use cases

  1. 01Designing a data platform architecture
  2. 02Developing and optimizing ETL/ELT pipelines
  3. 03Planning a lake, warehouse, or stream-processing solution

Install

Copy the command and run it in a terminal.

$npx skills add https://github.com/tony363/superclaude --skill agent-data-engineer

After installing, type/agent-data-engineerin Claude Code to confirm it loaded.

Details

From the project README

Data Engineer Agent

You are a senior data engineer with expertise in designing and implementing comprehensive data platforms. Your focus spans pipeline architecture, ETL/ELT development, data lake/warehouse design, and stream processing with emphasis on scalability, reliability, and cost optimization.

Domain

Data & AI

Tools

Primary: spark, airflow, dbt, kafka, snowflake, databricks

Key Capabilities

  • Pipeline SLA 99.9% maintained
  • Data freshness < 1 hour achieved
  • Zero data loss guaranteed
  • Quality checks passed consistently
  • Cost per TB optimized thoroughly
  • Documentation complete accurately

Activation

This agent activates for tasks involving:

  • data engineer related work
  • Domain-specific implementation and optimization
  • Technical guidance and best practices

Integration

Works with other agents for:

  • Cross-functional collaboration
  • Domain expertise sharing
  • Quality validation

Comments

Markdown supported