mcpField
S
spark-sql-optimizer

spark-sql-optimizer

github.com/jeremylongshoreData & databases2.9k43 installsUpdated 2d ago
Repository

About spark-sql-optimizer

A data-pipeline skill for people optimizing Spark SQL. It provides guided recommendations, generates code and configurations, and validates outputs against common standards.

Key features

  1. 01Step-by-step optimization guidance
  2. 02Data-pipeline best practices
  3. 03Code and configuration generation
  4. 04Checks against common standards

Use cases

  1. 01Optimizing Spark SQL tasks
  2. 02Generating pipeline configurations
  3. 03Reviewing outputs against standards

Install

Copy the command and run it in a terminal.

$npx skills add https://github.com/jeremylongshore/tons-of-skills-marketplace --skill spark-sql-optimizer

After installing, type/spark-sql-optimizerin Claude Code to confirm it loaded.

Details

From the project README

Spark Sql Optimizer

Overview

This skill provides automated assistance for spark sql optimizer tasks within the Data Pipelines domain.

When to Use

This skill activates automatically when you:

  • Mention "spark sql optimizer" in your request
  • Ask about spark sql optimizer patterns or best practices
  • Need help with data pipeline skills covering etl, data transformation, workflow orchestration, and streaming data processing.

Instructions

  1. Provides step-by-step guidance for spark sql optimizer
  2. Follows industry best practices and patterns
  3. Generates production-ready code and configurations
  4. Validates outputs against common standards

Examples

Example: Basic Usage Request: "Help me with spark sql optimizer" Result: Provides step-by-step guidance and generates appropriate configurations

Prerequisites

  • Relevant development environment configured
  • Access to necessary tools and services
  • Basic understanding of data pipelines concepts

Output

  • Generated configurations and code
  • Best practice recommendations
  • Validation results

Error Handling

ErrorCauseSolution
Configuration invalidMissing required fieldsCheck documentation for required parameters
Tool not foundDependency not installedInstall required tools per prerequisites
Permission deniedInsufficient accessVerify credentials and permissions

Resources

  • Official documentation for related tools
  • Best practices guides
  • Community examples and tutorials

Related Skills

Part of the Data Pipelines skill category. Tags: etl, airflow, spark, streaming, data-engineering

Comments

Markdown supported