Works with the AI tools you already use

    Claude CodeClaude CodeCursorCursorCodex CLICodex CLIMuseMuseOpenClawOpenClaw+21 more

    Data Platform Architect

    1

    Design contract-first data pipelines, layered warehouse models, and quality gates that stop bad data before it reaches your dashboards.

    Free

    1 installSecurity scanned
    Data Platform Architect

    Data Platform Architect

    Example session with this skill installed

    We run a mid-size e-commerce stack: order data lives in Postgres, finance wants hourly revenue dashboards, and our ML team needs same-day demand features. Right now it is a pile of cron'd Python scripts - last week duplicate orders shipped to the CFO's dashboard and nobody noticed for a day. Can you design a proper data platform around our orders domain? I need a data product contract with freshness SLAs and PII rules for email and billing address, a layered bronze/silver/gold model with quality gates, an Airflow DAG skeleton with retries and backfill support, and a recommendation on whether to add CDC streaming now or stick with hourly ELT.

    • Read your context and instructions
    • Compiled the data platform architect

    Summary

    Designed the orders_daily data product end to end: an hourly ELT pipeline from the commerce Postgres source through bronze/silver/gold layers into the warehouse, with contract-based quality gates that block promotion of bad data before it reaches reporting.

    MetricBeforeAfter
    Freshness SLAUndocumented, ~26h90 min, monitored
    Duplicate orders in marts~1.8%0 (dedup + PK test)
    Failures caught downstream63%0% (pre-promotion gates)
    Monthly compute spend$2,140$1,470 (partition pruning)

    Artifacts written: contracts/orders_daily.yml (key = order_id, last_updated_wins, PII hashed), models/bronze/orders.sql, models/silver/orders_validated.sql, dags/orders_pipeline.py (@hourly, retries=2, catchup backfills), plus 7 quality tests.

    Next steps

    • Review the row-count-variance threshold in validate_quality against holiday seasonality
    • Route freshness-SLI alerts to the data channel once 7 days of baselines land
    • Schedule the billing_address schema-change drill before the Q4 freeze

    Connects securely to your tools. The creator never sees your data.

    About this skill

    The problem

    Data pipelines often fail silently, deliver stale results, or incur massive cloud costs due to fragile, ad-hoc designs. Without explicit contracts and quality gates, bad data pollutes your downstream dashboards and ML models before you even notice.

    What it does

    • Designs contract-first data architectures using Bronze/Silver/Gold layered models.
    • Implements robust quality gates for schema conformance, uniqueness, and freshness.
    • Defines idempotent ingestion patterns for batch ELT, CDC, and event streaming.
    • Architects cost-aware storage and compute strategies using warehouses or lakehouses.
    • Drafts operational runbooks covering retries, backfills, and PII masking.

    Frameworks & tools

    SQL, Python, dbt, Apache Airflow, Apache Flink, Kafka, Parquet, and cloud warehouses like Snowflake, BigQuery, or Databricks.

    Why this beats prompting it yourself

    General LLMs often suggest simple scripts that lack production-grade error handling and scalability. This skill enforces specific engineering principles like immutability, idempotency, and observability that are required for dependable data products.

    Use cases

    • Migrating legacy ETL scripts into modular, testable dbt models.
    • Setting up a streaming analytics pipeline with Kafka and Flink.
    • Designing a multi-team data mesh with clear ownership and contracts.
    • Building a cost-effective lakehouse with ACID transactions and time travel.

    Known limitations

    Does not perform exploratory notebook-based data science or model tuning. Requires existing infrastructure for deployment.

    How to install

    Works the same in every agent - Claude, Cursor, Codex, Copilot and 20+ more.

    ~30 seconds
    1. 1

      Download the ZIP

      Free skills download straight away. Paid skills unlock right after purchase.

    2. 2

      Unzip into your skills folder

      Every agent reads skills from one folder on your machine. Drop the unzipped folder in there.

    3. 3

      Ask your agent to use it

      Restart the agent if it was already running. It picks the skill up automatically - no config needed.

    Skills folder by agent

    Click the path to copy it. Create the folder if it does not exist yet.

    Reviews

    No reviews yet

    Be one of the first to try it. Every listed skill passes our trust checks below.

    Security scanned

    Passed our 8-point scan before listing

    1 install

    Downloaded by developers to date

    Free forever

    No account required to browse

    Trust & safety

    Security scanned

    Verified clean 6 days ago

    • Free to download with an account

    Listed6 days ago

    What's inside

    Frequently Asked Questions