More screenshots

    Works with the AI Agents you already use

    Claude CodeClaude CodeCursorCursorCodex CLICodex CLIDeepSeekDeepSeekMuseMuse+22 more

    Data Storage and Architecture

    1

    Model warehouses, lakehouses, Iceberg and data mesh. 10 ordered skills, starting with Dimensional Modeling, Modern Data Warehouse, Data Lakehouse.

    Free

    Security scanned
    Data Storage and Architecture

    Data Storage and Architecture

    Example session with this skill installed

    We have a slow query on our Iceberg table in Snowflake. Users filter by event_timestamp. Can you review our partition spec and suggest how to evolve it without a full rewrite?

    • Read your context and instructions
    • Compiled the data storage

    I have analyzed the partitioning requirements for your Iceberg table. Since users frequently filter by event_timestamp, the current identity partitioning is likely creating too many small files or scanning too much data if the granularity is off.

    Iceberg Partition Evolution Plan

    ComponentCurrent StateProposed ChangeRationale
    Partition Transformidentity(event_timestamp)days(event_timestamp)Reduces manifest size and metadata overhead for daily queries.
    Evolution MethodManual RewriteALTER TABLE ... SET PARTITION SPECIceberg supports in-place evolution; old data stays in old layout, new data uses new layout.
    File CompactionFragmented small filesrewrite_data_filesUse the Spark or Trino procedure to bin-pack existing small files into larger Parquet files.
    Format Versionv1v2Required if you plan to use row-level deletes (merge/update) efficiently with the new spec.
    -- Step 1: Evolve the partition spec (Metadata only change)
    ALTER TABLE events_table SET PARTITION SPEC (
      days(event_timestamp)
    );
    
    -- Step 2: Optimize existing data to the new layout (Optional but recommended)
    -- This prevents the "split-brain" performance where old data is still slow
    CALL system.rewrite_data_files(
      table => 'events_table',
      options => map('target-file-size-bytes', '536870912') -- 512MB target
    );
    

    Next steps

    1. Run EXPLAIN on a typical query to see if the optimizer is currently hitting ManifestList bottlenecks.
    2. Confirm your engine version (Snowflake/Spark/Trino) supports Iceberg Spec v2 if enabling row-level deletes.
    3. Schedule a snapshot expiration job to clean up metadata files after the rewrite.

    Connects securely to your tools. The creator never sees your data.

    About this skill

    The problem

    Data architects often need a repeatable process, not a one-off prompt. This pack targets: Model warehouses, lakehouses, Iceberg and data mesh.

    What's inside (10 skills, suggested learning order)

    1. Dimensional Modeling — Star schemas for analytics.
    2. Modern Data Warehouse — Design cloud warehouses.
    3. Data Lakehouse — Unify lake and warehouse.
    4. Apache Iceberg — Open table format.
    5. Data Mesh — Decentralized data architecture.
    6. Relational Data Modeling — Design database schemas.
    7. SQL Query Optimization — Improve SQL performance.
    8. Data Warehouse Automation — Automate modeling and loading.
    9. Enterprise Data Architecture — Design data platforms.
    10. DataOps Operations — Apply DevOps practices to data.

    Why a skill pack instead of a one-off prompt

    Each skill gives the agent a defined trigger, step-by-step procedure and output format, so results are consistent across sessions and easier to review.

    How to use

    1. Install the pack in your SKILL.md-compatible agent.
    2. Ask for the task in plain language.
    3. Review the output against the skill's quality checks before using it.

    Known limitations

    • Outputs are drafts that need human review; they are not professional, legal or financial advice.
    • Tools, APIs and prices change; check current vendor documentation before relying on version-specific details.
    • Quality depends on the context you give the agent (data, requirements, constraints).
    • Tested only where stated in the Compatibility note.

    Also by Rodrigo Santos

    Specialized Agents and Distribution; AI Agents: Fundamentals and Protocols; Model Fine-Tuning and Alignment

    Find more skills like this on the Claude Skills Marketplace, the Codex Skills Marketplace and the Gemini Skills Marketplace, or browse Claude Skills for Data & Databases.

    Does not tune non-relational DBs. Architecture focus is limited to data domains (lakehouse, mesh, warehouse). Requires engine versions for specific feature support.

    How to use

    1. 1

      Connect your agent to the Agensi MCP

      Copy the prompt and paste it into Claude, ChatGPT, Cursor or any agent that supports MCP. It sets up the connection for you. Manual setup

    2. 2

      Sign in to Agensi

      Your agent shows a sign-in link. Sign in and click Allow.

    3. 3

      Ask for what you need

      Your agent loads this skill and uses it on your task. It always asks before buying a skill.

    Reviews

    No reviews yet

    Be one of the first to try it. Every listed skill goes through the trust checks below.

    Security scanned

    Checked by our 8-point scan before listing

    Fresh listing

    Recently published to Agensi

    Free to use

    No account required to browse

    Trust & safety

    Security scan

    Security scan passed 3 days ago

    • Free with an Agensi account

    Permissions

    Read Files
    Listed3 days ago

    What's inside

    Frequently Asked Questions

    This skill is designed for advanced Large Language Models (LLMs) integrated into agentic workflows that have access to your data warehouse metadata or IDE. It is optimized for environments where the agent can interact with tools like dbt, Snowflake, or Apache Iceberg catalogs.

    Beyond simple SQL generation, this skill enforces 'spec-grounded' design, meaning it understands table grain, Iceberg manifest structures, and Kimball modeling principles. It prevents common architectural failures like partition bloat or circular dependencies that generic prompts often overlook.

    The skill supports modern cloud warehouses (Snowflake, BigQuery, Redshift), transactional databases (PostgreSQL), and open table formats (Apache Iceberg, Delta Lake, Apache Hudi). It also includes specialized patterns for dbt-based transformation pipelines.

    You receive a comprehensive set of engineering blueprints, metadata-driven automation patterns, and systematic procedures for query optimization and DataOps implementation. These are delivered as a ready-to-use skill package for your agent's toolkit.

    No, this skill is specifically focused on relational and analytical data structures. It does not provide optimization or architectural design for NoSQL, vector, or graph databases.

    Updates are released periodically to include the latest engine-specific optimizations and new table format features. All purchasers receive lifetime access to version updates for this skill as the data ecosystem evolves.

    New in Data & Databases

    Free