dbt DAG Optimization Architect
Architect and optimize dbt DAGs for peak performance
What You Can Do
You analyze your dbt project's DAG structure to identify performance bottlenecks, circular dependencies, and architectural anti-patterns. Claude provides concrete materialization recommendations, dependency optimization strategies, and refactoring guidance to reduce build times and improve maintainability while preserving data lineage.
Features
identify which models constrain overall build performance
find and break problematic dependency loops that prevent incremental refreshes
decide between table, incremental, view, and ephemeral based on refresh cadence and downstream usage
pinpoint slow-running models and suggest optimization approaches (incremental loads, dbt+python, database-level optimization)
evaluate test distribution across DAG and identify untested critical nodes
auto-generate markdown or Mermaid diagrams showing data flows with business context
review custom macros for redundancy, performance, and compliance with dbt best practices
compare build metrics before and after changes to validate improvements
Example Output
Critical Path Analysis Report:
- Identified
fct_transactions(22 min) as critical path bottleneck - Recommended converting to incremental + partition by date (est. 3 min)
- Dependency map shows 8 downstream fact tables blocked by this single model
Materialization Recommendations:
model_name | current | recommended | reasoning
fct_daily_agg | table | incremental | 2GB daily volume, business needs fresh data hourly
dim_customer | table | snapshot | Slow-changing dimension, captures SCD Type 2 updates
stg_orders | view | ephemeral | Only consumed by 1 downstream model, ephemeral avoids materialization
Refactoring Workflow:
- Add
incremental+unique_keyto critical models - Extract shared logic into staging models (reduce redundancy)
- Move complex transformations to database views (push computation down)
- Add freshness SLAs to staging layer
What's Included
- SKILL.md: DAG audit workflows, optimization decision trees, and performance tuning playbooks
- DAG Analysis Template: structured checklist for parsing dependencies and identifying patterns
- Materialization Decision Matrix: table comparing refresh cadence, volume, and downstream usage patterns
- Performance Benchmarking Checklist: before/after metrics, profiling queries, and measurement framework
- Dependency Refactoring Guide: step-by-step workflow for breaking circular dependencies and reorganizing layers
Who It's For
- Analytics Engineering Leads — audit team dbt projects and enforce architectural standards
- dbt Architects — design scalable DAG structures for enterprise data platforms
- Data Platform Teams — optimize shared dbt projects used by multiple business units
- Senior Analytics Engineers — refactor complex projects to reduce technical debt
- Data Engineering Managers — benchmark build performance and identify team workflow improvements
Best For
- Auditing inherited or legacy dbt projects — quick assessment of architectural health and performance risks
- Redesigning DAG structure — breaking monolithic projects into modular layers (raw → staging → intermediate → mart)
- Optimizing slow builds — profiling and refactoring models that dominate CI/CD runtime
- Incremental model strategy — deciding which models should use incremental loads vs. full refreshes
- Documenting lineage and business context — generating lineage diagrams and data dictionaries
You might also like
Build complete B2C campaign launch plans from positioning through execution. You'll segment audiences based on behavior and value, architect cohesive messaging for each segment, design optimal channel mixes, and establish measurable success metrics tied to business outcomes. Get a ready-to-execute campaign blueprint that coordinates positioning, creative, channels, and performance tracking.
by lurenyang418
You can extract, structure, and synthesize consumer insights from multiple research sources including interviews, surveys, and social listening data. This skill transforms raw qualitative and quantitative data into clear, actionable findings and detailed consumer personas that inform product, marketing, and business strategy decisions.
by lurenyang418
You'll analyze competitor positioning, market strategies, and business models to generate actionable competitive intelligence reports. This skill synthesizes public data, customer research, and market trends into structured competitive analysis that informs product strategy, pricing, and go-to-market decisions. Get clear competitive advantages, threat assessments, and market opportunity summaries without hours of manual research.
by lurenyang418
This skill analyzes consumer data, behavior patterns, and feedback to extract actionable insights. You can synthesize raw data into coherent market trends, identify consumer segments, and generate strategic recommendations. Perfect for understanding your audience at scale and uncovering hidden opportunities in consumer preferences and market dynamics.
by lurenyang418
Analyze your current brand perception, competitive position, and market gaps to develop a comprehensive repositioning strategy. You'll receive a differentiated positioning statement, messaging architecture, competitive analysis, and a tactical 90-day implementation roadmap that your team can execute immediately.
by lurenyang418
Transform raw research data from surveys, interviews, focus groups, and social listening into validated consumer insights grounded in evidence. You'll automatically identify customer segments, map their pain points, detect emerging trends, and generate strategic recommendations that connect research to business decisions. This skill helps you move from scattered findings to a unified market intelligence strategy that stakeholders can act on.
by lurenyang418
You upload interview transcripts, survey responses, or focus group data, and this skill systematically extracts themes, patterns, and relationships using proven thematic coding frameworks. It moves beyond raw data to deliver actionable strategic insights, complete with prioritization and visualization recommendations. The result is a structured, evidence-based foundation for decision-making.
by lurenyang418
Develop comprehensive go-to-market strategies that align sales, marketing, and product teams. This skill helps you analyze your target market, design multi-channel campaigns, define success metrics, and create detailed launch roadmaps. You'll get strategic frameworks, competitive analysis, and actionable campaign plans tailored to your B2B business.
by lurenyang418