MLOps System Diagnostic & Troubleshooting
Diagnose ML pipeline failures in minutes with structured log analysis
What You Can Do
You can rapidly identify root causes of training failures, data pipeline breakdowns, and model serving issues by analyzing logs, metrics, and infrastructure state. Claude examines your system events, resource utilization patterns, and error traces to pinpoint performance bottlenecks, data quality problems, and deployment misconfigurations—then recommends targeted remediation steps.
Features
Convert unstructured logs into searchable diagnostic timelines with event correlation
Trace failures back to their origin (data, compute, configuration, dependency)
Spot training slowdowns, GPU utilization issues, and I/O contention
Detect schema drift, missing values, distribution anomalies in training data
Analyze latency, throughput, and error rates in inference pipelines
Correlate errors across microservices, workers, and cloud infrastructure
Identify memory leaks, CPU saturation, disk space issues, and network congestion
Create step-by-step remediation guides from diagnostic findings
Example Output
Example 1: Training Failure Diagnosis
Symptom: Training job OOM-killed after 2 hours
Claude Analysis:
✓ Identified: Batch size 256 + gradient accumulation 4 = effective batch 1024
✓ Bottleneck: GPU memory 80GB insufficient for model + optimizer state
✓ Timeline: Memory usage grew 15% per epoch (no weight decay regularization)
✓ Recommendation: Reduce batch to 128, enable gradient checkpointing, add L2 regularization
Example 2: Data Pipeline Stall
Symptom: Daily ETL hangs, training waits 6+ hours for data
Claude Analysis:
✓ Root cause: CSV read operation on 500GB file via single process
✓ Bottleneck: S3 download bandwidth 50MB/s (3 hours), parsing 200MB/s (50 mins)
✓ Contributing factor: No partitioning strategy; full scan on every run
✓ Recommendation: Enable columnar format (Parquet), add time-range partitioning, parallelize reads (8 workers)
✓ Expected speedup: 6h → 45 min
Example 3: Model Serving Latency
Symptom: p95 inference latency 500ms (target 50ms)
Claude Analysis:
✓ Profiled request breakdown: Model inference 15ms + preprocessing 350ms + postprocessing 100ms
✓ Bottleneck: Preprocessing serializes NLP tokenization on CPU
✓ Issue: Model deployed on single GPU; 100 concurrent requests queue
✓ Recommendation: Batch tokenization, add GPU queue, deploy 4 replicas behind load balancer
✓ Expected p95 latency: 500ms → 65ms
What's Included
- SKILL.md: Full diagnostic workflows with decision trees for training, data, and serving failures
- Log Analysis Template: Structured checklist for parsing and correlating events
- Performance Profiling Guide: Step-by-step GPU/CPU/memory/I/O analysis framework
- Data Quality Verification Checklist: Schema, completeness, distribution validation
- Incident Response Runbook: Diagnostic questions and remediation workflow
- Metrics Collection Checklist: Essential metrics to capture for future debugging
- Troubleshooting Decision Tree: Flowchart to narrow failure category quickly
- Post-Incident Review Template: Lessons learned and prevention measures
Who It's For
- ML Engineers — Diagnosing failed training runs and production model issues
- MLOps Engineers — Troubleshooting infrastructure, pipeline orchestration, and resource constraints
- Data Engineers — Identifying data quality issues, ETL bottlenecks, and schema problems
- Platform/DevOps Teams — Debugging distributed systems, Kubernetes deployments, cloud service issues
- Incident Response Teams — Rapidly responding to model serving outages and training failures
Best For
- Training job failures — OOM errors, convergence issues, data loading timeouts, GPU/TPU utilization problems
- Data pipeline breakdowns — ETL stalls, schema drift, missing data, slow ingestion, partitioning issues
- Model serving incidents — High latency, throughput degradation, error spikes, cold start delays
- Performance optimization — Identifying and resolving bottlenecks in training, inference, and data pipelines
- Infrastructure debugging — Resource contention, Kubernetes pod evictions, cloud quota issues, network congestion
You might also like
Rapidly analyze production incidents by correlating observability signals—logs, metrics, traces, and events—to identify the true root cause instead of symptoms. You'll reconstruct incident timelines, quantify impact scope, and generate both immediate remediation steps and long-term prevention measures.
Claude analyzes your code diffs and generates standardized commit messages that follow the Conventional Commits specification. The skill automatically determines the correct commit type, scope, and description based on the changes you've made, ensuring your messages are parseable by automation tools while remaining human-readable for code reviewers.
You'll transform high-level feature requirements into a complete development plan covering API design, frontend implementation, testing strategy, and documentation. The skill helps you identify dependencies, parallelize work across frontend and backend teams, and establish quality gates that ensure features ship bug-free with proper error handling and logging.
Transform schema and data changes into production-ready migration packages that protect data integrity and minimize downtime. You can handle column additions, renames, type conversions, and backfills using proven patterns like expand-contract and shadow tables. The skill generates explicit rollback scripts, validation checklists, and phased execution plans that keep applications stable throughout the migration.
You can create comprehensive performance testing strategies tailored to your application's architecture, analyze test results to identify bottlenecks, and generate prioritized recommendations for optimization. The skill helps you design load tests, interpret metrics like latency and throughput, and create action plans for performance improvements.
You can design comprehensive performance test strategies tailored to your application architecture, analyze performance metrics and logs to identify bottlenecks, and receive specific optimization recommendations. The skill guides you through creating realistic load scenarios, interpreting performance data, and prioritizing fixes based on impact analysis.
You can submit your Solidity smart contracts for comprehensive security analysis, vulnerability detection, and gas optimization recommendations. Claude reviews your code against known attack vectors, design patterns, and best practices—identifying reentrancy risks, overflow/underflow issues, access control flaws, and inefficient operations. You receive actionable fix recommendations with explanations of the security implications and gas savings potential.
You can accelerate your entire antenna design workflow—from initial concept to optimized specifications—by leveraging Claude's knowledge of electromagnetic theory, antenna types, and design trade-offs. Claude helps you parameterize designs, identify optimal configurations for your frequency band and application, and prepare detailed briefs for simulation and manufacturing. You'll generate design reviews, impedance-matching solutions, and validation checklists without context-switching to multiple tools.