Research Data Curation Workflow
Validate, standardize, and curate research datasets with automated quality workflows
What You Can Do
You can systematically validate research datasets, automatically standardize formats and schemas, and verify compliance requirements in one workflow. The skill performs comprehensive quality assessment, enriches metadata, detects duplicates and anomalies, and generates documentation—transforming raw datasets into publication-ready, audit-trail-enabled collections.
Features
Validates dataset structure, data types, and value ranges against your schema; identifies missing values, outliers, and format inconsistencies
Automatically generates and enriches metadata—provenance, collection methods, variable definitions, units, and licensing information
Checks datasets against GDPR, HIPAA, research ethics guidelines, and institutional policies; flags PII, restricted data, and consent gaps
Converts datasets to standard formats (CSV, JSON, Parquet); aligns column naming, encoding, and coding schemes across related datasets
Generates quality metrics—completeness, consistency, validity, and accuracy—with actionable feedback and remediation suggestions
Identifies duplicate records, near-duplicates, and statistical anomalies using fuzzy matching and outlier detection algorithms
Creates detailed audit logs of all transformations, validation steps, and decisions; tracks dataset lineage and version history
Example Output
Input: Raw survey dataset (500 rows, inconsistent date formats, missing value codes, unclear variable labels)
Output:
Quality Assessment Report
─────────────────────────
Completeness: 92% (46 cells flagged)
Consistency: 89% (8 column naming issues, 12 encoding mismatches)
Validity: 95% (23 values outside expected range)
Accuracy: 88% (5 likely duplicates, 3 logical errors)
Compliance Status: ⚠️ NEEDS REVIEW
- 12 rows flagged: contain potential PII (names, email patterns)
- Missing consent documentation for 15 respondents
- Compliance: GDPR Article 6 basis unclear
Metadata Generated
──────────────────
Collection Date: 2024-01-15 to 2024-03-22
Data Custodian: Research Team A
License: CC-BY-4.0
Variables Documented: 34/34
Dict: [age (integer, 18-85), gender (categorical), ...]
Recommendations
────────────────
✓ Standardize dates to ISO 8601
✓ Code missing values as 'NA' consistently
✓ Redact PII columns or pseudonymize
✓ Obtain explicit consent docs for 15 respondents
After curation: Clean, standardized dataset ready for publication with full metadata, compliance sign-off, and audit trail.
What's Included
- Data Validation Engine: Schema checking, type validation, range/pattern enforcement, and constraint verification
- Quality Assessment Module: Automated scoring for completeness, consistency, validity, and accuracy with recommendations
- Compliance Checker: GDPR, HIPAA, and institutional policy verification; PII detection; consent tracking
- Metadata Templates: Pre-built templates for Data Documentation Initiative (DDI), Dublin Core, and domain-specific schemas
- Transformation Workflows: Standardization templates for CSV-to-JSON, encoding conversion, column renaming, and deduplication
- Audit & Versioning System: Complete log of all changes, decisions, and curator actions with rollback capability
Who It's For
- Research Data Managers
- Academic Researchers & Scientists
- Data Stewards & Curators
- Compliance & Ethics Officers
- Data Quality Engineers
Best For
- Preparing datasets for public repositories or journals
- Ensuring compliance with funding agency requirements
- Standardizing multi-source research data
- Auditing data quality before analysis or publication
- Documenting dataset lineage and transformations
You might also like
You can design, validate, and execute statistical analyses for health outcomes research, comparative effectiveness studies, and clinical trials with regulatory rigor. This skill guides you through study design validation, appropriate statistical method selection, data quality assessment, hypothesis testing, and results interpretation aligned with FDA, EMA, and ICH-GCP standards. You'll generate publication-ready analysis plans and ensure your findings meet scientific and regulatory requirements for peer review or submission.
by hah23255
Generate comprehensive drug trial protocols that meet ICH-GCP and regulatory standards. You can develop phase-specific study designs, safety monitoring procedures, informed consent frameworks, and complete regulatory submissions with built-in compliance checks. Claude ensures your documentation aligns with FDA and international regulatory requirements while maintaining scientific rigor.
by hah23255
Create comprehensive data governance policies, compliance frameworks, and access control matrices tailored to healthcare research regulations. Audit existing data management practices against HIPAA, GDPR, and institutional requirements, identify gaps, and generate actionable remediation plans with detailed documentation and risk assessments.
by hah23255
You'll generate compliant DoD healthcare research proposals by leveraging validated templates, regulatory checklists, and institutional review frameworks. The skill guides you through proposal structure, ensures compliance with DoD-specific requirements (DODI 3216.02, HSPB standards), and provides budget justification templates that meet federal acquisition regulations. You can produce complete proposal sections—from technical narratives to risk mitigation strategies—in hours instead of weeks.
by hah23255
You structure clinical research manuscripts according to IMRaD (Introduction, Methods, Results, Discussion) standards required by peer-reviewed journals. This skill helps you draft sections from raw research notes, polish prose for academic clarity, enforce citation standards, and identify common submission issues before sending to journals. The result is a manuscript ready for peer review with minimal editor feedback.
by hah23255
Systematically evaluate healthcare policies for ethical compliance by mapping them against multiple ethical frameworks (deontological, consequentialist, virtue-based, care ethics), assessing equity impact across populations, and identifying regulatory alignment gaps. You receive structured analysis with ethical tensions, vulnerable populations at risk, compliance recommendations, and alternative policy approaches that optimize for both ethics and feasibility.
by hah23255
This skill guides you through the complete statistical workflow for genomic research—from study design and sample size determination to analysis method selection and result interpretation. You get evidence-based recommendations for handling genomic data's unique challenges: multiple testing correction, batch effects, and small-sample inference. Each recommendation includes the reasoning, assumptions, and limitations so you can make informed choices for your research.
by hah23255
This skill helps you develop comprehensive regulatory submission strategies, analyze complex compliance requirements, and navigate jurisdiction-specific pathways. You'll generate detailed submission plans, compliance checklists, and risk assessments that align your product or service with regulatory standards. It guides you through documentation requirements, timeline planning, and stakeholder communication strategies for successful regulatory filings.
by hah23255