Research Data Curation Workflow
Validate, standardize, and curate research datasets with automated quality workflows
What You Can Do
You can systematically validate research datasets, automatically standardize formats and schemas, and verify compliance requirements in one workflow. The skill performs comprehensive quality assessment, enriches metadata, detects duplicates and anomalies, and generates documentation—transforming raw datasets into publication-ready, audit-trail-enabled collections.
Features
Validates dataset structure, data types, and value ranges against your schema; identifies missing values, outliers, and format inconsistencies
Automatically generates and enriches metadata—provenance, collection methods, variable definitions, units, and licensing information
Checks datasets against GDPR, HIPAA, research ethics guidelines, and institutional policies; flags PII, restricted data, and consent gaps
Converts datasets to standard formats (CSV, JSON, Parquet); aligns column naming, encoding, and coding schemes across related datasets
Generates quality metrics—completeness, consistency, validity, and accuracy—with actionable feedback and remediation suggestions
Identifies duplicate records, near-duplicates, and statistical anomalies using fuzzy matching and outlier detection algorithms
Creates detailed audit logs of all transformations, validation steps, and decisions; tracks dataset lineage and version history
Example Output
Input: Raw survey dataset (500 rows, inconsistent date formats, missing value codes, unclear variable labels)
Output:
Quality Assessment Report
─────────────────────────
Completeness: 92% (46 cells flagged)
Consistency: 89% (8 column naming issues, 12 encoding mismatches)
Validity: 95% (23 values outside expected range)
Accuracy: 88% (5 likely duplicates, 3 logical errors)
Compliance Status: ⚠️ NEEDS REVIEW
- 12 rows flagged: contain potential PII (names, email patterns)
- Missing consent documentation for 15 respondents
- Compliance: GDPR Article 6 basis unclear
Metadata Generated
──────────────────
Collection Date: 2024-01-15 to 2024-03-22
Data Custodian: Research Team A
License: CC-BY-4.0
Variables Documented: 34/34
Dict: [age (integer, 18-85), gender (categorical), ...]
Recommendations
────────────────
✓ Standardize dates to ISO 8601
✓ Code missing values as 'NA' consistently
✓ Redact PII columns or pseudonymize
✓ Obtain explicit consent docs for 15 respondents
After curation: Clean, standardized dataset ready for publication with full metadata, compliance sign-off, and audit trail.
What's Included
- Data Validation Engine: Schema checking, type validation, range/pattern enforcement, and constraint verification
- Quality Assessment Module: Automated scoring for completeness, consistency, validity, and accuracy with recommendations
- Compliance Checker: GDPR, HIPAA, and institutional policy verification; PII detection; consent tracking
- Metadata Templates: Pre-built templates for Data Documentation Initiative (DDI), Dublin Core, and domain-specific schemas
- Transformation Workflows: Standardization templates for CSV-to-JSON, encoding conversion, column renaming, and deduplication
- Audit & Versioning System: Complete log of all changes, decisions, and curator actions with rollback capability
Who It's For
- Research Data Managers
- Academic Researchers & Scientists
- Data Stewards & Curators
- Compliance & Ethics Officers
- Data Quality Engineers
Best For
- Preparing datasets for public repositories or journals
- Ensuring compliance with funding agency requirements
- Standardizing multi-source research data
- Auditing data quality before analysis or publication
- Documenting dataset lineage and transformations
You might also like
You can design comprehensive clinical trial protocols that meet FDA and ICH-GCP requirements, develop rigorous patient eligibility criteria, and establish safety monitoring frameworks that protect trial participants. This skill helps you assess inclusion/exclusion criteria, define safety endpoints, plan statistical analyses, and generate regulatory-ready documentation—accelerating protocol development from concept to submission-ready draft.
by hah23255
You'll generate compliant DoD healthcare research proposals by leveraging validated templates, regulatory checklists, and institutional review frameworks. The skill guides you through proposal structure, ensures compliance with DoD-specific requirements (DODI 3216.02, HSPB standards), and provides budget justification templates that meet federal acquisition regulations. You can produce complete proposal sections—from technical narratives to risk mitigation strategies—in hours instead of weeks.
by hah23255
Create comprehensive data governance policies, compliance frameworks, and access control matrices tailored to healthcare research regulations. Audit existing data management practices against HIPAA, GDPR, and institutional requirements, identify gaps, and generate actionable remediation plans with detailed documentation and risk assessments.
by hah23255
Systematically evaluate healthcare policies for ethical compliance by mapping them against multiple ethical frameworks (deontological, consequentialist, virtue-based, care ethics), assessing equity impact across populations, and identifying regulatory alignment gaps. You receive structured analysis with ethical tensions, vulnerable populations at risk, compliance recommendations, and alternative policy approaches that optimize for both ethics and feasibility.
by hah23255
You can systematically analyze research protocols against ethical principles, regulatory frameworks, and IRB standards to identify risks before submission. Claude reviews your protocol to ensure vulnerable populations receive appropriate protections, verify informed consent meets regulatory adequacy, detect conflicts of interest and bias, and generate actionable recommendations for strengthening ethical safeguards.
by hah23255
Generate comprehensive drug trial protocols that meet ICH-GCP and regulatory standards. You can develop phase-specific study designs, safety monitoring procedures, informed consent frameworks, and complete regulatory submissions with built-in compliance checks. Claude ensures your documentation aligns with FDA and international regulatory requirements while maintaining scientific rigor.
by hah23255
This skill guides you through the complete statistical workflow for genomic research—from study design and sample size determination to analysis method selection and result interpretation. You get evidence-based recommendations for handling genomic data's unique challenges: multiple testing correction, batch effects, and small-sample inference. Each recommendation includes the reasoning, assumptions, and limitations so you can make informed choices for your research.
by hah23255
This assistant automates creation of HIPAA-compliant archival documentation, metadata templates, and retention schedules for your research datasets. You get customized compliance checklists, de-identification verification, and institutional review board-ready documentation tailored to your funding agency requirements. Perfect for research institutions managing sensitive health data with strict regulatory and audit trail obligations.
by hah23255