Survey Design & Psychometric Validation
Design scientifically-valid surveys with automatic psychometric validation
by omkamalSocial Sciences & PolicyPsychology (Applied)Industrial-Organizational PsychologistSurvey/AnalyticsWhat You Can Do
Create rigorously designed surveys using evidence-based methodology and validate them with psychometric analysis. Claude analyzes your research objectives, generates targeted survey items, evaluates scale reliability and validity, and identifies potential measurement issues before data collection. You get publication-ready instruments with documented psychometric properties.
Features
Create theoretically-grounded, unbiased survey questions aligned with your constructs. Claude generates balanced items with appropriate response scales and avoids common pitfalls like leading language and double negatives.
Calculate and interpret Cronbach's alpha, test-retest reliability, and inter-rater consistency. Claude diagnoses problematic items and recommends revisions to improve internal consistency.
Analyze content validity, construct validity, and criterion validity. Claude maps items to theoretical constructs and identifies gaps or redundancies in your measurement model.
Prepare data and interpret factor structure. Claude guides you through exploratory and confirmatory factor analysis to verify that items cluster as expected.
Evaluate item difficulty, discrimination, and variance. Claude identifies problematic items (low correlations, extreme distributions, skew) and suggests improvements.
Choose appropriate rating scales (Likert, Semantic Differential, etc.) based on your construct and sample. Claude evaluates scale length, endpoint labels, and anchoring strategies.
Screen for potential measurement bias, cultural assumptions, and language barriers. Claude flags items that may disadvantage specific groups or populations.
Example Output
Input: "I'm designing a burnout scale for healthcare workers. I have three constructs: emotional exhaustion, depersonalization, and personal accomplishment."
Claude Output:
# Emotional Exhaustion Scale (5 items)
1. I feel emotionally drained by my work. [5-point Likert]
2. Working with patients all day is really a strain for me. [5-point Likert]
...
# Validity Assessment
- Content validity: All items directly address emotional depletion (strong)
- Discriminant validity concern: Item 3 overlaps with depersonalization—revise
- Recommended Cronbach's α target: 0.80+ (current: 0.76)
# Diagnostics
- Item 4 shows low corrected item-total correlation (r=0.31); consider removal
- Response distribution skewed toward agreement; check for response bias
What's Included
- Survey Template Generator: Automatically structure multi-dimensional surveys with clear section headers, consistent formatting, and professional layout instructions for distribution.
- Psychometric Analysis Checklist: Step-by-step guide to validating your survey, including reliability tests, validity checks, and item-level diagnostics with interpretation guidance.
- Response Scale Advisor: Recommendations on optimal scale types, number of response options, and endpoint anchoring based on your research design and sample characteristics.
- Bias Detection Framework: Systematic review of items for leading language, cultural assumptions, accessibility barriers, and potential measurement bias across demographics.
- Sample Size & Power Calculator: Guidance on required sample sizes for reliability estimates, factor analysis, and validity testing based on your survey complexity and statistical goals.
Who It's For
- Research Scientists & Academics
- Clinical & Organizational Psychologists
- UX Researchers & Product Teams
- HR & Learning & Development Professionals
- Public Health & Social Science Researchers
Best For
- Developing new measurement instruments from scratch
- Adapting existing scales for new populations or contexts
- Validating survey data before analysis
- Improving scale reliability and eliminating problematic items
- Documenting psychometric properties for publication
You might also like
You can design and validate selection systems that maximize predictive accuracy while minimizing legal risk. The skill applies industrial-organizational psychology principles to create structured assessments, job analyses, and validity evidence that withstand regulatory scrutiny. You'll generate documentation that demonstrates how your selection criteria connect to job performance and comply with EEOC/OFCCP standards.
by omkamal
Systematically integrate psychological and psychiatric assessment results into comprehensive, legally-sound forensic competency opinions. Claude guides you through evidence-based reasoning to address the specific legal standards applicable to your jurisdiction, helping you organize clinical findings into clear, defensible conclusions about cognitive, functional, and volitional capacities relevant to the legal question at hand.
by omkamal
This skill transforms raw clinical findings and assessment data into structured, legally defensible competency evaluation reports. You provide clinical observations, test scores, and relevant history; Claude organizes them into coherent narratives with proper test cross-referencing, expert reasoning frameworks, and standards-compliant conclusions that withstand legal scrutiny.
by omkamal
Build empirically validated competency frameworks and selection assessments grounded in structured job analysis and industrial-organizational psychology principles. Create assessment blueprints with criterion-related validity evidence, competency models aligned to business strategy, and comprehensive documentation that withstands legal scrutiny. Generate adverse impact analyses and reliability metrics to ensure your selection systems are both defensible and fair.
by omkamal
This skill provides comprehensive human factors analysis of vehicle interface designs. You can assess cognitive load, identify driver distraction risks, evaluate NHTSA compliance, and uncover usability issues before design freeze. It combines HCI best practices, automotive safety standards, and workload assessment methodologies to deliver actionable feedback that keeps drivers safe.
by omkamal
Systematically assess automotive human-machine interfaces against usability standards, safety frameworks (ISO 26262, SOTIF), and accessibility guidelines. You'll identify cognitive load risks, driver distraction hazards, and compliance gaps—then receive prioritized remediation recommendations backed by safety impact analysis. The skill works from design descriptions, wireframes, or prototypes to produce comprehensive evaluation reports.
by omkamal
You can systematically analyze aerospace accidents and incidents using evidence-based human factors frameworks like STAMP, SHEL, and Five Whys to identify systemic contributors beyond individual error. The skill pinpoints design flaws, procedural gaps, and organizational factors that created the accident pathway. You'll receive structured findings and specific, actionable interventions for design improvements or procedural changes to prevent recurrence.
by omkamal
You can systematically architect training programs grounded in industrial-organizational psychology principles. This skill guides you through organizational needs analysis, competency framework development, learning objective design, and program evaluation strategy. You'll produce comprehensive training blueprints that align development with business outcomes and job performance requirements.
by omkamal