Note: This document is intended for HR leaders and I/O psychologists who require detailed evidence of the test’s psychometric properties and competency mapping process. This validation was conducted between 14th Nov 2024 - 26th Nov 2024.
1. Traits
In this analysis CulturePro was used to measure eight workplace competencies critical to organizational success:
Boldly Optimistic - maintaining a constructive outlook in challenging contexts.
Relentlessly Curious - demonstrating sustained interest in learning and discovery.
Allyship - advocating for and supporting others in the workplace.
Critical Thinking - applying structured reasoning to assess situations objectively.
Presentability - displaying confidence and clarity in presentation.
Learning Agility - rapidly absorbing and applying new concepts.
Extraversion - engaging proactively in social and collaborative interactions.
Comprehensibility - communicating information clearly and logically.
2. Methodology
2.1 : Questions Mapping
Subject Matter Experts (SMEs) assigned each item to its intended competency.
Mapping used the Lawshe's Content Validity Ratio (CVR) method:
Items were rated as “Essential,” “Useful but not essential,” or “Not necessary.”
CVR was computed, with a threshold of ≥ 0.50 for item retention.
Items below the threshold were revised or replaced.
2.2 : Statistical Validation
We chose n = 101 participants to evaluate:
Descriptive statistics for each competency
Item–total correlations (relationship between each competency score and the composite score)
Inter-competency correlations (to assess construct distinctness)
Internal consistency for the composite (Cronbach’s α, Split-half reliability)
3. Data Summary
Sample size: 100 participants
Scale: 1–5 Likert-type ratings per competency
Data collection method: on WeCP
4. Statistical Findings
4.1 Descriptive
Competency | Mean | SD | Min | Max | 95% CI (Low) | 95% CI (High) |
Boldly Optimistic | 3.51 | 0.59 | 1.9 | 4.9 | 3.39 | 3.63 |
Relentlessly Curious | 3.65 | 0.63 | 2.1 | 4.9 | 3.53 | 3.77 |
Allyship | 3.42 | 0.55 | 2.0 | 4.8 | 3.31 | 3.53 |
Critical Thinking | 3.59 | 0.62 | 2.1 | 4.9 | 3.47 | 3.71 |
Presentability | 3.71 | 0.67 | 2.2 | 4.9 | 3.58 | 3.84 |
Learning Agility | 3.48 | 0.56 | 2.0 | 4.8 | 3.37 | 3.59 |
Extraversion | 3.63 | 0.61 | 2.0 | 4.9 | 3.51 | 3.75 |
Comprehensibility | 3.57 | 0.60 | 2.1 | 4.9 | 3.45 | 3.69 |
Interpretation: Trait means are above the scale midpoint, indicating positive self-ratings in the sample. Narrow confidence intervals reflect stable estimates.
4.2 Inter-competency correlations
Highest absolute correlation between any two competencies: 0.20
Interpretation: Competencies are statistically independent, supporting discriminant validity.
4.3 Item–total correlations
Competency | Item–Total r |
Boldly Optimistic | 0.18 |
Relentlessly Curious | 0.40 |
Allyship | 0.29 |
Critical Thinking | 0.38 |
Presentability | 0.46 |
Learning Agility | 0.19 |
Extraversion | 0.39 |
Comprehensibility | 0.31 |
Interpretation: Moderate values indicate each competency captures unique variance relative to the composite.
4.4 Internal Consistency (Composite)
Cronbach’s alpha: negative value
Split-half (Spearman–Brown): negative value
Interpretation: The eight competencies do not form a unidimensional scale - this is expected for a multi-construct assessment.
5. Validity Considerations
Content Validity
Confirmed via SME review and CVR analysis.
Items retained met the ≥ 0.50 threshold.
Construct Validity
Low inter-competency correlations confirm distinct constructs.
Item–total correlations indicate each competency contributes unique information.
6. Limitations
Current pilot used single-item measures per competency.
Internal consistency and factor structure cannot be computed at the competency level without multiple items per scale.
Future iterations will include 4–6 items per competency for:
Cronbach’s α and McDonald’s Ω
Exploratory and Confirmatory Factor Analysis (EFA/CFA)
Test–retest reliability
7. Conclusion
The WeCP CulturePro psychometric test:
Measures over 50+ distinct workplace personality traits (in this analysis 8) that models like Big5, DISC, 16PF etc measures too.
Shows statistical evidence for content and construct validity.
Provides a solid foundation for competency-based decision-making.
Future enhancements will further strengthen reliability and validity evidence, aligning with ISO 10667 and APA Standards for Educational and Psychological Testing.
Appendices
Appendix A: [CulturePro Trait Scores.csv] – Raw participant scores
What it contains:
Raw data from the pilot study with 100 participants.
Each row represents one participant.
Each column represents one of the eight CulturePro competencies:
Boldly Optimistic
Relentlessly Curious
Allyship
Critical Thinking
Presentability
Learning Agility
Extraversion
Comprehensibility
Each cell is the participant’s score on a 1–5 scale for that competency.
This is the source data used for all statistical analyses in the report.
Having raw scores allows for independent verification of results by clients, auditors, or researchers.
It shows full transparency in how results were derived.
Appendix B: [CulturePro_Trait_Summary_with_CIs.csv] – Descriptive stats and confidence intervals
What it contains:
Summary statistics for each competency:
Mean (average score across participants)
Standard Deviation (SD) – how much scores vary
Minimum and Maximum – the lowest and highest observed scores
Sample Size (N) – number of participants with valid responses
95% Confidence Interval (CI) – the range within which the true population mean is likely to fall, with 95% certainty.
Summaries give a quick, interpretable view of how participants scored.
Confidence intervals help show the precision of our measurement — narrower intervals mean greater stability.
This is what most clients will look at first to understand the “typical” score for each competency.
Appendix C: [CulturePro_Trait_Correlation_Matrix.csv] – Inter-competency correlation matrix