An investigator wishes to study the relation between dogmatism and anthrocentrism. He uses a well-established measure of anthrocentrism and constructs an instrument to measure dogmatism. The correlation between dogmatism and anthrocentrism is 0.60. The investigator does not stop there. However, because it seems to him that the correlation may be due to factors other than those he is trying to measure, he is particularly dubious about the dogmatism measure. What should he do to obtain evidence that his dogmatism measure is really measuring dogmatism? Pay particular attention to construct validity and construct validation.
To obtain evidence that his dogmatism measure is really measuring dogmatism, the investigator needs to focus on construct validation, which is the process of gathering evidence to support that a test measures the intended theoretical construct—in this case, dogmatism.
π Why the Concern?
The investigator is wisely questioning whether the observed correlation (r = 0.60) between dogmatism and anthrocentrism might be due to confounding factors, measurement error, or that the dogmatism scale is not valid. This skepticism is essential in construct validation.
✅ Steps to Strengthen Construct Validity of the Dogmatism Measure:
1. Content Validity
-
Action: Involve multiple subject matter experts to review the test items to ensure they cover all relevant facets of dogmatism (e.g., rigidity of belief, resistance to change, intolerance of ambiguity).
-
Purpose: Ensures the scale has comprehensive and representative content.
2. Convergent Validity
-
Action: Correlate the dogmatism measure with other established measures of dogmatism or related constructs (e.g., authoritarianism, rigidity).
-
Expected Result: Moderate to high positive correlations suggest the scale is measuring a similar or related construct.
-
Purpose: Shows the scale behaves as expected if it truly measures dogmatism.
3. Discriminant Validity
-
Action: Correlate the dogmatism scale with measures of unrelated constructs (e.g., extraversion or physical fitness).
-
Expected Result: Low or near-zero correlations.
-
Purpose: Demonstrates that the test is not measuring unrelated traits, strengthening evidence that it measures dogmatism alone.
4. Factor Analysis (Exploratory & Confirmatory)
-
Action: Conduct factor analysis to examine the underlying structure of the scale.
-
Goal: Determine whether items load on factors consistent with the theoretical model of dogmatism.
-
Purpose: Helps confirm whether the items group in a way that matches the conceptual understanding of dogmatism.
5. Known-Groups Validity (Construct Validation by Differentiation)
-
Action: Compare dogmatism scores across groups known to differ in dogmatic thinking (e.g., open-minded vs. fundamentalist groups).
-
Expected Result: Statistically significant differences support construct validity.
-
Purpose: Confirms that the measure can distinguish between theoretically relevant groups.
6. Test–Retest Reliability
-
Action: Administer the dogmatism test twice over a period and compute the correlation.
-
Expected Result: A high correlation (e.g., ≥ 0.7) suggests the measure is stable over time.
-
Purpose: While not construct validity, it ensures consistent measurement.
7. Multitrait-Multimethod (MTMM) Matrix (Advanced)
-
Action: Use different methods (e.g., self-report, peer ratings) to assess multiple traits, including dogmatism.
-
Goal: Examine patterns of correlation to separate trait variance from method variance.
-
Purpose: Offers a rigorous approach to establish construct validity.
π§ Conclusion: What Should the Investigator Do?
The investigator should systematically gather construct validity evidence for the dogmatism scale using convergent and discriminant validation techniques, factor analysis, and expert reviews. Relying solely on a correlation (even 0.60) with another construct (like anthrocentrism) is insufficient. Without a validated dogmatism measure, the interpretation of the 0.60 correlation remains speculative.
Comments
Post a Comment