Validity - Research Design - Lecture Slides, Slides of Research Methodology

Validity, Types of Validity, Threats to Validity, Validity and Strategies, Validity Descriptors, Taxonomy of Validity, Assessment Tool, Validity Features, Assessment Validity, Construct Validity are some points from lecture of Research Design with respect to psychology.

Typology: Slides

2011/2012

Uploaded on 12/21/2012

chunni
chunni 🇮🇳

4

(15)

82 documents

1 / 35

Toggle sidebar

This page cannot be seen from the preview

Don't miss anything!

bg1
Validity
Overview
Overview of the concept
Different types of validity
Threats to validity and strategies for handling
them
Examples of validity issues from the literature
Discussion of validity issues with respect to
student projects
Docsity.com
pf3
pf4
pf5
pf8
pf9
pfa
pfd
pfe
pff
pf12
pf13
pf14
pf15
pf16
pf17
pf18
pf19
pf1a
pf1b
pf1c
pf1d
pf1e
pf1f
pf20
pf21
pf22
pf23

Partial preview of the text

Download Validity - Research Design - Lecture Slides and more Slides Research Methodology in PDF only on Docsity!

Validity

Overview

  • Overview of the concept
  • Different types of validity
  • Threats to validity and strategies for handling

them

  • Examples of validity issues from the literature
  • Discussion of validity issues with respect to

student projects

Validity Descriptors

• “Hypothesis” validity

• “Construct” validity

• “Content” validity

• “Convergent” validity

• “Ecological” validity

• “Internal” validity

• “Statistical conclusion”

validity

• “Concurrent” validity

• “External” validity

• “Predictive” validity

• “Criterion-related” validity

• “Discriminant” validity

Validity Issues Surrounding

Assessment/Measurement

Validity of an Assessment Tool

• Validity represents an overall judgment of the

degree to which both empirical evidence and

theoretical considerations support the

interpretation of the score and the

implications for action that this interpretation

entails (Cronbach, 1971).

Validity Features

• Validity applies to all assessments, including

performance/behavioral assessments

• Validity is not a property of the “test” per se,

but rather of the meaning of the test score

• Validation is an ongoing process

Features

• Validity is not just a measurement principle, it

is a social value that has powerful implications

whenever evaluative judgments and decisions

are made

Types of “Assessment” Validity

• Criterion-related validity

– Degree to which a “Test” score relates to some

relevant external criterion

• Concurrent validity

• Predictive validity

Types of “Assessment” Validity

• Construct validity *

– Ongoing, integrated summary of the evidence

supporting the interpretation and utility of “Test”

scores

– Combines information from content validity,

criterion-related validity, and

discriminant/convergent validity

Threats to Assessment Validity

• Construct underrepresentation

– Exists when the assessment fails to include

important facets of the construct (i.e., assessment

is too narrow)

– Examples?

INSTRUCTIONS: Circle the one phrase that best represents the extent to which you agree with the item. If any of the items concern

something that is not part of your experience (e.g., “it scares me when I feel shaky” for someone who has never trembled or had the

“shakes”), answer on the basis of how you think you might feel if you had such an experience. Otherwise, answer all items on the basis

of your own experience.

  1. It is important to me not to appear nervous. VERY LITTLE A LITTLE SOME MUCH VERY MUCH
  2. When I cannot keep my mind on a task, I worry that I might be going crazy. VERY LITTLE A LITTLE SOME MUCH VERY MUCH
  3. It scares me when I feel 'shaky' (trembling). VERY LITTLE A LITTLE SOME MUCH VERY MUCH
  4. It scares me when I feel faint. VERY LITTLE A LITTLE SOME MUCH VERY MUCH
  5. It is important to me to stay in control of my emotions. VERY LITTLE A LITTLE SOME MUCH VERY MUCH
  6. It scares me when my heart beats rapidly. VERY LITTLE A LITTLE SOME MUCH VERY MUCH
  7. It embarrasses me when my stomach growls. VERY LITTLE A LITTLE SOME MUCH VERY MUCH
  8. It scares me when I am nauseous. VERY LITTLE A LITTLE SOME MUCH VERY MUCH
  9. When I notice that my heart is beating rapidly, I worry that I might have a heart attack. VERY LITTLE A LITTLE SOME MUCH VERY MUCH
  10. It scares me when I become short of breath. VERY LITTLE A LITTLE SOME MUCH VERY MUCH
  11. When my stomach is upset, I worry that I might be seriously ill. VERY LITTLE A LITTLE SOME MUCH VERY MUCH
  12. It scares me when I am unable to keep my mind on a task. VERY LITTLE A LITTLE SOME MUCH VERY MUCH
  13. Other people notice when I feel shaky. VERY LITTLE A LITTLE SOME MUCH VERY MUCH
  14. Unusual body sensations scare me. VERY LITTLE A LITTLE SOME MUCH VERY MUCH
  15. When I am nervous, I worry that I might be mentally ill. VERY LITTLE A LITTLE SOME MUCH VERY MUCH
  16. It scares me when I am nervous. VERY LITTLE A LITTLE SOME MUCH VERY MUCH Docsity.com

Evidence for Assessment Validity

• Evidence of content relevance and

representativeness

• The extent to which test scores are consistent with

theoretical predictions

• Evidence examining the extent to which score

properties and interpretations generalize to and

across groups, settings, and tasks

Evidence for Assessment Validity

• Evidence on the fidelity of the scoring structure to

the structure of the construct being tapped

• Evidence from criterion-related studies including

convergent and discriminant studies

• Evidence pertaining to the consequential aspect of

test use and score interpretation, especially as it

relates to issues of bias, and fairness

Drawing Valid Inferences about

Causal Relationships

Types of Validity Pertinent to

Drawing Causal Inferences

• Internal validity

– Degree to which causal inferences can be made

between a measured or manipulated variable (i.e.

independent variable) and another measured

variable (dependent variable)