Measuring Concepts: Indicators, Dimensions, and Validity, Slides of Performance Evaluation

The concepts of measuring various things, from direct observables to constructs. It discusses the importance of indicators and dimensions in representing concepts, the interchangeability of indicators, and the challenges of defining concepts and ensuring measurement reliability and validity. The document also touches upon the tension between reliability and validity in research.

Typology: Slides

2011/2012

Uploaded on 12/25/2012

ramkrishna
ramkrishna 🇮🇳

4.3

(7)

88 documents

1 / 16

Toggle sidebar

This page cannot be seen from the preview

Don't miss anything!

bg1
Developing Measures
Concepts as File Folders
Three Classes of Things That can be Measured
(Kaplan, 1964)
Direct Observables--Color of the Apple or a Check Mark
in a Survey
Indirect Observables--The Check Mark Beside Female in
a Questionnaire Indirectly Observes Gender or Historical
Accounts of Social Acts
Constructs--Theoretical Creations based on Observations
docsity.com
pf3
pf4
pf5
pf8
pf9
pfa
pfd
pfe
pff

Partial preview of the text

Download Measuring Concepts: Indicators, Dimensions, and Validity and more Slides Performance Evaluation in PDF only on Docsity!

Developing Measures

Concepts as File Folders

  • Three Classes of Things That can be Measured (Kaplan, 1964) - Direct Observables--Color of the Apple or a Check Mark in a Survey - Indirect Observables--The Check Mark Beside Female in a Questionnaire Indirectly Observes Gender or Historical Accounts of Social Acts - Constructs--Theoretical Creations based on Observations

Indicators and Dimensions

  • Indicators are Observations We Choose to Represent as a Variable of a Concept We Wish to Study. Going to Church may be Chosen as an Indicator of Religiosity.
  • Dimensions are Facets or Aspects of Concepts. What are Some Dimensions of LOVE?

Confusion Over Definitions and Reality

Confusion Over Definitions and

Reality

Conceptualization in Evaluation

  • Concept can be Measured anyway you Choose
  • But, Most Likely You Will Measure in a way not too Different from Other Peoples Mental Images of the Concept
  • Measures become Established (CES-D)

Reliability and Validity

Reliability

  • The quality of a measurement that suggests that the same data would be collected each time in repeated observations of the same phenomenon.
  • Which would give more reliable information:
    1. Did you attend church last week? 2) How many times have you attended church in your lifetime?

Reliability Problems

  • Single Observer as a source of data
  • Different sort of interviewers get different answers on telephone surveys (social response bias)
  • May not understand the question
  • May not care

Validity

  • Term that describes a measure that accurately reflects concept it is intended to measure. Hard to establish

Types of Validity

• Face Validity -- the degree to which a

measure seems reasonable

• Criterion-Related Validity -- degree to

which a measure relates to an external

criterion -- college board and college

success

Tension Between Reliability

and Validity

  • Often the specification of a reliable instrument robs the richness of meaning and validity in a concept
  • Difference between qualitative and quantitative research and idiographic and nomothetic research.