IRT Models in Psychometrics: Concepts, Assumptions, and Models, Study notes of Statistics for Psychologists

The item response theory (irt) models used in psychometrics, discussing concepts such as examinee performance, item characteristic curves, and assumptions like unidimensionality and local independence. It also covers normal ogive and logistic models, their differences, and the invariance of item and person parameters.

Typology: Study notes

2011/2012

Uploaded on 11/21/2012

ashakiran
ashakiran 🇮🇳

4.5

(27)

261 documents

1 / 3

Toggle sidebar

This page cannot be seen from the preview

Don't miss anything!

bg1
19
Ch. 2: Concepts, Assumptions, and Models
I. Concepts and Features
A. An examinee’s performance on a test is a monotonically increasing function of a
set of latent traits or abilities.
B. The item characteristic curve (ICC) describes the function between an examinee’s
performance on a test item and the latent trait.
C. The IRT model was adopted from psychophysics (threshold) and biology (lethal
dose). OHP.
D. The IRT models are falsifiable models.
E. The IRT models offer the possibility of computing invariant item and person
parameters.
II. Assumptions
A. Unidimensionality of the latent space
1. Only one latent trait is measured by items in one test.
2. In reality, if items in one test measure one dominant latent trait, the
unidimensionality assumption is met.
3. Multi-dimensional IRT models can be developed, Mulaik (1972) and
Samejima (1974).
4. Factor analysis can be used to test the unidimensionality assumption.
B. Local Independence (Conditional Independence)
1. For a given ability level, the probability of getting one item correct is
independent of the probability of getting other items correct.
P(ui = 1 uj = 1| ) = P(ui = 1| )P(uj = 1| ), i j
2. If we partial out the effect of ability ( ), then, the probability of getting
the items correct is independent of each other.
3. The ability specified in the model is the only factor influencing an
examinee’s performance.
4. If we meet the unidimensionality assumption, then the complete latent
space has only one trait.
5. Even though latent space has multiple traits (multi-dimensionality), as
long as all traits are specified in the model, the local independence
assumption will hold.
6. If one item is related to another item (cue or hint), the local independence
assumption will not hold.
III. IRT models
A. Two mathematical Models
1. Normal Ogive Models: utilize the cumulative normal curve.
2. Logistic Models: mathematically simpler than the Normal Ogive Models,
but the practical difference from the N.O.M. is less than .01 (OHP for
ICC).
B. Normal Ogive Models: by Lord (1952)
1. One-parameter Normal Ogive Model
Docsity.com
pf3

Partial preview of the text

Download IRT Models in Psychometrics: Concepts, Assumptions, and Models and more Study notes Statistics for Psychologists in PDF only on Docsity!

Ch. 2: Concepts, Assumptions, and Models

I. Concepts and Features

A. An examinee’s performance on a test is a monotonically increasing function of a

set of latent traits or abilities.

B. The item characteristic curve (ICC) describes the function between an examinee’s

performance on a test item and the latent trait.

C. The IRT model was adopted from psychophysics (threshold) and biology (lethal

dose).  OHP.

D. The IRT models are falsifiable models.

E. The IRT models offer the possibility of computing invariant item and person

parameters.

II. Assumptions

A. Unidimensionality of the latent space

  1. Only one latent trait is measured by items in one test.
  2. In reality, if items in one test measure one dominant latent trait, the

unidimensionality assumption is met.

  1. Multi-dimensional IRT models can be developed, Mulaik (1972) and

Samejima (1974).

  1. Factor analysis can be used to test the unidimensionality assumption.

B. Local Independence (Conditional Independence)

  1. For a given ability level, the probability of getting one item correct is

independent of the probability of getting other items correct.

P(ui = 1 uj = 1| ) = P(ui = 1| )P(uj = 1| ), i j

  1. If we partial out the effect of ability ( ), then, the probability of getting

the items correct is independent of each other.

  1. The ability specified in the model is the only factor influencing an

examinee’s performance.

  1. If we meet the unidimensionality assumption, then the complete latent

space has only one trait.

  1. Even though latent space has multiple traits (multi-dimensionality), as

long as all traits are specified in the model, the local independence

assumption will hold.

  1. If one item is related to another item (cue or hint), the local independence

assumption will not hold.

III. IRT models

A. Two mathematical Models

  1. Normal Ogive Models: utilize the cumulative normal curve.
  2. Logistic Models: mathematically simpler than the Normal Ogive Models,

but the practical difference from the N.O.M. is less than .01 (OHP for

ICC).

B. Normal Ogive Models: by Lord (1952)

  1. One-parameter Normal Ogive Model

a) Pi( ) = e dz

b i

z 2

2

where

Pi( ): The probability of getting item i correct for given ,

: Latent trait (ability or proficiency),

bi: Item difficulty parameter, and

z:

X

b) The probability of getting an item(i) correct is a function of ability

( ) and item difficulty parameter (bi) only.

  1. Two-parameter Normal Ogive Model

a) Pi( ) = e dz

ai b i

z ( ) 2

2

where ai: item discrimnation parameter.

b) Pi( ) is a function of ai and bi in addition to.

  1. Three-parameter Normal Ogive Model

a) Pi( ) = c c e dz

ai bi

z

i i

( ) 2

2

where ci: Pseudo-chance parameter.

b) Pi( ) is a function of ai, bi, ci, and.

  1. Since the Normal Ogive Models contain double integrals for the ability

estimation, the models are for theoretical interests only.

C. Logistic Models (Birnbaum, 1968)

  1. One-parameter Logistic (1-pl) Model (Rasch Model)

a) Pi( ) = ( )

( )

1 i

i

D b

D b

e

e

( ) 1

D b i e

= [1 +

D ( bi ) ^ e ]

  • .

*Original Rasch Model: Pi( ) =

b

(later).

b) D=1, a scaling factor for the N.O.M.

c) Pi( ) is a function of bi.

  1. Two-parameter Logistic (2-pl) Model

a) Pi( ) = ( )

( )

i i

i i

Da b

Da b

e

e

( ) 1

eDai^ b^ i

b) Pi( ) is a function of ai and bi in addition to.

c) D=1.7, a scaling factor for the N.O.M.

  1. Three-parameter Logistic (3-pl) Model

a) Pi( ) = ( )

( )

i i

i i

Da b

Da b

i i e

e c c = ( ) 1

Dai b i

i i e

c c.

b) Pi( ) is a function of ai, bi, ci, and.