Test Development - Tests and Measurements - Lecture Notes, Study notes of Psychological Data

Test Development, Test Conceptualization, Identify the Subject Population, Review of the Literature, Test Construction, Item Generation, Selecting the Test Format, Response Formats, Response Biases, Selecting a Scoring Method. You might have found many different lecture notes on Tests and Measurements regarding psychological disorder over internet but this set I am uploading is best you can find.

Typology: Study notes

2011/2012

Uploaded on 12/11/2012

saikumar
saikumar 🇮🇳

4.2

(44)

141 documents

1 / 3

Toggle sidebar

This page cannot be seen from the preview

Don't miss anything!

bg1
Test Development
Test Conceptualization: Specification of Test Purpose
Specify the objective of the test
What is the goal of testing?
Define the Attribute
What is the construct that you are measuring?
Operational definition
Identify the Subject Population
Which is the group on which you will develop the test?
Review of the Literature
What is the previous research on the construct?
Describe observations of the behavior
Test Construction: Item Generation
Defining the "observable"
How will you measure the construct?
Generate a pool of items to measure the trait by systematically identifying and specifying
the items in the content domain
Item generation yields more items than necessary
Scaling: Selecting the Test Format
How will the test be presented?
Item format may be objective vs. subjective
Response format may be forced vs. open-ended
Response Formats
Dichotomous
True-False, Yes-No
Multichotomous
Response Biases
There are several response styles.
Social desirability
Acquiescence
Other Response Biases?
NonAcquiescence
Extreme
Deviance
Docsity.com
pf3

Partial preview of the text

Download Test Development - Tests and Measurements - Lecture Notes and more Study notes Psychological Data in PDF only on Docsity!

Test Development

Test Conceptualization: Specification of Test Purpose

  • Specify the objective of the test
  • What is the goal of testing?

Define the Attribute

  • What is the construct that you are measuring?
  • Operational definition

Identify the Subject Population

  • Which is the group on which you will develop the test?

Review of the Literature

  • What is the previous research on the construct?
  • Describe observations of the behavior

Test Construction: Item Generation

  • Defining the "observable"
  • How will you measure the construct?
  • Generate a pool of items to measure the trait by systematically identifying and specifying the items in the content domain
  • Item generation yields more items than necessary

Scaling: Selecting the Test Format

  • How will the test be presented?
  • Item format may be objective vs. subjective
  • Response format may be forced vs. open-ended

Response Formats

  • Dichotomous
    • True-False, Yes-No
  • Multichotomous

Response Biases

  • There are several response styles.
    • Social desirability
    • Acquiescence

Other Response Biases?

  • NonAcquiescence
  • Extreme
  • Deviance

Selecting a Scoring Method

  • Typically, a method is devised to obtain a measure of the construct according to the number of correct responses or the absence vs. presence of a trait
  • Summative model

Item Tryout

  • Essentially, an exploratory examination of the test
  • Administer the test items to a sample that is identical to population for which the test will be developed

Item Analyses

  • Quantitative evaluation of items on a scale
  • The purpose is to obtain more info on each item in order to determine the retention, deletion, or revision of items.
  • Two possible methods for analyzing items:
    • Item Difficulty
    • Item Discrimination

Item Difficulty

  • How difficult are the items?
  • Examining the proportion of examines who answer items correctly vs. incorrectly.
  • Assumes right or wrong answers
  • Item Difficulty Formula
  • (p) = # of examinees answering item correctly Total # of examinees
  • Value ranges from 0.0 to +1.
  • lower the (p) = harder
  • If 50/50 answer correctly then (p) = 1.
  • If 25/50 answer correctly then (p) = 0.

Average Optimum Item Difficulty

  • Depends on the purpose of the test
  • Optimum range is .3 to.
  • When is 0.5 appropriate?
  • When is a lower (p) best?

Guessing

  • D index also take mere guessing into account
  • Optimal (p) is the midpoint between % correctly answering the question by guessing and 100%
  • What is the optimal (p) for a True/False item?
  • What is the optimal (p) for five-answer multiple choice item?

Item Discrimination

  • The extent to which a test item discriminates between groups of examinees who obtain high scores from those that obtain low scores