






Study with the several resources on Docsity
Earn points by helping other students or get them with a premium plan
Prepare for your exams
Study with the several resources on Docsity
Earn points to download
Earn points by helping other students or get them with a premium plan
This study guide provides questions and detailed answers related to validity and reliability in assessments. It covers content validity, construct validity, criterion-related validity, and consequential validity. The guide also addresses threats to validity, internal reliability, equivalency reliability, and inter-rater reliability. Key concepts include formative and summative assessments, selected response tests, constructed response tests, and qualitative vs. Quantitative data. It is designed to help students prepare for exams by testing their knowledge and understanding of assessment principles and practices.
Typology: Exams
1 / 10
This page cannot be seen from the preview
Don't miss anything!







CONTENT validity - CORRECT ANSWERS the assessment measures the content it's designed to assess
Purpose of CONSTRUCT validity - CORRECT ANSWERS Checks to see if test measures what it's supposed to and not something else
Purpose of CONTENT validity in objective assessment - CORRECT ANSWERS To determine how closely the test represents what should be assessed.
Objective assessment - CORRECT ANSWERS Question with only one answer
Purpose of CRITERION-RELATED validity - CORRECT ANSWERS Measures the degree of correlation between a first and 2nd test
CONSEQUENTIAL validity - CORRECT ANSWERS results are used for a purpose and have social significance.
FACE validity - CORRECT ANSWERS looks valid on the surface
CONSTRUCT validity - CORRECT ANSWERS Degree to which a test actually measures what it claims to measure
CRITERION-RELATED validity - CORRECT ANSWERS Validity is determined by comparing one test to another (2 types: concurrent & predictive)
PREDICTIVE validity - CORRECT ANSWERS results used to determine future achievement
CONCURRENT validity - CORRECT ANSWERS the extent to which two measures of the same trait or ability agree
OR
how well a new test compares to a well-established test
How do you ensure validity of a test? - CORRECT ANSWERS 1. Scoring procedures are evaluated for objectivity FAIRNESS
CHECK for BIAS
CONSISTENT
Threats to validity - CORRECT ANSWERS 1. Ambiguous test directions
INTERNAL reliability - CORRECT ANSWERS consistent results across items in a test
SPLIT HALF = both halves of the test "work"
Kuder-Richardson
Chronbach's alpha
estimated from a single administration of a test
High RELIABILITY coefficients show... - CORRECT ANSWERS highly reliable
Low RELIABILITY coefficients show... - CORRECT ANSWERS low reliability
Characteristics of reliability coefficients measure... - CORRECT ANSWERS 1. how well scores hold up over time
Constructed Response - CORRECT ANSWERS a written response to a prompt (usually a paragraph)
LOW reliability (depending on inter-rater folks)
Projective Test - CORRECT ANSWERS a personality test, such as the Rorschach or TAT,
LOW reliability
Heterogenous test group - CORRECT ANSWERS HIGH reliability
Large number of test questions - CORRECT ANSWERS HIGH reliability
a short test, a quiz - CORRECT ANSWERS LOW reliability
Significant difference in students' scores - CORRECT ANSWERS LOW reliability
Several subtest components of one larger test - CORRECT ANSWERS LOW reliability
negligible (insignificant) standard error of measurement - CORRECT ANSWERS typical error of measurement is insignificant
HIGH reliability
Significant standard error of measurement - CORRECT ANSWERS measure of how much measured test scores are spread around a "true" score.
more errors = the less accurate the test
LOW reliability
Minor differences in students' scores - CORRECT ANSWERS HIGH reliability
Inconsistent rating of constructed response items - CORRECT ANSWERS LOW reliability
Spearman-Brown used for VALIDITY or RELIABILITY? - CORRECT ANSWERS RELIABILITY
FORMATIVE - CORRECT ANSWERS never graded, anonymous
used to guide instruction
FORMATIVE evaluation element
An ELEMENT of Formative Evaluation - CORRECT ANSWERS IMPLEMENTATION evaluation
(notes the changes needed as instruction progresses)
purpose of summative evaluation - CORRECT ANSWERS To assign grades or certify mastery
see if goals have been met
make decisions
Identify subject of the evaluation - component of... - CORRECT ANSWERS SUMMATIVE Evaluation
Define the purpose of an evaluation - component of... - CORRECT ANSWERS SUMMATIVE Evaluation
Who are stakeholders? Plan the eval - components of... - CORRECT ANSWERS SUMMATIVE Evaluation
determine the data needed for answers - component of... - CORRECT ANSWERS SUMMATIVE Evaluation
Decide where data is, how to collect it, collection instruments - components of... - CORRECT ANSWERS SUMMATIVE Evaluation
Write the narrative timeline of when & how data will be collected - component of... - CORRECT ANSWERS SUMMATIVE Evaluation
SELECTED RESPONSE test - CORRECT ANSWERS choose answer
easier to grade
higher reliability (WGU tests)
CONSTRUCTED RESPONSE test - CORRECT ANSWERS short answer, essay or other open ended questions
pain to grade
lower reliability
Components of CONSTRUCTED response: - CORRECT ANSWERS clear directions
ample space for answers
give details about what is required in answer
INTERVIEW - CORRECT ANSWERS A face-to-face or telephone questioning of a respondent to obtain desired information.
questionaire - CORRECT ANSWERS Provide answers to well-defined questions
electronic format
Closed end questions - QUALITATIVE or QUANTITATIVE? - CORRECT ANSWERS QUANTITATIVE
Likert Scales 1-5 - QUALITATIVE or QUANTITATIVE? - CORRECT ANSWERS QUANTITATIVE ####
Comparison of Pre-test vs post test scores
QUALITATIVE or QUANTITATIVE? - CORRECT ANSWERS QUANTITATIVE ####
Summative evaluation using student test scores
QUALITATIVE or QUANTITATIVE? - CORRECT ANSWERS QUANTITATIVE ###
Semantic differential scale on a continuum
QUALITATIVE or QUANTITATIVE? - CORRECT ANSWERS QUANTITATIVE ####
Interview to capture scaled responses
QUALITATIVE or QUANTITATIVE? - CORRECT ANSWERS QUANTITATIVE (scaled - #s)