Psychological Assessment Test: Validity, Reliability, and Construct Validity, Exams of Psychology

A comprehensive overview of psychological assessment tests, focusing on key concepts like validity, reliability, and construct validity. It delves into different types of validity, including content validity, criterion-related validity, and construct validity, explaining their significance in evaluating the effectiveness of psychological assessments. The document also explores various scaling methods, item analysis techniques, and the importance of test construction principles for ensuring accurate and reliable assessments.

Typology: Exams

2024/2025

Available from 02/18/2025

DrShirleyAurora
DrShirleyAurora 🇺🇸

4.4

(9)

6.1K documents

1 / 18

Toggle sidebar

This page cannot be seen from the preview

Don't miss anything!

bg1
Psychological Assessment Test 2
Validity -
A test is valid to the extent that influences made from the Standard for Educational and
Psychological Testing
Content Validity -
Determined degree to which the questions, tasks, or items on a test are representative of the
universe of behavior test was designed to sample
Quantification of Content Validity -
2 expert judges rank items an agree on strong relevant items
IF trait is ill-defined, no measure of validity can be made
Face Validity -
- Not validity at all
- Looks valid to test users, examiners, and examinees at FACE value
Criterion-related Validity -
When a test is shown to be effective in estimating an examinee's performance on some outcome
measure
Concurrent Validity -
Criterion measures or obtained at approximately the same time as the test score
- Licensing exam or achievement test
- Good when the test score correlates to other tests already out there
Predictive Validity -
A score on a scale or test predicts scores on some criterion measure
- Entrance exams and emplment tests
1 | P a g e
pf3
pf4
pf5
pf8
pf9
pfa
pfd
pfe
pff
pf12

Partial preview of the text

Download Psychological Assessment Test: Validity, Reliability, and Construct Validity and more Exams Psychology in PDF only on Docsity!

Psychological Assessment Test 2

Validity - ✅A test is valid to the extent that influences made from the Standard for Educational and Psychological Testing Content Validity - ✅Determined degree to which the questions, tasks, or items on a test are representative of the universe of behavior test was designed to sample Quantification of Content Validity - ✅2 expert judges rank items an agree on strong relevant items IF trait is ill-defined, no measure of validity can be made Face Validity - ✅- Not validity at all

  • Looks valid to test users, examiners, and examinees at FACE value Criterion-related Validity - ✅When a test is shown to be effective in estimating an examinee's performance on some outcome measure Concurrent Validity - ✅Criterion measures or obtained at approximately the same time as the test score
  • Licensing exam or achievement test
  • Good when the test score correlates to other tests already out there Predictive Validity - ✅A score on a scale or test predicts scores on some criterion measure
  • Entrance exams and emplment tests
  • Who's to succeed in a future endeavor Regression Equation - ✅Describes the best-fitting straight line for estimating the criterion from the test
  • let's us determine the specific relation of the Predictor and the OUTCOME Standard Error of Estimate - ✅The margin of error to be expected in the predicted criterion score.
  • Formula:
  • Index and standard error help gauge margins of error Decision Theory - ✅Purpose of psychological testing is not measurement per se but measurement in the service of decision making. Decision Theory Assumptions - ✅- 1. The value of various outcomes to the institution can be expressed in terms of a common utility scale.
    1. In institutional selection decisions, the most generally useful strategy is one that maximizes the average gain on the utility scale over many decisions Construct - ✅Theoretical, intangible quality of trait which individuals differ Construct Validity - ✅defines how well a test or experiment measures up to its claims. A test designed to measure depression must only measure that particular construct, not closely related ideals such as anxiety or stress.

Multitrait-Multimethod Matrix - ✅Rich sources of data on reliability, convergent validity, and discriminant validity Factor Analysis - ✅- Statistical technique that is used for investigating construct validity

  • Identify minimum number of factors required to account for the inter-correlations among the battery of test -Correlation between individual test and a single factor Classification Accuracy - ✅Sensitivity and Specificity
  • HElps in dichotomous diagnostic situation in which individualizes are presumed to manifest a syndrome or not
  • 80%-90% of sensitivity or specificity to justify use Extravalidity - ✅Include side effects and unintended consequences of testing Test - ✅Clear idea of what test is to measure and how it is to differ from existing instruments research adds to our understanding of intelligence an looks towards measuring future constructs Nominal Scale - ✅Number serve as cateory Ordinal Scale - ✅A form of order ranking
  • Doesnt tell you how spread out that are Intercal - ✅Provides information about ranking = Metric gauging of differences between ranking Ratio - ✅MEANINGFUL 0 Which scale is the best for test construction? - ✅Interval and Ratio Scales
  • Due to being more powerful and useful parametric statistical procedues Expert Ranking - ✅Experts judge patients and scores them as pariticpants do a test Method of Equal-Appearing Intervals - ✅- Beck Depression Scale Method of Absolute Scaling - ✅Procedure fr obtaining a measure of absolute item difficulty based on results fr different age groups of test takers Likert Scale - ✅Simple Straightforward method for scaling Attitudes Empirical Keying - ✅Test items are selected for a scale based interiely on how well they contrast a criterion group from a normative sample
  • Empirical consideration devoid of theory or expert judgement
  • Souley of stats

Revising a Test - ✅1. Item Analysis

  1. Cross Validation: The practice of using the original regression equation in a new sample to see if test predicts the same criterion as well
  2. Feedback from Examinees Publishing the Test - ✅1. Techinical Manual: Data about a new instrument are usually summarized with appropriate references in this
  3. User's Manual: Gives instruction for administrations and provides guidelines for test interpretation Definition of Intelligence - ✅- Operational Def: Defines a concept in terms of the way it is measured
  • Real Def: Seeks to tell us true nature of the thing being defined
  • Two THEMES: Capacity to learn from experience and to adapt to environments Wechsler's Defnition of intelligence - ✅The aggregate or global capacity of the individual to act purposefully, to think rationally, and to deal effectively with the environment Confirmatory Factor Analysis - ✅To confirm that test scorers and variables fit a certain pattern predicted by a theory Exploratory Factor Analysis - ✅Summarize the interrelationships among large number of variables into concise and accurate manner as an aid in conceptualization Correlation Matrix - ✅Complete table of inter-correlations of all variables Galton's Theory of Intelligence -

✅Sensory Keenness

  • Intelligence could be measured by sensory ailities
  • RT: Time the subjects takes to remove his or her finger from button
  • MT : Interval between removing the finger and touching button that turns off green light Spearmen's Theory of Intelligence - ✅Intelligence consisted of two kinds of factors
  • g Factor: pervasive general factor
  • s Factor: factor specific to the test Test should look for the g Factor not the s Factor g Factor - ✅3 Principles of Cognition
  1. Apprehension of experience
  2. Education of relations
  3. Education of correlations (education means process of finding things out Thurstone's Theory of Intelligence - ✅PRIMARY MENTAL ABILITIES: Several broad group factors could best explain empirical results
  • Verbal Comprehension
  • Word FLuency
  • Number
  • Spatial
  • Associative Memory
  • Perceptual Speed
  • Inductive Reasoning

Planning, Attention, Simultaneous, and Successive Pass Theory - ✅- Case studies and clinical observations of brain-injured soldiers to arrive at a general theory of cognitive processing

  • focuses on the mechanics by which information if procesed simultaneous processing - ✅Info is characterized by execution of several different mental operations simultaniously SPATIAL ANALYSIS RIGHT BRAIN Successive Processing - ✅Mental activities in which a proper sequence of operations must e follow LEFT BRAIN Information Processing Theories of Intelligence - ✅Architectural System: -biologically based properties necessary for information processing
    • Memory spand and speed of encoding information Executive System:
    • environmentally learned components that steer problem solving Gardner and the Theory of Multiple Intelligence - ✅- Study of brain-behavior relationships
  • Argues for the existence of several relatively independent human intelligence
  • Savant: Mentally deficient individual who developed talent in a single

Sternberg Theory of Intelligence - ✅Triarchic Theory of Successful Intelligence: 3 aspects of intelligence

    1. Componential Intelligence: Analytical
    1. Experimental Intelligence: Creative
    1. Contextual Intelligence: Practical Wechsler First Test - ✅ 1932 New Age-relative Formula for Wechsler Test - ✅IQ = Attained or actual score / Expected Mean Score for Age Assumption of IQ constancy is basic for Wechsler Scales Mean and Standrad Deviation for Wechsler for IQ - ✅Mean: 100 SD: 15 (Every version of test gets harder, but with new formula the mean and standard deviation are the same) IQ is STABLE Stanford-Binet 5th Edition - ✅- suitable for ages 2 -
  • Routing Procedure: estimating of general cognitive ability of examinee before the test to identify appropriate starting points
  • includes high-end items to assess highest leel of gifted performance

Raven's Progessive Matters (RPM) - ✅Did not measure g Factor well Useful index of nonverbal, figural reasoning Known for using supplemental testing of children and adults with hearing, language, or physical disabilities Perspective on Culture-Fair Tests - ✅- Intelligence test are just samples of what people know and can do

  • Knowledge is based in culture and acquired over time
  • No such thing as culture-free test Differential Aptitude Test (DAT) - ✅8 Independent Tests
  1. Verbal Reasoning
  2. Numerical Reasoning
  3. Abstract Reasoning
  4. Perceptual Speed and Accuracy
  5. Mechanical Reasoning
  6. Space Relatins
  7. Spelling
  8. Language Usage General Aptitude Test Battery (GATB) - ✅- Made for predicting performance
  • 8 Paper-Pencil Tests and 4 Apparatus
  • 2.5 hours long
  • 9 Factor scores, mean of 100 and SD of 20 Armed Services Vocational Aptittude Battery (ASVAB) - ✅- Researched from CAT since 1980s
  • Reasons it's a good tests:
  1. Shotern overall testing time
  2. Increases secruity by eliminating chance of it being stolen
  3. Increases precision
  4. Provides a means for immediate feedback
  5. Gives consitent means for flexible start times The Scholastic Assessment Test (SAT) - ✅- Criterion-Related Validity
  • .42 correlation of SAT scores and first-year college GPA
  • Restriction of range, Low SAT scoring high schoolers do not usually attend college
  • ACT also Postgraduate Selection Tests - ✅a. Graduate Record Exame
  • Strong Reliability
  • Correlation between grad school grade and GRE score is very small b. MCAT c. Law School Admission Test (LSAT)

Qualified Individualism - ✅- Radically different in definition

  • Unethical to discriminate, but race and gender can me taken in as a factor Genetic Contribution to Intelligence - ✅- Adoption studies, familial research, and twin projects proves this
  • Heritability estimates right around .5 so HALF of the variability in IQ scores is from genetic factors Environment Effects to intelligence - ✅- Impoverishment
  • Enrichment Teratogenic Effects on Intelligence - ✅- Teratogens that cross the placental barrier and cause physical deformities
  1. Fetal Alcohol Syndrome
    • Weight below the 10th percentile after
    • Central Nervous System Dysfunction: Skull or braind malformations, mental retardation, neurological abnormalities, behavior problems
    • Facial Dysmorpholofy Effects of Environmental Toxins on Intelligence - ✅????? gonna take a guess here because im too lazy to read the book
  • Smog, chemicals in fertilizers, chemicals in animals have effects on our minds Tenability of Genetic Hypothesis - ✅- CRITICISM: Genetic hypothesis is based on questionable assumption that evidence of IQ heritability withing groups can be used to infer heritability between groups
  • CRITICISM: Race as a biological entity is simple nonexistence, that there are no biological races Schaie's Cross-Sequential Study f adult Mental abilities - ✅- Your mental abiltiies slow down as you et older
  • Newer genertations know more than older generations
  • Showed a tendency for mean scores either to rise silightly r to remade constant until age 60 or 70
  • Dont lose smarts and continue to learn Flynn Effect - ✅The rise in average IQ scores that has occurred over the decades in many nations
  • IMPERATIVE to re-standardize tests frequently, or norms in the test will be obsolete WAIS-4 Vocabulary Section - ✅Single BEST tubtest of overall intelligence Wais-4 Digit Symbol - ✅Heavily memory based subtest Deteriorates with age WAIS-4 Block Design - ✅Spatial Task Wais-4 Matrix Reasoning - ✅MEasures Fluid Intelligence maniplutation of abstract symbols