









Study with the several resources on Docsity
Earn points by helping other students or get them with a premium plan
Prepare for your exams
Study with the several resources on Docsity
Earn points to download
Earn points by helping other students or get them with a premium plan
PSYC 2080 MIDTERM 1 VERIFIED ACCURATE STUDY GUIDE
Typology: Exams
1 / 15
This page cannot be seen from the preview
Don't miss anything!










Measurement - Answers - act of identifying properties of an object. Measurement Theory - Answers - field of stats that describes and evaluates quality of measurements latent construct - Answers - latent- unobservable construct- domain of behaviours operational definition - Answers - ex ability to recall digits is the ___ for working memory achievement test - Answers - assess prior learning aptitude test - Answers - assess potential to learn, specific task/skill/narrow intelligence test - Answers - ability to solve problems and think abstractly/relative ability in global areas personality tests - Answers - assess traits, qualities, behaviours that determine individuality (overt and covert) Personality test (structured) - Answers - accept or reject statements of one's self, self- report Personality test (projective) - Answers - reactions to ambiguous stimuli are recorded and interpreted
Test - Answers - technique to quantify a behaviour, systematic procedure for comparing behaviour of two people (Cronbach) test item - Answers - specific stimuli that produces response, many items for proper test psychometrics - Answers - science of evaluating characteristics of psychological tests Criterion referenced tests - Answers - decisions made in comparison to a cut-off score ex min score Norm-referenced tests - Answers - score is compared to reference sample o expected score from population
u= population average N= population number
observed SD * root(1-coefficient of reliability) domain sampling theory - Answers - · Avoid making assumption of parallel tests · have a limited number of items out of larger pool of items · assume subset represents larger pool of all items · Then two tests can be constructed out of diff subsets of items and correlation between them would estimate reliability · Reliability conceptualized by how well true score is measured when using asubset of all items · Ex Depression, we assume that a given depression test could have been constructed with diff items from pool of depression items generalizability theory - Answers - · extension of CTT · Can deal with fact that a test may measure multiple concepts rather than assumed single · helps relax many assumptions by introducing a more complex model to estimate reliability Item Response Theory - Answers - · Solves several problems with CTT · Ex: under IRT individuals can receive different versions of test (Under CTT, test composition is integral to reliability) · IRT expanded w advancement of computers commonly used in field of education test-retest - Answers - · The same test applied on two different occasions · can examine error associated w administering test at diff times · correlation between tests is reliability (coefficient of stability) · only meaningful if true score does not change over time · must also assume error variance is stable over time carryover effects - Answers - where information gained by writing test carries over to the second time writing · When carryover effect is consistent, no impact to reliability · carryover only shifts response distribution left/right and does not change reliability · becomes impossible to estimate true reliability because we do not know direction of bias (reliability over- or underestimated?) · acceptable reliability of method ranges from >0.9 (education) to 0.8-0.9 (personality) parallel forms reliability - Answers - · Compare two equivalent forms of test that measure same construct but made of diff items from pool of items, given at same time · link to domain sampling theory · coefficient of equivalence · When two tests given at same time, only diff in variability should be test items
· not used often due to six assumptions · sometimes no resources so parallel form would be 2 tests constructed out of single test post-administration internal consistency - Answers - assessment of reliability via within-test configurations split-half reliability - Answers - - Divide a test into two halves, scored separately, and compared
highly, low - Answers - If two tests are ___ correlated, reliability of difference score will be ___ change score - Answers - When difference score is between same test discrepancy score - Answers - When difference score is between two different tests more - Answers - change score is ___ likely to be correlated than discrepancy score Validity - Answers - whether a test measures what it is meant to measure Guidelines of validity - Answers - · 1. The test response process · 2. The internal structure of the test · 3. The relationship between the test and related variables · 4. The consequence of testing construct validity - Answers - does test appear to mean what we intend it to? (Whether items are mathematically related to construct) · In addition to item correlations we ask how test relates to other types of tests · When no good criterion exists, construct validity becomes even more important · when construct not well defined, construct validity can help operationalize construct by seeing how different items relate to it · For multidimensional tests, may need multiple other tests to establish differing relationships · Cronbach was supporter of establishing construct validity model · Some argue Construct Validity is backbone that holds all other validity types together Correlational, Group differences, Factor analytical, and Multitrait-multi-methods - Answers - Four major studies to examine construct validity Substantive Stage, Structural Stage, Final state - Answers - 3 stages of construct validity Substantive Stage of construct validity - Answers - · We define theoretical domains of construct · How should construct be measured? · This stage is theory driven · Strongly linked to content validity structural stage of construct validity - Answers - · What are the internal relationships among items and domains that operationalize the construct? · Do items behave in ways that we would expect based on our theories and research? · examine how items relate to latent construct (item loading)
· also examine for possibility of subscales, subsets of items that are very correlated to each other but not to others. · use Exploratory and Confirmatory Factor Analysis (EFA, CFA) to establish this stage · look to obtain moderate to high item correlations and factor loadings and for the internal structures to reflect theory rather than being a fragment from statistical method · Item correlations help assess item homogeneity - items of a construct should relate to a common trait/attribute · want homogeneous tests because they have better psychometric properties (ex reliability is higher when items are homogenous) · Item homogeneity is typically first thing examined in structural stage · No criteria for how high a correlation needs to be for items to be considered homogenous item loading - Answers - how items relate to latent construct subscales - Answers - subsets of items that are very correlated to each other but not to the others. item homogeneity - Answers - items of a construct should relate to a common trait/attribute
· When Screen plot sees a substantial drop and levels off, called the hinge (point of drop is dimensionality) · then rotate items: plot all items on graph, where each axis is a dimension · distance from axis indicates the factor loading, similar in concept to correlation or relation of item to a specific dimension · By rotating axis we can try to maximize relationships btwn items and dimension / construct. · Rotations necessary because factor loadings of item are not set; there is an infinite number of solutions to satisfy mathematical equation that is used to attach items to each dimension (factor indeterminacy) · means our goal is to rotate dimensions to identify a set of factor loadings that satisfy some equation while maximizing # of 0s (no loadings) on other dimensions while maximizing item correlations Orthogonal rotation - Answers - dimensions not allowed to be related to each other; forced to be independent by program