Lecture 7 Effect sizes and Item-rest correlation 14
Confidence intervals and measurement error 14
Effect sizes and statistical significance 14
Item discrimination and internal consistency 15
Lecture 8 Validity 17
Content validity 17
Internal validity 17
Response process validity 17
Associations with other variables 17
Consequential validity 17
Lecture 9 Convergent and discriminant validity 19
Types of correlations 19
Factors affecting predictive validity (for admission purpose) 20
, Interpretative approach (estimating practical effects) 20
Analysis of test sensitivity and specificity 21
Lecture 10 Item response theory and Rasch models 22
Item response theory (IRT) = modern test theory 22
IRT measurement models 22
Item information and test information 23
Lecture 11 IRT in practice 25
Purpose of item response theory 25
Comparing IRT and CTT 26
True score in IRT 26
Lecture 12 Test bias 27
Types of test bias 27
Ways of evaluation construct bias 27
External methods to identify predictive bias 27
Intercept bias 28
Slope bias 28
Intercept and slope bias 28
, Lecture 1: introduction and basic knowledge of
statistics
Test theory: developing and ensuring high-quality psychological tests to measure not
directly observable properties.
In tests, items are indicators for the construct (like perfectionism). Answers are assigned
scores, which are transformed into test scores and then interpreted.
Psychological test is a systematic procedure for comparing the behavior of 2 or more
people (Cronbach). Aimed at measuring behavior (observable), samples collected in a
systemic way (objective), and compare behaviors of multiple people or same people over
time (comparative).
Maximum performance tests: measuring maximum skills
1. Speeded tests: time-limited tests to measure performance, count number of
questions answered.
2. Power tests: measure skills without time pressure, count number of questions
correct.
Typical performance tests: measuring personality traits, attitudes and disorders.
Criterion referenced tests: compare people with an absolute standard of skill level. A
person’s performance is either above or belong the performance criterion.
Norm reference tests: compare people with the rest of the population.
Reflective/effect indicators: a hypothetical construct (intelligence) causes someone’s
responses on an intelligence test.
Formative/causal indicators: indicators of SES (income, educations) are the things that
define SES.
Psychometrics: the science on evaluation the attributes of psychological tests
1. Type of information
2. The reliability of data from psychological tests
3. Issues concerning the validity of data obtained from psychological tests
Measurement challenges
1. Participant reactivity: people change their behavior because they know they are
being measured.
2. Data collectors may be biased.
3. Score sensitivity: ability of a measure to discriminate between meaningful amounts or
units of the dimension being measured.
High variance and covariance between item scores is desirable because item scores are
intended to reveal differences between people.
correlation is also important, some score high on all items and some score low on all items,
also causing more variance.
The benefits of buying summaries with Stuvia:
Guaranteed quality through customer reviews
Stuvia customers have reviewed more than 700,000 summaries. This how you know that you are buying the best documents.
Quick and easy check-out
You can quickly pay through credit card or Stuvia-credit for the summaries. There is no membership needed.
Focus on what matters
Your fellow students write the study notes themselves, which is why the documents are always reliable and up-to-date. This ensures you quickly get to the core!
Frequently asked questions
What do I get when I buy this document?
You get a PDF, available immediately after your purchase. The purchased document is accessible anytime, anywhere and indefinitely through your profile.
Satisfaction guarantee: how does it work?
Our satisfaction guarantee ensures that you always find a study document that suits you well. You fill out a form, and our customer service team takes care of the rest.
Who am I buying these notes from?
Stuvia is a marketplace, so you are not buying this document from us, but from seller sanaezaaboul. Stuvia facilitates payment to the seller.
Will I be stuck with a subscription?
No, you only buy these notes for $7.93. You're not tied to anything after your purchase.