Summary
Summary PYC4807 Chapter 4 & 5
- Institution
- University Of South Africa (Unisa)
Chapters covered are Reliability & Validity
[Show more]
Content preview
CHAPTER 4 RELIABILITYDEFINING RELIABILITY
For an instrument to have sound psychometric characteristics, it should have test reliability.
Reliability = the consistency with which it measures whatever it measures
To obtain R measures we have to apply 3 aspects consistently:
1. What the entity is that we are measuring eg weight/height
2. What the nature of the measure is eg ruler, scale
3. Application of the rules on how to measure the object eg with/without clothes or shoes
The goal of estimating reliability is:
Determine how much of the variability in test scores is due to errors in measurement and how much
is due to variability in true scores.
True score = the replicable feature of the concept being measured. It is the part of the observed
score that would recur across different measurement occasions in the absence of error.
Errors of measurement = composed of both random error and systematic error. Represents the
discrepancies between scores obtained on tests and the corresponding true scores.
We never know a person’s true score so we use observed data to compute the reliability of tests.
Reliability coefficient = numerical expression for reliability
TYPES OF RELIABILITY
1)Test-retest reliability 2) Alternate-form reliability 3) Split half reliability
4) Inter-item consistency(Kuder-Richardson & Cronbach Alpha) 5) Inter-scorer reliability
1)Test-retest reliability:
= Repeating the test to the same group on a different occasion
The reliability coefficient (rc) is correlation between 1st & 2nd test also known as coefficient of
stability
The interval between retests should not exceed 6 months so that the changes are random and not
cumulative or progressive
Disadvantages:
- Test takers circumstances change eg illness, emotions, fatigue…
1
, - The physical environment alters eg venue, weather, noise….
- Transfer effects:
o Practice could equate to improvement of score
o Short interval between re test may result in recall
Generally not appropriate for computing reliability.
2) Alternate-form reliability
= Administering an alternate form of the same test to the same group on a different occasion
The RC is correlation between 1st & 2nd test also known as coefficient of equivalence (if
administered close together). If administered several days apart it’s known as coefficient of stability
& equivalence.
Difference between the scores illustrates the type of error variance under consideration.
The 2 measures need to be truly equivalent eg same # of items, scoring procedure…..
Disadvantages:
• Difficult to create several alternate forms of a test
• Difficult if not impossible to guarantee that two alternate forms of a test are parallel measures
• Not available for many tests due to practicality of producing equivalent forms
3) Split-half reliability
= Administering a test to a group of individuals and then splitting the test in half and correlating scores
on one half of the test with scores on the other half.
The RC is correlation between two split halves also known as coefficient of internal consistency.
This halves reliability. Estimate is then stepped up to the full test length using the Spearman–Brown
prediction formula.
Most common way to split a test is to take odd and even items not the 1st & the 2nd halves as tests do
get harder.
4) Inter-item consistency(Kuder-Richardson & Cronbach Alpha)
= based on the consistency of responses to all items in the measure
To calculate the reliability of item scores of 1 or 0 (dichotomous) you use Kudar-Richardson 20
(KR20)
2
The benefits of buying summaries with Stuvia:
Guaranteed quality through customer reviews
Stuvia customers have reviewed more than 700,000 summaries. This how you know that you are buying the best documents.
Quick and easy check-out
You can quickly pay through EFT, credit card or Stuvia-credit for the summaries. There is no membership needed.
Focus on what matters
Your fellow students write the study notes themselves, which is why the documents are always reliable and up-to-date. This ensures you quickly get to the core!
Frequently asked questions
What do I get when I buy this document?
You get a PDF, available immediately after your purchase. The purchased document is accessible anytime, anywhere and indefinitely through your profile.
Satisfaction guarantee: how does it work?
Our satisfaction guarantee ensures that you always find a study document that suits you well. You fill out a form, and our customer service team takes care of the rest.
Who am I buying this summary from?
Stuvia is a marketplace, so you are not buying this document from us, but from seller thestudyshack. Stuvia facilitates payment to the seller.
Will I be stuck with a subscription?
No, you only buy this summary for R60,00. You're not tied to anything after your purchase.
Can Stuvia be trusted?
4.6 stars on Google & Trustpilot (+1000 reviews)
83225 documents were sold in the last 30 days
Founded in 2010, the go-to place to buy summaries for 14 years now