Zusammenfassung
Summary AMDA Spring: Topic 1 & 2 Reproducability and Mediation/Moderation
- Kurs
- Hochschule
AMDA Spring Chapter 0: reproducable research and Chapter 1: Mediation and Moderation
[ Mehr anzeigen ]vorschau 3 aus 19 Seiten
Vorschau 3 aus 19 Seiten
In den Einkaufswagen
In den Einkaufswagen
Verkäufer
Folgen
fionabrosig
Deine Reviews
Inhaltsvorschau
1Applied Multivariate Data Analysis –
Spring
Please do not share this with your fellow students. I have put a lot of work into this and hope to
have put a low/fair price on it. SO that people who need it can afford it.
Would be greatly appreciated. Thanks you!!
Now good luck studying!
, 2
0. Planning for reproducible research
● The aim as researchers:
● In the last years it has been found that research was not reproducible. = reproducible
crisis
○ This is not specific to psychology, but also in other sciences.
● It seems that researchers are exploiting grey zones. Even unintentional uses of those grey
zones can significantly change the outcome of a study.
○ Usually the guideline that is used to say there is a significant result is .05. This
means that in 5% of the cases we are still wrong. By using the grey zones (such as
having more dependent variables, adding observations, dropping conditions, and
controlling for variables) can significantly increase this rate (up to 60%, instead of 5)
○ Research has found that these practices are being used quite frequently
But what can we do to solve this problem?
- The most agreed upon techniques are pre-registration of study plans, reproducibility
practices, and standardizing definitions and analysis.
- Others are sharing data, better statistical methods, improved study design standards, peer
reviewing, etc.
Robustness checks
1. Checking the written report (e.g. are numbers correct?)
2. Reproducibility (does re-analysis of the same data give the same outcome?)
3. Bias present? (e.g. sensitivity to researcher decisions: multiverse analysis, p-curve; was
bias constrained by preregistration?)
4. Replication (independent lab repeats methods)
→ together make science self-correcting
Making your work more robust:
● Planning the analysis
● Reproducible practices
, 3
Planning the analysis
● You need to think through your work and make a plan that includes multiple things of how
you will perform the analysis. This prevents the possibility to make decisions later on that
can (even unconsciously) be biased and cause your results to be skewed to what you want
it to be.
○ So.. create a data analysis plan, even before you collect data: including
■ The research question;
■ The hypotheses (null and alternative);
■ The population;
■ The sampling plan
■ The sample size (e.g. power analysis; stopping rules);
■ The statistical analysis;
■ The assumptions of the statistical analysis;
■ What to do if the assumptions are not true
■ How to detect and handle outliers/ influential cases / missing data
■ The possible outcomes of the analysis
■ What to do for each of the possible outcomes
● Benefits of planning:
○ Everyone on the team is on the same page before the start. This way you can also
make sure that when people are not working at the same time or on the same task,
that everyone still knows what to do, etc.
○ Design/analysis is well thought through and biased decisions can be prevented
○ Protect yourself again biases (e.g. confirmation bias)
○ Clear divide between confirmatory and exploratory
■ You can still run analysis that you did not plan to do from the beginning. You
will just have to put them under exploratory analysis. This creates a clear
distinction between what is actually confirmatory and what is exploratory.
○ ‘Relief’ if you run the planned analysis knowing you don’t have to tweak it anymore
○ List goes on (especially when registering at a journal, ‘RRs’)
■ For example, they will more likely be willing to also publish non-sig. Findings.
Because you have registered it beforehand and then they already made
some form of contact with you and your work and also they can “approve “ it
beforehand, again binding them more to the publication of the final results
Generally: the more specific the plan, the better the plan. analytic flexibility is constrained
Less ambiguity means that others will interpret your plan the same way
The how:
○ Make a detailed plan, when possible pre-register it
○ Have others check you by seeing if they can interpret your plan differently
○ Try out your planned analysis on fake/simulated data
○ Write out the results section without the numbers to see what you will be able to
conclude/interpret
○ Make transparent in your writing which part sticks to the plan, which part deviate
■ Planned part will be more reliable, unplanned prone to chance/bias
Alle Vorteile der Zusammenfassungen von Stuvia auf einen Blick:
Garantiert gute Qualität durch Reviews
Stuvia Verkäufer haben mehr als 700.000 Zusammenfassungen beurteilt. Deshalb weißt du dass du das beste Dokument kaufst.
Schnell und einfach kaufen
Man bezahlt schnell und einfach mit iDeal, Kreditkarte oder Stuvia-Kredit für die Zusammenfassungen. Man braucht keine Mitgliedschaft.
Konzentration auf den Kern der Sache
Deine Mitstudenten schreiben die Zusammenfassungen. Deshalb enthalten die Zusammenfassungen immer aktuelle, zuverlässige und up-to-date Informationen. Damit kommst du schnell zum Kern der Sache.
Häufig gestellte Fragen
Was bekomme ich, wenn ich dieses Dokument kaufe?
Du erhältst eine PDF-Datei, die sofort nach dem Kauf verfügbar ist. Das gekaufte Dokument ist jederzeit, überall und unbegrenzt über dein Profil zugänglich.
Zufriedenheitsgarantie: Wie funktioniert das?
Unsere Zufriedenheitsgarantie sorgt dafür, dass du immer eine Lernunterlage findest, die zu dir passt. Du füllst ein Formular aus und unser Kundendienstteam kümmert sich um den Rest.
Wem kaufe ich diese Zusammenfassung ab?
Stuvia ist ein Marktplatz, du kaufst dieses Dokument also nicht von uns, sondern vom Verkäufer fionabrosig. Stuvia erleichtert die Zahlung an den Verkäufer.
Werde ich an ein Abonnement gebunden sein?
Nein, du kaufst diese Zusammenfassung nur für 4,99 €. Du bist nach deinem Kauf an nichts gebunden.
Kann man Stuvia trauen?
4.6 Sterne auf Google & Trustpilot (+1000 reviews)
45.681 Zusammenfassungen wurden in den letzten 30 Tagen verkauft
Gegründet 2010, seit 14 Jahren die erste Adresse für Zusammenfassungen