The Generalizability Crisis – when Verbal and Statistical Expressions Don’t Match

The Journal Club: “ReproducibiliTea” at LMU Munich continues with its 16th meeting, the fourth one for this semester. It will take place this Friday and we will talk about the The Generalizability Crisis. During this sessions we will discuss Tal Yarkoni’s paper „The generalizability crisis“ that deals with the consequences arising when verbal and statistical expressions of a hypothesis do not closely align, potentially resulting in inflated false-positive rates and mitigating validity and researchers’ generalization intentions.

Procedure: One member of our organizing team will introduce (approx. 20 minutes). We will then continue with an open discussion where you can contribute your own thoughts and questions. Finally, there will be time to get to know each other and talk in smaller groups.

Concept of the Journal Club

The interdisciplinary journal club “ReproducibiliTea” is launched every 3-4 weeks and addresses main questions and current topics concerning Open Science and the credibility of research findings. The idea - originated from Great Britain - was already developed in many other countries using the same name. During on-site meetings tea, juice and small snacks are provided to live up to the slogan. However, some meetings are held online due to organizational reasons. No matter where the sessions take place, everybody is welcome to bring their own food and drinks and thus connect the journal club with their lunch break.

The Journal Club consists of open talk sessions for discussing Open Science, reproducibility, and other related issues and is explicitly open to all disciplines and institutions to create the most interesting interchange. Each session starts with a short talk about the paper and then continues with an open discussion in which you can contribute your own thoughts and questions.

During a longer break between 2020 and 2021, the concept was slightly revised, and the organization team decided to invite the speaker(s) of the respective paper that is discussed in each session. The author herself/himself starts with the introductory talk including a short summary of the paper. Afterwards, there is enough time for direct interaction with the author(s) and, as before, an open discussion with all of the participants.

You are warmly welcome to join the next meetings. You can simply send an e-mail to reproducibilitea.munich@gmail.com to join the mailing list to get information about the next meetings and chosen papers. For each session it would be helpful to have read the announced paper, but there is no obligation to do so.

The organization team is looking forward to seeing you at one of the next Journal Club sessions.

organization team:

• Laura Goetz, Medical Student at LMU Munich
• Stephan Nuding, PhD Student at the Chair of Social Psychology
• Leonhard Schramm, Psychology Student at LMU Munich
• Franka Etzel, Psychology Student at LMU Munich
• Viktoria Wiegelmann, Psychology Student at LMU Munich
• Gracia Pruem, Psychology Student at LMU Munich
• Finia Loeb, Psychology Student at LMU Munich