Confirmed invited speakers

Harald Baayen (University of Tübingen)
Regina Nuzzo (Stanford University)
Joaquín Ordieres (Polytechnical University of Madrid)

Over the last years, the current standards for scientific discovery have repeatedly been questioned. Especially the social sciences are going through a “replicability crisis” triggered by three main causes:
1) observations and experiments are carried out on samples that are too small to properly observe the investigated effects
2) the current standard for claiming significant discoveries is based on p-values, which pose several problems (e.g. they do not indicate the size of the observed effects, they can suffer important alterations depending on small modifications of the data, eventually leading to “p-hacking”, and they are poorly understood by many researchers)
3) strong pressure for publishing only significant results has lead to a publication bias caused by the reluctance to publish negative results, which precludes a great amount of relevant data highly needed to reject type I errors (i.e. false positives) from getting published.

Some disciplines, like social psychology, are increasingly drawing attention to these issues, while others, like linguistics, have not yet addressed them satisfactorily. This workshop aims at providing an opportunity to discuss these challenges. Particularly junior linguistics researchers, who have questions on these problems but seldom find answers within the discipline, are invited to participate. The workshop will bring together renowned experts to give plenary lectures on relevant topics like sampling methods and sample sizes, p-values vs. effect sizes and bayesian statistics, cognitive biases affecting the scientific method, and strong-inferences techniques. The workshop will have a strong practical focus, combining these plenaries with short presentations by participants as well as practical sessions accompanied by the experts.

We call for presentations of 15 minutes in which doctoral and postdoctoral researchers discuss quantitative issues from, or related to, their own research. The presentations are expected to point at potential problems, which can subsequently be addressed in practical sessions with the invited experts. Participants are invited to look at a range of different topics in their presentations, such as, for example, the following:

• corpus: representativeness of corpora, sample size
• experiments: replicability, variation in and repetition of stimuli, generalizability from individual subjects to population
• extralinguistic parameters: determination of relevant factors, different kinds of populations
• methods: hypothesis testing, interpretation of p-values and other statistical measures, alternatives
• Any other relevant topic researchers would wish to address

If you are interested in participating, please send a title and a short description of your presentation proposal (approximately 200 words) to albert.wall@uzh.ch before 31 August 2017. Participation slots will be granted on a first-come-first-serve-basis, and in case of high demand, researchers from Zurich will be given preference. Participation will be confirmed in the first week of September.
Organization: Carlota de Benito Moreno, Danae Perez, Albert Wall (University of Zurich)