How statistically non-significant results are reported and interpreted following null hypothesis significance testing is often criticized. This issue is important for animal cognition research because studies in the field are often underpowered to detect theoretically meaningful effect sizes, i.e., often produce non-significant p-values even when the null hypothesis is incorrect. Thus, we manually extracted and classified how researchers report and interpret non-significant p-values and examined the p-value distribution of these non-significant results across published articles in animal cognition and related fields. We found a large amount of heterogeneity in how researchers report statistically non-significant p-values in the result sections of articles, and how they interpret them in the titles and abstracts. Reporting of the non-significant results as “No Effect” was common in the titles (84%), abstracts (64%), and results sections (41%) of papers, whereas reporting of the results as “Non-Significant” was less common in the titles (0%) and abstracts (26%), but was present in the results (52%). Discussions of effect sizes were rare (<5% of articles). A p-value distribution analysis was consistent with research being performed with low power of statistical tests to detect effect sizes of interest. These findings suggest that researchers in animal cognition should pay close attention to the evidence used to support claims of absence of effects in the literature, and—in their own work—report statistically non-significant results clearly and formally correct, as well as use more formal methods of assessing evidence against theoretical predictions.

Null Hypothesis Significance Testing is a statistical procedure widely used in cognitive development research. There is widespread concern that the results of this statistical procedure are misinterpreted and lead to unsubstantiated claims about studies’ outcomes. Two particularly pertinent issues for research on cognitive development are: i) treating a non-significant result as evidence of no difference or no effect, and ii) treating a non-significant result in one group/condition and a significant result in another as evidence of a difference between groups/conditions. The current study focuses on quantifying the extent to which these two issues can be observed in the published literature on cognitive development. To this end, we will systematically search for empirical studies investigating cognitive development in 0-to-16-year-old children that have been published at two time points, namely in 1999 and 2019. For each of the two issues, we will extract information from 300 published articles, 150 per publication year.

Scholastic factors (academic achievement) are hypothesized to be important determinants of health-related behaviors in adolescents, but there is a lack of knowledge on their influence on physical activity levels (PAL), especially considering the COVID-19 pandemic and the imposed lockdown. This study aimed to investigate the associations between scholastic factors and PAL before and during the pandemic lockdown. The participants were adolescents form Bosnia and Herzegovina (n = 525, 46% females), who were observed prospectively at the baseline (before the pandemic lockdown) and during the lockdown in 2020 (follow-up). The scholastic factors (grade point average, behavioral grade, school absences, unexcused absences) were evidenced at the baseline (predictors). The outcome (PAL) was evaluated using the Physical Activity Questionnaire for Adolescents at the baseline and the follow-up. Gender, age, parental/familial conflict, and sport participation were observed as confounders. No significant influence of the predictors on PAL were evidenced at the baseline or at the follow-up. The scholastic variables were significantly associated with the changes of PAL which occurred due to pandemic lockdown, with a lower risk for negative changes in PAL among adolescents who were better in school (OR = 0.56, 95%CI: 0.34–0.81, and OR = 0.66, 95%CI: 0.34–0.97, for the grade point average and behavioral grade, respectively). Students who do well in school are probably more aware of the health benefits of proper PAL, and therefore are devoted to the maintenance of their PAL even during the home-confinement of lockdown. Public health authorities should focus more on helping adolescents to understand the importance and benefits of proper PAL throughout the school system.

Eurasian jays have been reported to protect their caches by responding to cues about either the visual perspective or current desire of an observing conspecific, similarly to other corvids. Here, we used established paradigms to test whether these birds can – like humans – integrate multiple cues about different mental states and perform an optimal response accordingly. Across five experiments, which also include replications of previous work, we found little evidence that our jays adjusted their caching behaviour in line with the visual perspective and current desire of another agent, neither by integrating these social cues nor by responding to only one type of cue independently. These results raise questions about the reliability of the previously reported effects and highlight several key issues affecting reliability in comparative cognition research.

To promote collaboration across canine science, address reproducibility issues, and advance open science practices within animal cognition, we have launched the ManyDogs consortium, modeled on similar ManyX projects in other fields. We aimed to create a collaborative network that (a) uses large, diverse samples to investigate and replicate findings, (b) promotes open science practices of preregistering hypotheses, methods, and analysis plans, (c) investigates the influence of differences across populations and breeds, and (d) examines how different research methods and testing environments influence the robustness of results. Our first study combines a phenomenon that appears to be highly robust, dogs’ ability to follow human pointing, with a question that remains controversial: do dogs interpret pointing as an informative gesture, as an imperative command, or as a simple associative cue? We collected preliminary data (N = 61) from a single laboratory on two conditions of a 2-alternative object choice task: (1) Ostensive (experimenter pointed to a baited cup after making eye-contact and saying the dog’s name); (2) Non-ostensive (experimenter pointed to a baited cup without making eye-contact or saying the dog’s name). Dogs followed the ostensive point, but not the non-ostensive point, significantly more often than expected by chance. Preliminary results also provided suggestive evidence for variability in point-following across dog breeds. The next phase is the global participation stage of the project. We propose to replicate this protocol in a large and diverse sample of research sites, simultaneously assessing replicability between labs and further investigating the question of dogs’ point-following comprehension.

Replication is an important tool used to test and develop scientific theories. Areas of biomedical and psychological research have experienced a replication crisis, in which many published findings failed to replicate. Following this, many other scientific disciplines have been interested in the robustness of their own findings. This chapter examines replication in primate cognitive studies. First, it discusses the frequency and success of replication studies in primate cognition and explores the challenges researchers face when designing and interpreting replication studies across the wide range of research designs used across the field. Next, it discusses the type of research that can probe the robustness of published findings, especially when replication studies are difficult to perform. The chapter concludes with a discussion of different roles that replication can have in primate cognition research.

Replications are widely considered an essential tool to evaluate scientific claims. However, many fields have recently reported that replication rates are low and - when they are conducted - many findings do not successfully replicate. These circumstances have led to widespread debates about the value of replications for research quality, credibility of research findings, and factors contributing to current problems with replicability. This special issue brings together researchers from various areas within the field of animal behavior to offer their perspective on the status and value of replications in animal behavior science.