How statistically non-significant results are reported and interpreted following null hypothesis significance testing is often criticized. This issue is important for animal cognition research because studies in the field are often underpowered to detect theoretically meaningful effect sizes, i.e., often produce non-significant p-values even when the null hypothesis is incorrect. Thus, we manually extracted and classified how researchers report and interpret non-significant p-values and examined the p-value distribution of these non-significant results across published articles in animal cognition and related fields. We found a large amount of heterogeneity in how researchers report statistically non-significant p-values in the result sections of articles, and how they interpret them in the titles and abstracts. Reporting of the non-significant results as “No Effect” was common in the titles (84%), abstracts (64%), and results sections (41%) of papers, whereas reporting of the results as “Non-Significant” was less common in the titles (0%) and abstracts (26%), but was present in the results (52%). Discussions of effect sizes were rare (<5% of articles). A p-value distribution analysis was consistent with research being performed with low power of statistical tests to detect effect sizes of interest. These findings suggest that researchers in animal cognition should pay close attention to the evidence used to support claims of absence of effects in the literature, and—in their own work—report statistically non-significant results clearly and formally correct, as well as use more formal methods of assessing evidence against theoretical predictions.
Null Hypothesis Significance Testing is a statistical procedure widely used in cognitive development research. There is widespread concern that the results of this statistical procedure are misinterpreted and lead to unsubstantiated claims about studies’ outcomes. Two particularly pertinent issues for research on cognitive development are: i) treating a non-significant result as evidence of no difference or no effect, and ii) treating a non-significant result in one group/condition and a significant result in another as evidence of a difference between groups/conditions. The current study focuses on quantifying the extent to which these two issues can be observed in the published literature on cognitive development. To this end, we will systematically search for empirical studies investigating cognitive development in 0-to-16-year-old children that have been published at two time points, namely in 1999 and 2019. For each of the two issues, we will extract information from 300 published articles, 150 per publication year.
Scholastic factors (academic achievement) are hypothesized to be important determinants of health-related behaviors in adolescents, but there is a lack of knowledge on their influence on physical activity levels (PAL), especially considering the COVID-19 pandemic and the imposed lockdown. This study aimed to investigate the associations between scholastic factors and PAL before and during the pandemic lockdown. The participants were adolescents form Bosnia and Herzegovina (n = 525, 46% females), who were observed prospectively at the baseline (before the pandemic lockdown) and during the lockdown in 2020 (follow-up). The scholastic factors (grade point average, behavioral grade, school absences, unexcused absences) were evidenced at the baseline (predictors). The outcome (PAL) was evaluated using the Physical Activity Questionnaire for Adolescents at the baseline and the follow-up. Gender, age, parental/familial conflict, and sport participation were observed as confounders. No significant influence of the predictors on PAL were evidenced at the baseline or at the follow-up. The scholastic variables were significantly associated with the changes of PAL which occurred due to pandemic lockdown, with a lower risk for negative changes in PAL among adolescents who were better in school (OR = 0.56, 95%CI: 0.34–0.81, and OR = 0.66, 95%CI: 0.34–0.97, for the grade point average and behavioral grade, respectively). Students who do well in school are probably more aware of the health benefits of proper PAL, and therefore are devoted to the maintenance of their PAL even during the home-confinement of lockdown. Public health authorities should focus more on helping adolescents to understand the importance and benefits of proper PAL throughout the school system.
Eurasian jays have been reported to protect their caches by responding to cues about either the visual perspective or current desire of an observing conspecific, similarly to other corvids. Here, we used established paradigms to test whether these birds can – like humans – integrate multiple cues about different mental states and perform an optimal response accordingly. Across five experiments, which also include replications of previous work, we found little evidence that our jays adjusted their caching behaviour in line with the visual perspective and current desire of another agent, neither by integrating these social cues nor by responding to only one type of cue independently. These results raise questions about the reliability of the previously reported effects and highlight several key issues affecting reliability in comparative cognition research.
To promote collaboration across canine science, address reproducibility issues, and advance open science practices within animal cognition, we have launched the ManyDogs consortium, modeled on similar ManyX projects in other fields. We aimed to create a collaborative network that (a) uses large, diverse samples to investigate and replicate findings, (b) promotes open science practices of preregistering hypotheses, methods, and analysis plans, (c) investigates the influence of differences across populations and breeds, and (d) examines how different research methods and testing environments influence the robustness of results. Our first study combines a phenomenon that appears to be highly robust, dogs’ ability to follow human pointing, with a question that remains controversial: do dogs interpret pointing as an informative gesture, as an imperative command, or as a simple associative cue? We collected preliminary data (N = 61) from a single laboratory on two conditions of a 2-alternative object choice task: (1) Ostensive (experimenter pointed to a baited cup after making eye-contact and saying the dog’s name); (2) Non-ostensive (experimenter pointed to a baited cup without making eye-contact or saying the dog’s name). Dogs followed the ostensive point, but not the non-ostensive point, significantly more often than expected by chance. Preliminary results also provided suggestive evidence for variability in point-following across dog breeds. The next phase is the global participation stage of the project. We propose to replicate this protocol in a large and diverse sample of research sites, simultaneously assessing replicability between labs and further investigating the question of dogs’ point-following comprehension.
Replication is an important tool used to test and develop scientific theories. Areas of biomedical and psychological research have experienced a replication crisis, in which many published findings failed to replicate. Following this, many other scientific disciplines have been interested in the robustness of their own findings. This chapter examines replication in primate cognitive studies. First, it discusses the frequency and success of replication studies in primate cognition and explores the challenges researchers face when designing and interpreting replication studies across the wide range of research designs used across the field. Next, it discusses the type of research that can probe the robustness of published findings, especially when replication studies are difficult to perform. The chapter concludes with a discussion of different roles that replication can have in primate cognition research.
Replications are widely considered an essential tool to evaluate scientific claims. However, many fields have recently reported that replication rates are low and - when they are conducted - many findings do not successfully replicate. These circumstances have led to widespread debates about the value of replications for research quality, credibility of research findings, and factors contributing to current problems with replicability. This special issue brings together researchers from various areas within the field of animal behavior to offer their perspective on the status and value of replications in animal behavior science.
Animal cognition research aims to understand animal minds by using a diverse range of methods across an equally diverse range of species. Throughout its history, the field has sought to mitigate various biases that occur when studying animal minds, from experimenter effects to anthropomorphism. Recently, there has also been a focus on how common scientific practices might affect the reliability and validity of published research. Usually, these issues are discussed in the literature by a small group of scholars with a specific interest in the topics. This study aimed to survey a wider range of animal cognition researchers to ask about their attitudes towards classic and contemporary issues facing the field. Two-hundred and ten active animal cognition researchers completed our survey, and provided answers on questions relating to bias, replicability, statistics, publication, and belief in animal cognition. Collectively, researchers were wary of bias in the research field, but less so in their own work. Over 70% of researchers endorsed Morgan’s canon as a useful principle but many caveated this in their free-text responses. Researchers self-reported that most of their studies had been published, however they often reported that studies went unpublished because they had negative or inconclusive results, or results that questioned “preferred” theories. Researchers rarely reported having performed questionable research practices themselves—however they thought that other researchers sometimes (52.7% of responses) or often (27.9% of responses) perform them. Researchers near unanimously agreed that replication studies are important but too infrequently performed in animal cognition research, 73.0% of respondents suggested areas of animal cognition research could experience a ‘replication crisis’ if replication studies were performed. Consistently, participants’ free-text responses provided a nuanced picture of the challenges animal cognition research faces, which are available as part of an open dataset. However, many researchers appeared concerned with how to interpret negative results, publication bias, theoretical bias and reliability in areas of animal cognition research. Collectively, these data provide a candid overview of barriers to progress in animal cognition and can inform debates on how individual researchers, as well as organizations and journals, can facilitate robust scientific research in animal cognition.
Endurance training (ET) has multiple beneficial effects on cardiovascular health (CVH), but there is an evident lack of knowledge on differential effects of various types of ET on indices of CVH in women. The aim of this study was to analyse the effectiveness of two different types of ET on changes in indicators of CVH in apparently healthy adult women. The sample included 58 women (24 ± 3 years; height: 165 ± 6 cm, mass: 66.7 ± 7.2 kg, BMI: 24.3 ± 2.5 kg/m2, at baseline) divided into one control non-exercising group (n = 19), and two exercising experimental groups (EE). The first EE participated in choreographed aerobic-endurance training (CAT; n = 19), while the second participated in treadmill-based endurance exercise (TEE; n = 20) during the experimental protocol (8 weeks, 24 training sessions). The testing included pre- and post-exercise protocols and measures of anthropometric/body composition indices, lipid panel, and endurance capacity. Two-way analysis of variance for repeated measurements with consecutive post hoc analysis was applied to the “group” and “measurement” variables. The main significant ANOVA effects found for measurement, and “Group x Measurement” interaction (p < 0.05) were found for all variables but body height. The EE induced positive changes in lipid panel variables, anthropometric/body-build status, and endurance capacity. However, TEE improved endurance capacity to a greater extent than CAT. The results suggest that that the optimal exercise intensity and self-chosen type of physical-activity may result in positive effects on indices of CVH, even in women of young age and good health status.
Corvids appear to be capable of adjusting their behaviour according to another’s perspective, knowledge and desire. For example, Eurasian jays have been found to employ a variety of cache protection strategies to minimise cache loss by responding to cues about the visual perspective or current desire of an observing conspecific. However, it is not known whether these jays (or any other corvid) can integrate multiple cues about different mental states and perform the optimal response accordingly. Across five experiments, we found little evidence that our Eurasian jays responded to either the visual perspective or current desire of another agent. In Experiments 1 and 2 we investigated whether Eurasian jays can limit the risk of cache loss by responding simultaneously to cues about the desire and perspective of a potential conspecific pilferer. Building on established paradigms, we used opaque and clear barriers to manipulate the observer’s visual access to cache locations, and specific satiety to manipulate the observer’s desire towards different types of food. Across both experiments the jays’ caching pattern provided no evidence that they could integrate information about the observer’s desire and perspective. Moreover, the results were also inconsistent with the previously reported effects that jays protect their caches by responding to either the visual access or specific satiety of the observer independently. To gain further insight into these unexpected results, we conducted three more experiments. In Experiments 3 and 4, we attempted to replicate the previous finding that Eurasian jays prefer to cache behind an opaque barrier over a clear barrier when observed by a conspecific than when caching in private. In Experiment 5, we further investigated the previous finding that jays preferentially cache a type of food that had been eaten to satiety by a conspecific over a food that had not been eaten by the conspecific. Experiments 3, 4 and 5 found no significant effects in the direction of the previously reported effects, questioning their robustness. We conclude by discussing the implications of our study for the field of corvid cognition and highlight several key issues that affect the reliability of comparative cognition research.
Parental and familial factors influence numerous aspects of adolescents’ lives, including their physical activity level (PAL). The purpose of this study was to evaluate the changes in PAL which occurred during the COVID-19 pandemic, and to evaluate influence of sociodemographic and parental/familial factors on PAL levels before and during pandemic in adolescents from Bosnia and Herzegovina. The sample included 688 adolescents (15–18 years of age; 322 females) who were tested on two occasions: in January 2020 (baseline; before the COVID-19 pandemic) and in April 2020 (follow-up; during the COVID-19 pandemic lockdown). Variables included PAL (measured by the Physical Activity Questionnaire for Adolescents–PAQ-A) as well as sociodemographic-, parental-, and familial factors. A significant decline in PALs was recorded between baseline and follow-up (t-test: 11.88, p < 0.001). Approximately 50% of adolescents underwent sufficient PAL at baseline, while only 24% of them were achieving sufficient PAL at the time of follow-up measurement. Paternal education was positively correlated (OR (95%CI): baseline: 6.63 (4.58–9.96), follow-up: 3.33 (1.19–7.01)), while familial conflict was negatively correlated (baseline: 0.72 (0.57–0.90), follow-up: 0.77 (0.60–0.99)) with PALs before and during the pandemic. This study highlights the importance of the parent–child relationship and parental/familiar support in promoting physical activity both during regular life and during crises and health challenging situations like the COVID-19 pandemic.
Nema pronađenih rezultata, molimo da izmjenite uslove pretrage i pokušate ponovo!
Ova stranica koristi kolačiće da bi vam pružila najbolje iskustvo
Saznaj više