In vivo neuroscience toolkit
Easy to implement tips on how to make your in vivo research as credible as possible
If details on methods and key details are not available to other researchers, this can be a barrier to them reproducing experiments, building on them, or considering how reliable the results are likely to be. In an analysis of 51,312 open access animal research papers published in 2018, the mention of measures to reduce subjective bias was low - randomisation was only mentioned in 36% of papers, blinding in 12%, and power in just 7% [1].
This toolkit aims to give
in vivo neuroscientists some of the key ways to strengthen credibility of
in vivo
research that they should aim to do, and which are simple to implement, at the stages you
plan your research,
carry the study out, and
after you've analysed your data.
Planning your study
A correctly powered study is both essential for a credible project and ethically important when using animals. The free-to-use Experimental Design Assistant tool on the NC3Rs website is an excellent starting point [2]. The EDA can provide advice to improve your experimental plan, recommendations for how to do the statistical analysis, power calculation, randomisation & blinding, and it can also produces a plan in a shareable format that can improve the transparency of your study (e.g. through preregistration).
If it is possible to have the experiment performed and the data analysed blind this is a big advantage, particularly when the experimenter is involved in judging the endpoint.
When thinking of Power it is also important to consider what groups are required – issues relating to these are detailed in points 2, 3 and 4 below.
For a brief summary of the EDA tool, watch Nathalie Percie du Sert from NC3Rs talk through the key features.
It is important wherever possible that both sexes are used in experiments. This not only provides a more rounded insight but also reduces the needless waste of female animals. Many researchers think that including females increases data variation, increases overall numbers and drives up costs. However, this is often not true [3]. The MRC now advises that both sexes be included as the default for grant applications of in vivo research unless a robust justification is given.
However, when using female animals, it is important to know and report what stage of cycle the animals are in – this should be ascertained on the day of testing (after the experiment has concluded).
Make sure that experimental cohort is derived from a variety of litters and randomised appropriately – this will control for environmental factors in individual litters that may affect the outcome of the experiment. In some instances, it may be critical to include litter as a factor in the analysis.
One option is also to conduct your study using block designs that can introduce variation in a controlled manner to help identify more generalisable results. Below, AstraZeneca's Natasha Karp highlights how this technique can help boost reproducibility (excerpt from a BNA webinar on embracing variation for in vivo research).
This is especially important in relation to genetically modified animals. When working with knock-out animals it's always essential to use the corresponding wild-type littermate control. When it comes to conditional knockouts, the control groups that should be tested also includes LoxP-ready line alone, and the Cre-driver line alone. This is because the Cre-line may have a phenotype already
(for instance Nestin-cre [4]).
Like all aspects of physiology, brain and behaviour change with age [5]. It is important to design your study with this in mind, particularly when conducting long-term experiments. It is also critical that the age at which each test was conducted is accurately reported.
You can reduce bias and build confidence in the study by preregistering a time-stamped account of your research plans prior to starting the study, clearly and openly stating your experimental rational, hypothesis, and methods, including the intended statistical analysis. This helps to demostrate not only the rigorous planning, but also that these aspects of the study were not shaped during or after data collection and that the results are not selectively reported.
The easiest way to preregister a study is via a registry. There are all-purpose registries for a range of scientific disciplines, such as the Open Science Framework, and specific in vivo registries such as the Animal Study Registry [6].
You can also preregister a study through a journal that offers Registered Reports, such as the BNA's Journal Brain and Neuroscience Advances.
Watch Ulrich Dirnagl from the QUEST Center for Responsible Research explain the preregistration options below (excerpt from a BNA webinar on preregistering in vivo studies).
There are simple steps that you can take to improve the structure of how you manage data collection throughout your study. This can not only help you further down the line when it comes to remembering the processes you used, but also provides transparency on how your raw data are turned into your final results. Retaining all raw data is also useful in case at a latter point you discover a error in the data processing or analysis that you need to trace back to the original data.
Setting up a lab strategy for data-gathering can ensure everyone in the lab adopts the same approaches, which can improve continuity when you have staff turnover and help keep your data safe. Having a structure where data is managed well throughout the study can also help with making the data shareable after the study is completed.
Electronic Lab Notebooks offer one tool to help keep track of your project and enable better research processes [7]. In the video below, Kaitlyn Hair from CAMARADES at the University of Edinburgh highlights the benefits ELNs can bring to data management in your study (excerpt from a
BNA webinar on handling
in vivo
data).
Neuroscientists have been “ahead-of-the-game” in understanding the contribution of genetic background to the phenotype [8] and reporting this in our research papers. However, we can improve this further. For instance, are your in-house bred C57BL/6 mice the same C57BL/6 mice others are using? In this regard, it is important when starting out with a new colony of mice to source them from a standard well-trusted supplier.
If you are working on a well-established in-house colony, it is important that the genetic strain is routinely genotyped (and reported), as you may find that this has deviated from the original background strain over successive breading/generations. Of course, this is also true for rats.
If your study involves looking at rodent behaviour, it is particularly important to understand how your handling can affect the animal. For instance, picking up mice by the tail can compromise their welfare and affect scientific outcomes, and all animals should be handled using non-stressful methods – see the NC3Rs guide on how to pick up a mouse correctly. Also it is important to minimise day-to-day experimenter differences – rodents are particular sensitive to olfactory cues and so it is important to be consistent in glove-type, and even deodorant and perfume use.
Another consideration if using rodents is that their physiology is guided by circadian rhythms and they are nocturnal. Therefore, it is important to be aware of how time of day affects the outcomes of a study. Conduct experiments (especially repeat experiments) at similar and well-considered times of the day and ensure a study does not span a light change (lights on/off). Data collected in the “dark phase” when the animals are naturally awake is often more robust.
After data collection
The ARRIVE guidelines are designed to help improve the reporting of research involving animals. The checklist contains the key information necessary to describe the study comprehensively and transparently, and can help the research to be evaluated properly, and the methods and findings to be reproduced. These were updated in 2020 to include an 'Essential 10' set of details to include in a manuscript to aid assessment of the study's reliability, and additional details that can add context to the study.
For a brief summary of the guidelines, watch Esther Pearl from NC3Rs talk through the updated set below (excerpt from a
BNA webinar on design and reporting of
in vivo
research).
Sharing your data via an online repository can be beneficial to both yourself and to science more widely. It ensures that your datasets are secure and accessible in the long term, and gives the dataset a DOI, allowing the data to be cited by others. Demonstrating data-sharing can also be useful when applying to future grants. Making the data available online means these could also in the future be used for further study by others, for example through combining different datasets.
There are a number of different repositories where you can store data safely from your in vivo studies, including NeuroMorpho, figshare, and Dryad. In the video below, Matt Grubb from Kings College London talks though some of the options and what this involves.
Video: For more useful tips, check out the six short BNA Credibility Lunchbox webinars on in vivo neuroscience, available in our recordings section with presenters' slides, or as a single playlist via the BNA's YouTube channel.
Blog: 12 things you didn't know about Cre-lox
Article: Diederich et al. A guide to open science practices for animal research. PLoS Biol 20(9): e3001810. doi.org/10.1371/journal.pbio.3001810
This toolkit was produced with guidance from
Anthony Isles.