The ReproVIP project

The ReproVIP project aims at evaluating and improving the reproducibility of scientific results obtained with the Virtual Imaging Platform (VIP) in the field of medical imaging. ReproVIP focuses on a reproducibility level ensuring that the code produces the same result when executed with the same set of inputs and that an investigator is able to reobtain the published results.

We investigate reproducibility at three levels:

the code itself, and in particular different versions of the same code
the execution environment, such as the operating system and code dependencies, parallel executions and the use of distributed infrastructures
the exploration process, from the beginning of the study and until the final published results

LEARN MORE

What is VIP ?

VIP is a web portal developed and deployed at the CREATIS lab since 2011. By effectively leveraging the computing and storage resources of the EGI federation, VIP offers its users high-level services enabling them to easily execute medical imaging applications on a large scale computing infrastructure. In 2024, VIP counts more than 1500 registered users and about 25 applications, among which a few internationally used and renowned ones (e.g., GATE, Freesurfer, FSL). The platform is freely available to any researcher in medical imaging.
This web page corresponds to the ReproVIP deliverable providing documentation on the reproducibility best practices and tools developed by ReproVIP.

Context and definitions

In the last few years, there has been a growing awareness of reproducibility concerns in many areas of science. In medical imaging, the increasing complexity of the software and pipelines undermines our ability to reproduce scientific results over time and across research teams. Here we focus on computational reproducibility, which is one's ability to obtain identical results by repeating identical treatments to the same set of inputs.

Best practices

The ReproVIP project has identified a set of best practices that researchers can follow to improve the reproducibility of their experiments. These best practices cover different aspects of the research process, from experimental design to data analysis and reporting.

ReproVIP tools and examples

The ReproVIP project has developed a set of tools to help researchers improve the reproducibility of their experiments. Here is a selection of tools and examples that can be used to implement the best practices identified by the project.