Methodology & Meta-science

Jupyter notebooks for efficient research

Coming from a Natural Language Processing engineer's perspective, where research is embedded in my job requirements, I have found Jupyter Notebooks as a very useful tool for research. Like every other tool out there, it can have its benefits as well as it can make things go very wrong. I will start with a (very) brief introduction to Jupyter Notebooks and basic workflow. Most importantly, I want to open a discussion about how research can be done using Jupyter Notebooks. I will discuss how they are used to facilitate rapid research and what are the most common problems with using them. The second part of the talk will be focused on two of the biggest issues in research code - code quality and reproducibility. I will offer advice and processes that can be adopted, in order to improve the quality of the code and ultimately the reproducibility of the conducted experiments.