Democratising deep learning for microscopy with ZeroCostDL4Mic

Lucas von Chamier, Romain F Laine, Johanna Jukkala, Christoph Spahn, Daniel Krentzel, Elias Nehme, Martina Lerche, Sara Hernández-Pérez, Pieta K Mattila, Eleni Karinou, Séamus Holden, Ahmet Can Solak, Alexander Krull, Tim-Oliver Buchholz, Martin L Jones, Loïc A Royer, Christophe Leterrier, Yoav Shechtman, Florian Jug, Mike HeilemannGuillaume Jacquemet, Ricardo Henriques

Research output: Contribution to journalArticleScientificpeer-review

277 Citations (Scopus)

Abstract

Deep Learning (DL) methods are powerful analytical tools for microscopy and can outperform conventional image processing pipelines. Despite the enthusiasm and innovations fuelled by DL technology, the need to access powerful and compatible resources to train DL networks leads to an accessibility barrier that novice users often find difficult to overcome. Here, we present ZeroCostDL4Mic, an entry-level platform simplifying DL access by leveraging the free, cloud-based computational resources of Google Colab. ZeroCostDL4Mic allows researchers with no coding expertise to train and apply key DL networks to perform tasks including segmentation (using U-Net and StarDist), object detection (using YOLOv2), denoising (using CARE and Noise2Void), super-resolution microscopy (using Deep-STORM), and image-to-image translation (using Label-free prediction - fnet, pix2pix and CycleGAN). Importantly, we provide suitable quantitative tools for each network to evaluate model performance, allowing model optimisation. We demonstrate the application of the platform to study multiple biological processes.

Original languageEnglish
Article number2276
JournalNature Communications
Volume12
Issue number1
DOIs
Publication statusPublished - Dec 2021
MoE publication typeA1 Journal article-refereed

Keywords

  • Animals
  • Cell Line, Tumor
  • Cloud Computing
  • Datasets as Topic
  • Deep Learning
  • Humans
  • Image Processing, Computer-Assisted/methods
  • Microscopy/methods
  • Primary Cell Culture
  • Rats
  • Software

Fingerprint

Dive into the research topics of 'Democratising deep learning for microscopy with ZeroCostDL4Mic'. Together they form a unique fingerprint.

Cite this