Scalable, reproducible bioinformatics workflows using Nextflow & nf-core

Alexander Peltzer

ELIXIR Workshop on FAIR Computational Workflows

September 2, 2020

nf-co.re

http://bit.ly/eccb2020-nf

Credit: https://doi.org/10.1093/gigascience/giy077

Dataflow Model

Domain-specific language

Executor abstraction

Tools

Guidelines

Pipelines

A community effort to collect a curated set of analysis pipelines built using Nextflow.

25 stable
15 in development

https://nf-co.re/pipelines

Github Actions: CI Testing

Linting

$ cd path/to/my_pipeline
$ nf-core lint .

                                          ,--./,-.
          ___     __   __   __   ___     /,-._.--~\
    |\ | |__  __ /  ` /  \ |__) |__         }  {
    | \| |       \__, \__/ |  \ |___     \`-._,-`-,
                                          `._,._,'
    nf-core/tools version 1.10.dev0


  INFO     Testing pipeline: nf-core-testpipeline/
╭──────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│ [!] 3 Test Warnings                                                                                      │
├──────────────────────────────────────────────────────────────────────────────────────────────────────────┤
│ https://nf-co.re/errors#5: GitHub Actions AWS full test should test full datasets: nf-core-testpipeline… │
│ https://nf-co.re/errors#8: Conda package is not latest available: bioconda::fastqc=0.11.8, 0.11.9 avail… │
│ https://nf-co.re/errors#8: Conda package is not latest available: bioconda::multiqc=1.7, 1.9 available   │
╰──────────────────────────────────────────────────────────────────────────────────────────────────────────╯
╭───────────────────────╮
│ LINT RESULTS SUMMARY  │
├───────────────────────┤
│ [✔] 117 Tests Passed  │
│ [!]   3 Test Warnings │
│ [✗]   0 Test Failed   │
╰───────────────────────╯

JSON Schema