Introduction to Nextflow and running nf-core workflows

This workshop is designed to provide participants with a foundational understanding of Nextflow and nf-core pipelines, with a focus on running existing pipelines efficiently. Participants are expected to have prior experience with the command-line interface and working with cluster systems like Slurm. The primary goal of the workshop is to equip researchers with the skills needed to use nf-core pipelines for their research data.

It is not intended for those looking to develop new Nextflow workflows

Course Presenters

  • Richard Lupat, Bioinformatics Core Facility
  • Miriam Yeung, Cancer Genomics Translational Research Centre

Course Helpers

  • Sanduni Rajapaksa, Research Computing Facility
  • Song Li, Bioinformatics Core Facility
  • Henrietta Holze, Dawson Lab

Prerequisites

  • Experience with command line interface and cluster/slurm
  • Familiarity with the basic concept of workflows
  • Access to Peter Mac Cluster

Learning Objectives:

By the end of this workshop, participants should be able to:

  • Gain exposure to key concepts and terminology in Nextflow and nf-core pipelines.
  • Understand the foundational knowledge required to navigate and customize the code base of nf-core pipelines.
  • Develop basic troubleshooting and customization skills necessary for responsibly applying nf-core pipelines to your own research data.

Set up requirements

Please complete the Setup Instructions before the course.

If you have any trouble, please get in contact with us ASAP via Slack/Teams.

Workshop schedule

Lesson Overview Time
Setup Follow these instructions to install VS Code and setup your workspace Prior to workshop
Session kick off Session kick off: Discuss learning outcomes and finalising workspace setup 09:30 - 09:40
Introduction to Nextflow Introduction to Nextflow: Introduce nextflow’s core features and concepts; including CLI and how to run it on Peter Mac cluster 09:40 - 10:20
Introduction to nf-core Introduction to nf-core: Introduce nf-core features and concepts, structures, tools, and example nf-core pipelines 10:20 - 11:00
Break Break 11:00 - 11:15
Customising & running nf-core pipelines Customising & running nf-core pipelines: Discuss pipelines’ required inputs, optional inputs, outputs, parameters file and configurations files 11:15 - 11:45
Troubleshooting nextflow run Troubleshooting nextflow run: Discuss Nextflow logging, caching, task execution directory, dependencies, and manual troubleshooting 11:45 - 12:15
Best practise and Q&A Best practise, tips & tricks for running nextflow pipelines at Peter Mac cluster 12:15 - 12:45

Credits and acknowledgement

This workshop is adapted from Customising Nf-Core Workshop materials from Sydney Informatics Hub