QIIME 2 Parallel Config Creator

QIIME 2 features the ability to parallelize all QIIME 2 Pipelines using the PARSL parallel scripting library under the hood. Running small workflows in parallel on a laptop requires minimal configuration, and can be achieved by simply passing the --p-parallel flag to the pipeline you are running without additional configuration; however, QIIME 2 also support parallelizing large scale workflows across multiple nodes on a compute cluster. This is particularly useful for pipelines in MOSHPIT and q2-boots which often do the same type of calculation a very large number of times on a large set of data.

This webapp can help you create a file to pass into the --p-parallel-config parameter of a QIIME 2 Pipeline you want to run in parallel on an HPC cluster using the Slurm scheduler. PARSL and thus QIIME 2 do support schedulers other than slurm, but this app currently only supports creating local and Slurm configs. More information about QIIME 2 parallel configuration may be found here. You should read that documentation before using this app or trying to parallelize your workflows at all.

Drag and drop or click here

Load a config to prefill the form.
Note: configs not generated by this webapp are not guaranteed to load.

Create a configuration

Fill out the fields below to create a `parallelConfig.toml` file you can pass to QIIME 2.

Currently, this config creator only supports local execution and Slurm. Choose local if parallelizing on your own laptop/desktop/server. Choose Slurm if parallelizing on an HPC using the Slurm scheduler.

If you are unsure, choose “No”.

How many threads to run simultaneously if your task is threadsafe and how many processes to run simultaneously if it isn't.

NOTE: More threads/processes requires more RAM.

Your config will download as `parallelConfig.toml`.