Skip to content

Commit

Permalink
📝 document distributed cluster execution
Browse files Browse the repository at this point in the history
  • Loading branch information
Henry Webel committed Nov 8, 2023
1 parent f46777b commit c849cb5
Show file tree
Hide file tree
Showing 3 changed files with 34 additions and 2 deletions.
18 changes: 18 additions & 0 deletions project/bin/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,18 @@
# Computerome2 (CR2) scripts

Cluster exectuion script for CR2 using a torque-pbs queue.


## Distributed

```bash
qsub run_snakemake_cluster.sh -N snakemake_exp -v configfile=config/single_dev_dataset/example/config.yaml,prefix=exp
```

## Single node

```bash
qsub run_snakemake.sh -N grid_exp
```


4 changes: 2 additions & 2 deletions project/bin/run_snakemake.sh
Original file line number Diff line number Diff line change
Expand Up @@ -5,8 +5,8 @@
### Job name (comment out the next line to get the name of the script used as the job name)
#PBS -N sn_grid
### Output files (comment out the next 2 lines to get the job name used instead)
#PBS -e qsub_logs${PBS_JOBNAME}.${PBS_JOBID}.e
#PBS -o qsub_logs${PBS_JOBNAME}.${PBS_JOBID}.o
#PBS -e qsub_logs/${PBS_JOBNAME}.${PBS_JOBID}.e
#PBS -o qsub_logs/${PBS_JOBNAME}.${PBS_JOBID}.o
### Email notification: a=aborts, b=begins, e=ends, n=no notifications
#PBS -m ae -M [email protected]
### Number of nodes
Expand Down
14 changes: 14 additions & 0 deletions project/workflow/bin/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,14 @@
# Scripts for pbs-torque cluster execution

We ran the software partly on a pbs-torque cluster

`qsub-status_v2.py` is used by snakemake to query the status of a submitted job in case the job,
in case the job is not ran locally within the main process running snakemake.

`create_qsub_commands.py` is a script which create some job submission commands.

`jobscript.sh` is a script which sets up conda before the subcommand create from within
a snakemake job is run.


> None of this is needed in case snakemake is non-distributed on a single node.

0 comments on commit c849cb5

Please sign in to comment.