Instructions for installing the tools required to process single cell RNAseq data using the GeneLab pipeline
This directory holds yaml files and instructions for how to install the conda environments that contain all the software programs needed to process single cell RNAseq data using the GeneLab pipeline. Additionally, instructions and the shell scripts for creating the directory structure that GeneLab uses to organize the single cell RNAseq processing pipeline output files are provided.
To install conda environments, you'll first have to install Anaconda. We recommend installing a Miniconda, Python3 version appropriate for your system, as instructed by Happy Belly Bioinformatics.
All the yaml files required to install the conda environments needed to run the scRNAseq pipeline are in the scRNAseq_yaml_files sub-directory. To get a copy of the yaml files on to your system, copy the github web address of the scRNAseq_yaml_files directory, then paste it into GitZip here, and click download.
After download, unzip the scRNAseq_yaml_files.zip file and cd into the directory, where you will find 3 yaml files:
conda env create -f fastqc.yml
Activate the fastqc conda environment with the following command:
This environment needs to be activated to run steps 1a of the scRNAseq processing pipeline.
conda activate fastqc
conda env create -f multiqc.yml
Activate the multiqc conda environment with the following command:
This environment needs to be activated to run steps 1b and 3b of the scRNAseq processing pipeline.
conda activate multiqc
conda env create -f star.yml
Activate the star conda environment with the following command:
This environment needs to be activated to run steps 2 and 3a of the scRNAseq processing pipeline.
conda activate star
If you run into any issues while installing the RNAseq conda environments, update conda using the following command then try re-creating the RNAseq conda environments using the installation instructions above.
conda update conda
To generate the same directory structure that GeneLab uses to organize the scRNAseq processing pipeline output files, follow the instructions below:
-
Use the
cdcommand to navigate to the location on your device where you want to create the RNAseq directory structure. -
Set up the top level (aka parent) directory for the GLDS dataset you want to process using the
mkdircommand as follows (the example below is for GLDS-405):
mkdir GLDS-405
- Go into the top level directory that you created in step 2 using the
cdcommand as shown in the example below:
cd GLDS-405
-
Download the GL_scRNAseq_mkdir.sh bash script into the directory you created in step 2. To download the bash script, copy the github web address of the GL_scRNAseq_mkdir.sh bash script, then paste it into GitZip here, and click download.
Make the downloaded GL_scRNAseq_mkdir.sh bash script executable by running the following command:
chmod u+x GL_scRNAseq_mkdir.sh -
Create all sub-directories (aka child and subsequent grandchild directories) within the top level directory (created in step 2) by executing the GL_scRNAseq_mkdir.sh script as follows:
bash GL_scRNAseq_mkdir.sh
-
Your directory structure should now be set up. If you wish to process the dataset using the same scripts that were used to create the processed data for your select dataset in the GeneLab Repository, you can do so by following the steps below:
-
Download the scripts and metadata files that were used to processes your select dataset into the respective subdirectories (aka grandchild directories) of the
processing_scriptschild directory you made in step 5.Note: The processing scripts for all GeneLab scRNAseq processed datasets are provided in the GLDS_Processing_Scripts directory of this repository.
-
Use a text editor such as nano to change the paths indicated in each of the processing scripts you downloaded in step 5i to match the path to the top level (aka parent) directory you created in step 2.
Note1: If your system uses the slurm job scheduler, you will also have to customize the #SBATCH options to be consistent with your system's slurm settings (consult your system administrator regarding the settings needed for your system).
Note2: If you are not using the slurm job scheduler, you will have to remove the #SBATCH options from each slurm script and replace them with the equivalent options for the job scheduler your system uses.
-
If you wish to start processing from the beginning of the pipeline using raw sequence data, download the raw fastq files from the GeneLab Repository for your select dataset by clicking on 'STUDY FILES' in the left panel then click the arrowhead next to 'GeneLab Processed RNA-Seq Files' then click on 'Merged sequence data' then select and download all the *raw.fastq.gz files into the
/GLDS-#/00-RawData/Fastqdirectory you made in steps 2-4.Note1: The *raw.fastq.gz files for datasets sequenced by GeneLab are stored under 'STUDY FILES' -> 'RNA-Seq' -> 'Raw sequence data'.
Note2: GeneLab provides processed data files from each step of the scRNAseq processing pipeline in the GeneLab Repository, so you may start processing from any step of the pipeline by downloading the appropriate input data for that step.
-
Once you've downloaded the scripts and input data you need to start processing (steps 5i and 5iii, respectively) and have revised all of your processing scripts to indicate the correct paths and settings for your machine (step 5ii), you may begin executing the scripts in the same order as indicated in the scRNAseq processing pipeline.
-