README.md

megadetector

Setup

Configure your environment (run only once)

cd $WORK
git clone https://github.com/Biodiversity-CatTracker2/megadetector-HPC.git megadetector
cd megadetector

mv slurm/track_progress_job.sh slurm/configure.sh slurm/megadetector_job.sh .

chmod +x configure.sh
./configure.sh

Connect to your cloud storage account (run only once)

• Here, we will use Google Drive as an example, but you can use any cloud storage listed here.

module load rclone
rclone config
# >>>> Prompt responses:
# n/s/q> n
# name> gdrive
# Storage> drive
# client_id> leave empty
# client_secret> leave empty
# scope> 1
# root_folder_id> leave empty
# service_account_file> leave empty
# y/n> n
# y/n> n
# COPY THE URL IN THE OUTPUT, AND OPEN IT IN YOUR BROWSER TO LOG IN...
#     ...THEN COPY THE CODE THAT WILL SHOW UP
# config_verification_code> PASTE THE CODE YOU COPIED HERE
# y/n> n
# y/e/d> y
# e/n/d/r/c/s/q> q

Submit the batch job

1. Edit the main batch job file: megadetector_job.sh.
2. Edit the progress tracking job file: track_progress_job.sh.
3. Submit the jobs

sbatch megadetector_job.sh
sbatch track_progress_job.sh