Skip to content

Commit ec56b06

Browse files
committed
Adds new data collection script
1 parent e75b300 commit ec56b06

File tree

1 file changed

+21
-0
lines changed

1 file changed

+21
-0
lines changed

Diff for: utils/run_data_collection.sh

+21
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,21 @@
1+
#!/bin/bash
2+
#SBATCH --job-name=adelie_data
3+
#SBATCH --output=adelie_data/output/slurm-%A_%a.out
4+
#SBATCH --ntasks=1
5+
#SBATCH --cpus-per-task=32
6+
#SBATCH --mem-per-cpu=16GB
7+
#SBATCH --partition=candes
8+
#SBATCH --array=1-50
9+
10+
BASE_DIR=$HOME/adelie_alo/benchmarking/run
11+
RESULTS_DIR=$BASE_DIR/results
12+
mkdir -p $RESULTS_DIR
13+
DEST_FILE=$RESULTS_DIR/sweep-$SLURM_ARRAY_TASK_ID.npz
14+
15+
16+
ml python/3.12.1
17+
ml py-pytorch/2.4.1_py312
18+
. $HOME/randalo/.venv/bin/activate
19+
20+
21+
python $HOME/randalo/utils/sherlock_script.py $DEST_FILE $SLURM_ARRAY_TASK_ID

0 commit comments

Comments
 (0)