Skip to content

Commit d575504

Browse files
committedJun 4, 2019
Some mistakes with the commands. Updated references
1 parent 4144f1d commit d575504

File tree

1 file changed

+5
-4
lines changed

1 file changed

+5
-4
lines changed
 

‎doc/orca_condor.md

+5-4
Original file line numberDiff line numberDiff line change
@@ -2,18 +2,19 @@
22

33
ORCA can be *easily* integrated with a High Throughput Computing (HTC) environment, such as [HTCondor](http://research.cs.wisc.edu/htcondor/), so extensive experiments can be speed up. The parallelization is done at dataset partition level, i.e. each partitions of each dataset is run in a different slot of the cluster.
44

5-
The [src/condor](../src/condor) folder contains a set of scripts that automate the use of ORCA with HTCondor. The script [condor-matlabExperiment.sh](../src/condor/condor-matlabExperiment.sh) allows to run an ORCA set of experiments by using any of the configuration files. To use the script, you will need to have the configuration file in the [src/condor](../src/condor) folder:
5+
The [src/condor](../src/condor) folder contains a set of scripts that automate the use of ORCA with HTCondor. The script [condor-matlabExperiment.sh](../src/condor/condor-matlabExperiment.sh) allows to run an ORCA set of experiments by using any of the configuration files. To use the script, you will need to have the configuration file in the [src/condor](../src/condor) folder. We will combine two different algorithms by concatenating two ini files:
66
```bash
77
~/orca/orca$ cd src/condor/
8-
~/orca/orca/src/condor$ cp ../config-files/svorim.ini ./
8+
~/orca/orca/src/condor$ cat ../tests/cvtests-30-holdout/svorim.ini > test.ini
9+
~/orca/orca/src/condor$ cat ../tests/cvtests-30-holdout/kdlor.ini >> test.ini
910
```
1011
Then, you have to edit the test file, so that the path of the experiments is correct with respect to the current path (replace `../example-data` by `../../example-data`). This can be done with a text editor or using the following `sed` command:
1112
```bash
12-
~/orca/orca/src/condor$ sed -i 's/\.\.\//\.\.\/\.\.\//g' svorim.ini
13+
~/orca/orca/src/condor$ sed -i 's/\.\.\//\.\.\/\.\.\//g' test.ini
1314
```
1415
Now the script is ready to be used. The following command:
1516
```bash
16-
~/orca/orca/src/condor$ condor-matlabExperiment.sh svorim.ini
17+
~/orca/orca/src/condor$ ./condor-matlabExperiment.sh test.ini
1718
```
1819
will create a HTCondor work and will add this work to the HTCondor queue. Each work consists of a task for dividing the work into different independent configuration files, a train-test task for each dataset partition and an extra task to collect all the data and create the reports. Most of the experimental results will be compressed, with the exception of the CSV files. To adapt the set of scripts to your HTCondor system please set up environment variables corresponding to MATLAB's path, universe, requirements and edit the ``.sh`` file.
1920

0 commit comments

Comments
 (0)