Skip to content

Commit

Permalink
update readme
Browse files Browse the repository at this point in the history
  • Loading branch information
semio committed Oct 16, 2023
1 parent d8bb1c0 commit b51d444
Showing 1 changed file with 4 additions and 0 deletions.
4 changes: 4 additions & 0 deletions yival_experiments/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -22,6 +22,8 @@ cp ../automation-api/.env ./
python fetch_question.py
```

This will fetch all enabled questions in the AI eval spreadsheet and create data/questions.csv.

Note: I tried to create a custom data reader to read data from AI eval
spreadsheet directly, but then yival failed to run the experiment. I
checked and found that Yival requires a dataset to have a local
Expand All @@ -37,6 +39,8 @@ The full experiment configuration is [here](https://github.com/Gapminder/gapmind
yival run --output ./output experiment.yaml
```

This will output a pickle file in output/ which include all Experiment Results objects.

Note: After running the experiment, Yival normaly will run a web
server to show the results. But somehow it doesn't start a web server
for our experiment. It just exits, though it is able to save the
Expand Down

0 comments on commit b51d444

Please sign in to comment.