Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Integrate a validation set #2

Open
Vectorrent opened this issue Aug 23, 2024 · 1 comment
Open

Integrate a validation set #2

Vectorrent opened this issue Aug 23, 2024 · 1 comment
Labels
enhancement New feature or request help wanted Extra attention is needed

Comments

@Vectorrent
Copy link
Contributor

The challenge is with how to split the data, when the vast majority of it is being sampled stochastically, today.

@Vectorrent Vectorrent added enhancement New feature or request help wanted Extra attention is needed labels Aug 23, 2024
@Vectorrent
Copy link
Contributor Author

I added some very basic (and kind of ugly) validation code. The only data that supports it currently is the Phi dataset.

Because Phi has just 2 batches, I assigned one to training data, and the other to validation data.

I also implemented a simple, deterministic random number generator, so that I could initialize weights and iterate over data in a reproducible fashion.

There are likely to be things I missed, so we'll leave this issue open for a while.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request help wanted Extra attention is needed
Projects
Status: In progress
Development

No branches or pull requests

1 participant