micro-epoch.md

micro epoch training

given a dataset for which a variety of effective data augs are available, load a sizeable portion into memory and sample from that data repeatedly, with augs.

can probably apply heurisitics from that "reusable dataset" diffp bootstrap article

• https://ai.googleblog.com/2015/08/the-reusable-holdout-preserving.html
• https://www.cis.upenn.edu/~aaroth/reusable.html