Releases: abhaskumarsinha/MinimalGPT
Releases · abhaskumarsinha/MinimalGPT
MinimalGPT v2.0.0
MinimalGPT v2.0.0 includes:
- Loading very large-sized files/datasets in the form of memory chunks.
- CPU/GPU/TPU Training support.
- OpenAI styled Multihead Attention implementation as well as classic Transformer Attention
- Table to check GPT Model components as well as number of parameters in each component.