NanoGPT-Pytorch2.0-Implementation

Introduction

This is a repo for my NanoGPT-Pytorch2.0-Implementation, faster and simpler than using pytorch 1.13

Thanks a lot for Andrej Karpathy: The simplest, fastest repository for training/finetuning medium-sized GPTs.

Implementation Details

You can find the complete implementation process on my Zhihu column in Chinese：https://zhuanlan.zhihu.com/p/611191403