This repository has been archived by the owner on Aug 22, 2024. It is now read-only.

Add flash attention? #3

Open

shaltielshmid opened this issue Feb 10, 2024 · 1 comment

shaltielshmid commented Feb 10, 2024

This is a fantastic library! Perhaps add in Flash Attention?

Check out the announcement here.

Owner

LittleLittleCloud commented Feb 23, 2024

@shaltielshmid Thanks, I'll take a look

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.