⚡️ Speed up method BasicTokenizer.tokenize by 14%#365
Open
codeflash-ai[bot] wants to merge 1 commit intomainfrom
Open
⚡️ Speed up method `BasicTokenizer.tokenize` by 14%#365codeflash-ai[bot] wants to merge 1 commit intomainfrom
codeflash-ai[bot] wants to merge 1 commit intomainfrom
![codeflash-ai[bot]](https://avatars.githubusercontent.com/in/413177?v=4&size=32){kind=avatar}