⚡️ Speed up method BasicTokenizer._run_split_on_punc by 97%#367
Open
codeflash-ai[bot] wants to merge 1 commit intomainfrom
Open
⚡️ Speed up method `BasicTokenizer._run_split_on_punc` by 97%#367codeflash-ai[bot] wants to merge 1 commit intomainfrom
codeflash-ai[bot] wants to merge 1 commit intomainfrom
![codeflash-ai[bot]](https://avatars.githubusercontent.com/in/413177?v=4&size=32){kind=avatar}