Skip to content

Pull requests: sugarme/tokenizer

New pull request New
5 Open 27 Closed
5 Open 27 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Make NewRawInputSequence public to prevent costly reflection
#72 opened Sep 26, 2025 by clems4ever Loading…
1
Fix #65, #66
#67 opened Sep 2, 2025 by season-studio Loading…
3
Support zero-width negative lookahead (?!regex)
#60 opened Jul 12, 2025 by nanmu42 Loading…
1
1
Initialize DecoderBase when fetching Default Decoders
#47 opened Sep 22, 2024 by ahhcash Loading…
Use go:embed for pretrained gpt2 tokenizer, add missing json
#23 opened Aug 11, 2022 by adayNU Loading…
1
ProTip! What’s not been updated in a month: updated:<2025-09-11.