chore(deps): update dependency tokenizers to v0.22.2 #79
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR contains the following updates:
==0.22.1->==0.22.2Release Notes
huggingface/tokenizers (tokenizers)
v0.22.2Compare Source
What's Changed
Okay mostly doing the release for these PR:
Basically good typing with at least
ty, and a lot fast (from 4 to 8x faster) loading vocab with a lot of added tokens and GIL free !?ci: add support for building Win-ARM64 wheels by @MugundanMCW in #1869
Add cargo-semver-checks to Rust CI workflow by @haixuanTao in #1875
Update indicatif dependency by @gordonmessmer in #1867
Bump node-forge from 1.3.1 to 1.3.2 in /tokenizers/examples/unstable_wasm/www by @dependabot[bot] in #1889
Bump js-yaml from 3.14.1 to 3.14.2 in /bindings/node by @dependabot[bot] in #1892
fix: used normalize_str in BaseTokenizer.normalize by @ishitab02 in #1884
[MINOR:TYPO] Update mod.rs by @cakiki in #1883
Remove runtime stderr warning from Python bindings by @Copilot in #1898
Mark immutable pyclasses as frozen by @ngoldbaum in #1861
DOCS: add
add_prefix_spacetoprocessors.ByteLevelby @CloseChoice in #1878Bump express from 4.21.2 to 4.22.1 in /tokenizers/examples/unstable_wasm/www by @dependabot[bot] in #1903
New Contributors
Full Changelog: huggingface/tokenizers@v0.22.1...v0.22.2
Configuration
📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).
🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
🔕 Ignore: Close this PR and you won't be reminded about this update again.
To execute skipped test pipelines write comment
/ok-to-test.Documentation
Find out how to configure dependency updates in MintMaker documentation or see all available configuration options in Renovate documentation.