Skip to content

Commit 8acdd4a

Browse files
committed
Release v0.5.2
1 parent 0e18fda commit 8acdd4a

3 files changed

Lines changed: 18 additions & 3 deletions

File tree

‎.github/workflows/release.yml‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -21,12 +21,12 @@ jobs:
2121
matrix:
2222
nif: ["2.15", "2.16"]
2323
job:
24-
- { target: aarch64-apple-darwin, os: macos-13 }
24+
- { target: aarch64-apple-darwin, os: macos-14 }
2525
- { target: aarch64-unknown-linux-gnu, os: ubuntu-22.04, use-cross: true }
2626
- { target: aarch64-unknown-linux-musl, os: ubuntu-22.04, use-cross: true }
2727
- { target: arm-unknown-linux-gnueabihf, os: ubuntu-22.04, use-cross: true }
2828
- { target: riscv64gc-unknown-linux-gnu, os: ubuntu-22.04, use-cross: true }
29-
- { target: x86_64-apple-darwin, os: macos-13 }
29+
- { target: x86_64-apple-darwin, os: macos-14 }
3030
- { target: x86_64-pc-windows-gnu, os: windows-2022 }
3131
- { target: x86_64-pc-windows-msvc, os: windows-2022 }
3232
- { target: x86_64-unknown-linux-gnu, os: ubuntu-22.04 }

‎CHANGELOG.md‎

Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -5,6 +5,20 @@ All notable changes to this project will be documented in this file.
55
The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
66
and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
77

8+
## [v0.5.2] - 2026-10-24
9+
10+
### Added
11+
12+
- Add `Tokenizers.DecodeStream` for incremental decoding of token ids.
13+
14+
### Changed
15+
16+
- Bump Rust tokenizers to v0.21.1.
17+
18+
### Fixed
19+
20+
- Allow larger response headers when downloading precompiled binaries.
21+
822
## [v0.5.1] - 2024-10-02
923

1024
### Added
@@ -108,6 +122,7 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
108122

109123
First release.
110124

125+
[v0.5.2]: https://github.com/elixir-nx/tokenizers/compare/v0.5.1...v0.5.2
111126
[v0.5.1]: https://github.com/elixir-nx/tokenizers/compare/v0.5.0...v0.5.1
112127
[v0.5.0]: https://github.com/elixir-nx/tokenizers/compare/v0.4.0...v0.5.0
113128
[v0.4.0]: https://github.com/elixir-nx/tokenizers/compare/v0.3.2...v0.4.0

‎mix.exs‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@ defmodule Tokenizers.MixProject do
22
use Mix.Project
33

44
@source_url "https://github.com/elixir-nx/tokenizers"
5-
@version "0.6.0-dev"
5+
@version "0.5.2"
66

77
def project do
88
[

0 commit comments

Comments
 (0)