File tree Expand file tree Collapse file tree
Expand file tree Collapse file tree Original file line number Diff line number Diff line change @@ -21,12 +21,12 @@ jobs:
2121 matrix :
2222 nif : ["2.15", "2.16"]
2323 job :
24- - { target: aarch64-apple-darwin, os: macos-13 }
24+ - { target: aarch64-apple-darwin, os: macos-14 }
2525 - { target: aarch64-unknown-linux-gnu, os: ubuntu-22.04, use-cross: true }
2626 - { target: aarch64-unknown-linux-musl, os: ubuntu-22.04, use-cross: true }
2727 - { target: arm-unknown-linux-gnueabihf, os: ubuntu-22.04, use-cross: true }
2828 - { target: riscv64gc-unknown-linux-gnu, os: ubuntu-22.04, use-cross: true }
29- - { target: x86_64-apple-darwin, os: macos-13 }
29+ - { target: x86_64-apple-darwin, os: macos-14 }
3030 - { target: x86_64-pc-windows-gnu, os: windows-2022 }
3131 - { target: x86_64-pc-windows-msvc, os: windows-2022 }
3232 - { target: x86_64-unknown-linux-gnu, os: ubuntu-22.04 }
Original file line number Diff line number Diff line change @@ -5,6 +5,20 @@ All notable changes to this project will be documented in this file.
55The format is based on [ Keep a Changelog] ( https://keepachangelog.com/en/1.0.0/ ) ,
66and this project adheres to [ Semantic Versioning] ( https://semver.org/spec/v2.0.0.html ) .
77
8+ ## [ v0.5.2] - 2026-10-24
9+
10+ ### Added
11+
12+ - Add ` Tokenizers.DecodeStream ` for incremental decoding of token ids.
13+
14+ ### Changed
15+
16+ - Bump Rust tokenizers to v0.21.1.
17+
18+ ### Fixed
19+
20+ - Allow larger response headers when downloading precompiled binaries.
21+
822## [ v0.5.1] - 2024-10-02
923
1024### Added
@@ -108,6 +122,7 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
108122
109123First release.
110124
125+ [ v0.5.2 ] : https://github.com/elixir-nx/tokenizers/compare/v0.5.1...v0.5.2
111126[ v0.5.1 ] : https://github.com/elixir-nx/tokenizers/compare/v0.5.0...v0.5.1
112127[ v0.5.0 ] : https://github.com/elixir-nx/tokenizers/compare/v0.4.0...v0.5.0
113128[ v0.4.0 ] : https://github.com/elixir-nx/tokenizers/compare/v0.3.2...v0.4.0
Original file line number Diff line number Diff line change @@ -2,7 +2,7 @@ defmodule Tokenizers.MixProject do
22 use Mix.Project
33
44 @ source_url "https://github.com/elixir-nx/tokenizers"
5- @ version "0.6.0-dev "
5+ @ version "0.5.2 "
66
77 def project do
88 [
You can’t perform that action at this time.
0 commit comments