Skip to content

feat: 兼容Gpt2 分词器 #2

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
YdrMaster merged 1 commit into from
May 9, 2025

feat: 兼容Gpt2 分词器

f1352a9
Select commit
Loading
Failed to load commit list.
Merged

feat: 兼容Gpt2 分词器 #2

feat: 兼容Gpt2 分词器
f1352a9
Select commit
Loading
Failed to load commit list.
GitHub Advanced Security / clippy failed May 9, 2025 in 3s

2 new alerts including 2 errors

New alerts in code changed by this pull request

  • 2 errors

See annotations below for details.

View all branch alerts.

Annotations

Check failure on line 262 in src/bpe/mod.rs

See this annotation in the file changed.

Code scanning / clippy

this repeat().take() can be written more concisely Error

this repeat().take() can be written more concisely

Check failure on line 262 in src/bpe/mod.rs

See this annotation in the file changed.

Code scanning / clippy

this repeat().take() can be written more concisely Error

this repeat().take() can be written more concisely