Skip to content

Qwen 3.5 lexer support and close the HF normalizer parity gap - #387

Draft
kylegrover wants to merge 11 commits into
zspacelabs:mainfrom
kylegrover:kyleg/qwen3.5-lexer
Draft

Qwen 3.5 lexer support and close the HF normalizer parity gap#387
kylegrover wants to merge 11 commits into
zspacelabs:mainfrom
kylegrover:kyleg/qwen3.5-lexer

move HF input normalization ownership to UnifiedTokenVocab

2577054
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning

The logs for this run have expired and are no longer available.