Skip to content

Commit 3c2c714

Browse files
resouerclaude
andcommitted
Add Tokenizer-Feature Logit Calibration (TFLC)
Novel eval-time mechanism: learns 6 scalar biases from byte-length token classes (control/1byte/1byte+space/2byte/3byte/special) using scored context, applies calibration to future logit predictions. Nearest: ETLB (openai#1399, full vocab bias vector). Mechanistic difference: TFLC uses 6 class-level biases from tokenizer metadata, not per-token. Compliant: prefix-only, score-before-update, single pass. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
1 parent b86dcc4 commit 3c2c714

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

0 commit comments

Comments
 (0)