You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit 0393fcb
Browse filesBrowse the repository at this point in the historyBrowse files
Adapter benchmark: a Classifier column, for granite-switch's classifier slots
A classifier slot (granite-switch PR #134) holds a linear head instead of an
adapter: its control token, placed last, makes the model emit one label
word, the head's verdict on the final hidden state there. No row measured
one. A fourth technology, classifier, does: one head per intrinsic that has
a classifier entry in adapters.yaml (answerability and guardian-core, labels
yes / no; answerability's read as "answerable" / "unanswerable", which are
not single tokens).
- Staging: a head folder (classifier_head.safetensors, classifier.json with
its labels in row order) is detected and staged like an adapter, with its
checksum and labels in the fingerprint; labels not the intrinsic's, in
order, are refused.
- Compose: heads join the LoRA / aLoRA checkpoint, with their labels, after
checks that a head is the base's width and its labels single tokens. The
PR renamed classifier slots to activation probes in aa7dd88 (manifest kind
probe, head file probe_head.safetensors); the run asks the commit's
composer which name it uses, gives a probe composer a linked copy of the
head, and records the kind. A group of heads alone gets a filler LoRA
whose delta is zero, since neither composer can compose heads without an
adapter. A commit whose composer has neither skips the cells.
- Generate: classifier cells render with adapter_name (both PR versions
take it for a head), must end in the head's marker, and generate one
token, in an eager engine of their own
(FULL CUDA-graph replay of a classifier slot differs from eager under
vLLM 0.26, granite-switch 1a78c29). Scoring maps the label to the
scorer's answer.
- Reference: the same head on the HF base model's final hidden state.
- Page: 13 columns per intrinsic; "—" where an intrinsic has no head, on
every row, in the PR comment's table too. The serving blocks measure no
classifier: it decodes nothing. Releases hold none.
- --only takes intrinsic/technology, and its results merge cell by cell, so
the column can be added to an existing row.
No bench_version or reference_version bump: the other cells are unchanged,
and old rows show the new cells as not run.
Signed-off-by: AlonMalach <alonmalach@gmail.com>
0 commit comments