Skip to content

feat(worker): add router qualification and abortable retirement #711

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
thxCode merged 31 commits into from
Oct 3, 2026
Merged

feat(worker): add router qualification and abortable retirement #711

Show file tree
Hide file tree
Changes from 19 commits
Commits
Show all changes
31 commits
Select commit Hold shift + click to select a range
734a374
feat(worker): initialize the ModelDeployment status contract for drain
thxCode Oct 1, 2026
a5d9bd3
feat(worker): read declared ModelDeployment parallelism into status
thxCode Oct 2, 2026
e7b11bc
feat(worker): maintain endpoint eligibility label for drain
thxCode Oct 2, 2026
8e9a06e
feat(pack): build llm-router with per-router discovery patches
thxCode Oct 2, 2026
a814932
docs(specs): tick s1 T3 and record the T4 acceptance split
thxCode Oct 2, 2026
1d1bc3b
merge(dp-ep): bring the router discovery patches into the drain line
thxCode Oct 2, 2026
4fd8b0c
feat(worker): observe router serving through read-only endpoint views
thxCode Oct 2, 2026
2cdae0e
fix(pack): make the observer patches compile at the pinned upstreams
thxCode Oct 2, 2026
3abf66a
feat(worker): gate endpoint eligibility on the whole-group health pre…
thxCode Oct 2, 2026
b94b3bc
docs(specs): tick s1 T7 and add the T11 group-forward observation task
thxCode Oct 2, 2026
21cb74a
feat(worker): observe engine group-forward with a request-bound probe
thxCode Oct 2, 2026
863e431
feat(worker): retire replicas through a reservation protocol before d…
thxCode Oct 2, 2026
890dac1
feat(worker): read member engine in-flight work through a pod exec dr…
thxCode Oct 2, 2026
575373f
docs(worker): document the retirement protocol and serving observation
thxCode Oct 2, 2026
5a1c3a9
feat(worker): drain a leader-served replica through its leader alone
thxCode Oct 2, 2026
c4ea182
fix(worker): drop a stray debug write and pin the whole scale-down li…
thxCode Oct 2, 2026
55cf053
docs(api): describe the Completed retirement state as never observed
thxCode Oct 2, 2026
c67484d
fix(pack): reconcile router pool membership on a 15-second timer
thxCode Oct 2, 2026
c7f9e7c
fix(worker): harden router observation and retirement evidence
thxCode Oct 3, 2026
7dfa178
fixup! feat(worker): observe engine group-forward with a request-boun…
thxCode Oct 3, 2026
8266d83
fixup! feat(worker): gate endpoint eligibility on the whole-group hea…
thxCode Oct 3, 2026
f126c4d
fixup! docs(worker): document the retirement protocol and serving obs…
thxCode Oct 3, 2026
932d2f7
fixup! feat(worker): drain a leader-served replica through its leader…
thxCode Oct 3, 2026
7160f7c
fixup! feat(worker): initialize the ModelDeployment status contract f…
thxCode Oct 3, 2026
bc5336d
fixup! feat(worker): read declared ModelDeployment parallelism into s…
thxCode Oct 3, 2026
4eb74c7
fixup! fix(pack): reconcile router pool membership on a 15-second timer
thxCode Oct 3, 2026
0cfae41
fixup! fix(worker): harden router observation and retirement evidence
thxCode Oct 3, 2026
38ee8b2
fixup! feat(worker): maintain endpoint eligibility label for drain
thxCode Oct 3, 2026
465fca0
fixup! fixup! feat(worker): gate endpoint eligibility on the whole-gr…
thxCode Oct 3, 2026
d5d3d13
fixup! feat(worker): maintain endpoint eligibility label for drain
thxCode Oct 3, 2026
06bede7
fixup! feat(worker): initialize the ModelDeployment status contract f…
thxCode Oct 3, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2,584 changes: 2,281 additions & 303 deletions api/worker/v1alpha1/generated.pb.go
View file
Open in desktop

Large diffs are not rendered by default.

241 changes: 241 additions & 0 deletions api/worker/v1alpha1/generated.proto
View file
Open in desktop

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

12 changes: 12 additions & 0 deletions api/worker/v1alpha1/generated.protomessage.pb.go
View file
Open in desktop

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Loading
Loading