Skip to content

compute: Retire the concat_many mixed-variant branch - #37796

Draft
antiguru wants to merge 3 commits into
columnar-tp-letrec-reencodefrom
columnar-td-concat-many
Draft

compute: Retire the concat_many mixed-variant branch#37796
antiguru wants to merge 3 commits into
columnar-tp-letrec-reencodefrom
columnar-td-concat-many

Conversation

@antiguru

@antiguru antiguru commented Jul 21, 2026

Copy link
Copy Markdown
Member

Retire the concat_many mixed-variant upgrade branch now that no producer emits a Vec edge (the temporal-bucketing and LetRec re-encodes removed the last two sources). Rewrites the unit test to exercise all-columnar concatenation.

Columnar dataflow-edge migration. Design doc: doc/developer/design/20260720_columnar_dataflow_edges.md (#37744).

Part of CPU-51.

@antiguru
antiguru force-pushed the columnar-td-concat-many branch from 310ba0c to f459648 Compare July 22, 2026 08:41
@linear-code

linear-code Bot commented Jul 22, 2026

Copy link
Copy Markdown

CPU-51

@antiguru
antiguru force-pushed the columnar-td-concat-many branch from f459648 to 7c88c83 Compare July 22, 2026 16:24
@antiguru
antiguru force-pushed the columnar-td-concat-many branch from 7c88c83 to e610449 Compare July 22, 2026 17:50
@antiguru
antiguru force-pushed the columnar-td-concat-many branch 2 times, most recently from 1f40997 to fc429ab Compare August 19, 2026 13:17
@antiguru
antiguru force-pushed the columnar-td-concat-many branch from fc429ab to 1bc6cfb Compare August 20, 2026 08:49
@antiguru
antiguru force-pushed the columnar-td-concat-many branch from 1bc6cfb to a631a06 Compare August 20, 2026 09:13
antiguru and others added 3 commits September 6, 2026 17:12
Every producer now emits the columnar edge, so `concat_many` can never
receive a `Vec` input. Remove the mixed-variant upgrade branch (the
`vec_to_columnar` upgrade) and the now-unreachable all-`Vec` branch,
leaving only the native all-columnar concatenation.

The enum still carries a `Vec` arm until the collapse, so the input match
type-handles `CollectionEdge::Vec` with an `unreachable!`. Removing the
last branch that constructed a `Vec` edge leaves the variant
unconstructed, so it carries `#[allow(dead_code)]`; the arm, the
attribute, and the `unreachable!` are removed together when the enum
collapses to a columnar alias. `vec_to_columnar` stays, still used by the
leaf-encodes (imports, join no-closure, temporal bucketing, LetRec).

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
The concat_many teardown made the Vec arm unreachable, so a mixed
Vec/Columnar input can no longer reach concat_many. Feed two columnar
edges instead, which is the only shape producers now emit.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Comment-only, no behavior change.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@antiguru
antiguru force-pushed the columnar-td-concat-many branch from a631a06 to 7d5cf9d Compare September 6, 2026 18:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant