Skip to content

Commit 61f8502

Browse files
cluster spec sheet: OPTIMIZE TABLE after seeding the MySQL source table
The QA table now carries a PRIMARY KEY, and the seeding INSERT emits customer_id in scattered order; inserted out of key order, the clustered index page-splits to ~2.5x its packed size (11.5 GiB instead of 4.6 GiB for 50M rows), which is what doubled the source_ingestion hydration measurement from ~4m to ~8m after the July 24 re-seed. OPTIMIZE TABLE rebuilds it packed. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
1 parent 7d319f4 commit 61f8502

1 file changed

Lines changed: 1 addition & 0 deletions

File tree

test/cluster-spec-sheet/mzcompose.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2161,6 +2161,7 @@ def setup(self) -> list[str]:
21612161
# UNION ALL SELECT 5 UNION ALL SELECT 6 UNION ALL SELECT 7 UNION ALL SELECT 8 UNION ALL SELECT 9) h
21622162
# ) nums
21632163
# WHERE n BETWEEN 1 AND 50000000;
2164+
# OPTIMIZE TABLE tbl;
21642165

21652166
# Kafka (Confluent)
21662167
# node /usr/local/bin/datagen -f avro -n 50000000 -w 0 -p qa_cluster_spec_sheet -s table.json

0 commit comments

Comments
 (0)