Skip to content

compute: log unhydrated collections in one line per check - #38251

Merged
def- merged 1 commit into
MaterializeInc:mainfrom
def-:ci-log-volume
Aug 17, 2026
Merged

def- merged 1 commit into
MaterializeInc:mainfrom
def-:ci-log-volume

Conversation

@def-

@def- def- commented Aug 17, 2026

Copy link
Copy Markdown
Contributor

collections_hydrated_on_replicas logged one INFO line per non-hydrated collection, and the cluster controller polls it on a tick tests turn down to 5ms. That made it the single largest contributor to CI log volume: 220,971 lines in one test build, 12% of all services.log lines, peaking at 13,076 per second.

Name them all in one line instead. The diagnostic keeps its full content and the line count drops by the size of the unhydrated set.

`collections_hydrated_on_replicas` logged one INFO line per non-hydrated
collection, and the cluster controller polls it on a tick tests turn down to
5ms. That made it the single largest contributor to CI log volume: 220,971
lines in one `test` build, 12% of all `services.log` lines, peaking at 13,076
per second.

Name them all in one line instead. The diagnostic keeps its full content and
the line count drops by the size of the unhydrated set.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
@def-
def- requested a review from antiguru August 17, 2026 17:59
@def-
def- requested a review from a team as a code owner August 17, 2026 17:59

@antiguru antiguru left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you, this has been bothering me for so long!

@def-
def- enabled auto-merge (squash) August 17, 2026 20:19
@def-
def- merged commit 59ca751 into MaterializeInc:main Aug 17, 2026
83 of 84 checks passed
@def-
def- deleted the ci-log-volume branch August 17, 2026 20:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants