You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
docs: add v26.38.0 notes for dictionary compression and observability
Documents three user-facing additions to the v26.38.0 release notes:
* **Dictionary compression**, as a public-preview feature section. Covers the
memory it saves when a column repeats values, the `EXPERIMENTAL ARRANGEMENT
COMPRESSION` opt-in, and the CPU-for-memory tradeoff plus the replica
replacement that changing the option triggers. The option is per cluster
only; it is rejected on unmanaged clusters, per
test/sqllogictest/managed_cluster.slt:450.
* **Observability integrations for Self-Managed**, covering export of metrics
and optionally logs to Datadog, Honeycomb, Google Cloud Monitoring,
Prometheus remote write, or any OTLP endpoint, with the bundled monitoring
stack the Terraform modules install as the fallback for deployments that
have no stack of their own.
* **materialize-debug-freshness**, the agent skill added in
MaterializeInc/agent-skills#35.
All 16 links and their anchors were verified to resolve against a local Hugo
build, which passes clean.
Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
[arrangements](/get-started/arrangements/#arrangements) use when a column holds the same values repeatedly. Instead of storing a repeated column value each time it appears, Materialize stores that value once and has each row reference it. This can reduce steady state memory requirements after [hydration](/concepts/hydration/) has completed.
32
+
33
+
Dictionary compression is off by default. You opt in per cluster with the
34
+
`EXPERIMENTAL ARRANGEMENT COMPRESSION` option:
35
+
36
+
```mzsql
37
+
-- Turn compression on for a new cluster
38
+
CREATE CLUSTER my_cluster (
39
+
SIZE = '100cc',
40
+
EXPERIMENTAL ARRANGEMENT COMPRESSION = true
41
+
);
42
+
43
+
-- Or turn it on for an existing cluster
44
+
ALTER CLUSTER my_cluster SET (EXPERIMENTAL ARRANGEMENT COMPRESSION = true);
45
+
```
46
+
47
+
For more information, see:
48
+
-[Guide: Dictionary compression](/transform-data/dictionary-compression/), including [when it helps and when it does not](/transform-data/dictionary-compression/#the-tradeoff)
-**Notice for single-replica sources on multi-replica clusters**: Materialize now warns when a command leaves a cluster holding more than one replica alongside PostgreSQL, MySQL, or SQL Server sources, which always run on a single replica, since the extra replicas make those sources neither more fault tolerant nor faster to ingest.
28
85
-**Self-Managed: Graceful resizing of system clusters**: `ALTER CLUSTER ... SET (SIZE ...)` on a system cluster such as `mz_catalog_server` or `mz_system` now runs as a background graceful reconfiguration, with a 24-hour default deadline and a rollback on timeout, instead of recreating the whole replica set at once, so `SHOW CLUSTERS` settles on the new configuration rather than flipping to it.
29
86
30
87
### Agent Skills {#v26.38-agent-skills}
88
+
-**materialize-debug-freshness**: New agent skill for diagnosing why an object is behind wall-clock time, whether that surfaces as a stale materialized view, index, or sink, or as a freshness alert. Running on the read-only tools of the Materialize developer MCP server, it ranks what is lagging, attributes the lag to a single hop, then rules out in-progress hydration, a replica dominated by one dataflow, and per-worker skew before naming the culprit operator and the SQL responsible for the expensive work.
31
89
-**mz-deploy**: New agent skill covering the `mz-deploy` CLI — project layout, the compile/test/apply/stage/promote workflow, deploy IDs and staging suffixes, schema-granularity conflict detection, stable API schemas, profile resolution, and the `EXECUTE UNIT TEST` grammar.
32
90
-**mz-sql-lsp**: New Claude Code plugin, installable from the `agent-skills` repository's new `materialize` plugin marketplace, that registers the `mz-deploy` language server for `.sql` files so agents can use go-to-definition, hover, and workspace symbols in an mz-deploy project instead of text search.
0 commit comments