docs: tweaks to include subscribe based sinks #33792
Conversation
kay-kim
force-pushed
the
docs-add-links-to-subscribe-sinks
branch
from
6dc4719 to
ba36e00
Compare
| write data to and details the encoding of that data. You can sink data from a | ||
| **materialized** view, a source, or a table. | ||
|
|
||
| ### Creating a sink |
There was a problem hiding this comment.
Moved into the kafka page since kafka specific.
| - Avoid putting sinks on the same cluster that hosts sources to allow for | ||
| [blue/green deployment](/manage/dbt/blue-green-deployments). | ||
|
|
||
| ### Available guides |
There was a problem hiding this comment.
Included in the table.
|
|
||
| Materialize bundles a **native connector** that allow writing data to Kafka and | ||
| Redpanda. | ||
| Redpanda. When a user defines a sink to Kafka/Redpanda, Materialize |
There was a problem hiding this comment.
Content ported over from Sinks pages since was specifically kafka/redpanda connector.
|
|
||
| Currently, Materialize only supports sending sink data to Kafka. See | ||
| the [Kafka sink documentation](/sql/create-sink/kafka) for details. | ||
| ## Sink methods |
There was a problem hiding this comment.
|
|
||
| ## Overview | ||
|
|
||
| Sinks are the inverse of sources and represent a connection to an external stream |
There was a problem hiding this comment.
Replaced kafka-specific content with more generic content (same as in the server-results/sink page)
| ## Hydration considerations | ||
|
|
||
| During creation, sinks need to load an entire snapshot of the data in memory. | ||
| During creation, Kafka sinks need to load an entire snapshot of the data in |
There was a problem hiding this comment.
Probably will tweak to Kakfa/Redpanda sinks since ...
| - External system: "Various" | ||
| Method: "Use `SUBSCRIBE`" | ||
| Guide(s) or Example(s): | | ||
| - [Sink to Postgres](https://github.com/MaterializeInc/mz-catalog-sync) |
There was a problem hiding this comment.
Should I mention dbmate in here? that is Subscribe + dbmate?
There was a problem hiding this comment.
This repo is private 😅 I'll make it public.
There was a problem hiding this comment.
Oh ... heh heh ... Thank you ❤️ ❤️ ❤️
2 participants
https://preview.materialize.com/materialize/33792/serve-results/sink/