Small trick to increase clickhouse performance and storage efficiency

[ardabeyazoglu]

Summary

Jitsu creates text columns with String data type by default. Some of these columns are very low cardinality like type, write_key, page_encoding, library_name etc. Making these columns LowCardinality(String) instead would result in better performance and lower storage cost.

I'd also recommend the following engine settings for events table by default for better storage efficiency.

ENGINE = ReplacingMergeTree
PARTITION BY toYYYYMM(timestamp)
ORDER BY (toDate(timestamp), message_id)

[github-actions]

This issue is stale because it has been open for 60 days with no activity.