v0.11.0
Highlights
Major improvements to Kafka extractor, BigQuery concurrency, HTTP sink templating, and Merlin authentication.
New Features
- Kafka auth — Add authentication and authorization support for Kafka extractor.
- Sink batching — Add batch size config for sink concurrency.
- HTTP before_script — Add before_script hook before making HTTP requests.
- BigQuery concurrency — Configurable concurrency for extracting assets from BigQuery.
- HTTP sink templating — Support templating for HTTP sinks.
Improvements
- Merlin — Replaced access token with ID token in Merlin extractor.
- BigQuery — Do not send preview field and rows if max_preview_rows is -1.
Bug Fixes
- Fixed multiple Kafka extractor issues.
Full Changelog: v0.10.1...v0.11.0