Skip to content

v0.11.0

Choose a tag to compare

@ravisuhag ravisuhag released this 31 Oct 18:12
· 58 commits to main since this release
2f73a1f

Highlights

Major improvements to Kafka extractor, BigQuery concurrency, HTTP sink templating, and Merlin authentication.

New Features

  • Kafka auth — Add authentication and authorization support for Kafka extractor.
  • Sink batching — Add batch size config for sink concurrency.
  • HTTP before_script — Add before_script hook before making HTTP requests.
  • BigQuery concurrency — Configurable concurrency for extracting assets from BigQuery.
  • HTTP sink templating — Support templating for HTTP sinks.

Improvements

  • Merlin — Replaced access token with ID token in Merlin extractor.
  • BigQuery — Do not send preview field and rows if max_preview_rows is -1.

Bug Fixes

  • Fixed multiple Kafka extractor issues.

Full Changelog: v0.10.1...v0.11.0