Skip to content

new CLI; table offset tracking adjustment
Compare
Choose a tag to compare
@truthordata truthordata released this 09 Jan 19:03
· 55 commits to main since this release
v0.3.0
ddc8668
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

  • table offsets now follow the typical offset model of tracking "next to be added" rather than "last successfully added". This is to help avoid confusion and more easily track bugs, should they arise. By doing this, we fix a rare edge case where table recovery misses the last entry on the topic due to the tracking being "off by 1".

  • added a new argument to SqliteFluvii to not allow table commits by default (allow_commits=False), which also added a step to avoid an initial table write and avoid issues with trying to use multiple readers at once.

  • Added a small step for tabling apps in the abort_transaction step so that it can also track failed offsets in the table for the partitions kept during rebalances (transactions are aborted any time a rebalance happens). This is a QoL adjustment that helps avoid some unneccesary rebalances.

  • There's now a Fluvii CLI! It allows you to add, delete, consume from, and produce to topics (assuming your environment is set up correctly). More documentation/examples coming soon around how to use it.

Assets 2
Loading