Skip to content

Releases: rh-marketingops/fluvii

recovery offset tweak

14 Nov 18:00
5a889dc
Compare
Choose a tag to compare

Tweaked what the table offset gets set to once table recovery is complete as it was possible to miss a table entry by setting it to the highwater, which shouldn't have been done anyway because of the way the table tracks its own offsets.

One might argue to change this to line up with how Kafka tracks it at some point (aka the offset is the "next" offset, whereas the table tracks what offset it has read up to), which might be done in the future, but it gets a little tricky with transactions.

bugfix for table recovery

14 Nov 01:41
02d4da7
Compare
Choose a tag to compare

The previous bugfix attempt failed because technically the transaction._pending_table_writes always has keys in it...a simpler solution is just checking if transaction.message is populated.

bugfix for table recovery

13 Nov 17:25
ffbf3d2
Compare
Choose a tag to compare

There was a method that was removed/simplified in table recovery but was not adjusted for correctly.

FIx issue with table recovery

13 Nov 16:53
1b78a7b
Compare
Choose a tag to compare

There was an issue with table recovery; since there are no consumer commits during table recovery, there was no way to stop the recovery loop with the typical TransactionNotRequired exception since it was only thrown by the consumer during a commit. Have added this exception to be thrown during the "table commit" step during recovery. Basically, when there are more offsets remaining, but they are not consumable, then there will be no table updates, and thus this exception will be thrown as expected.

FIx for metrics logging in Producer and Consumer

11 Nov 19:24
baf44ba
Compare
Choose a tag to compare

Producer and Consumer were using the wrong methods for metrics logging with produced and consumed messages.

bugfix for consumer config setting

10 Nov 23:14
44683ac
Compare
Choose a tag to compare

Fixed a bad consumer config setting and renamed it to make it more obvious what it is.

bugfix for push rate str

10 Nov 22:38
0b40a15
Compare
Choose a tag to compare

Fix an issue where the metrics push rate was defaulting to a string when it should be an int.

Oauth now implemented

04 Nov 17:46
Compare
Choose a tag to compare

Oauth for Kafka clients is now implemented correctly

Fix producer schema add function

03 Nov 18:39
b1cfed0
Compare
Choose a tag to compare

There was a bug introduced with the last version around instantiating schemas on the producer, now fixed!

Minor Producer feature tweaks/additions

02 Nov 18:08
Compare
Choose a tag to compare

Added a very minor producer method called _get_topic_partition_count to make it easier to retrieve a topic's partition count if you needed it, and enforced add_topic to not re-add an existing topic unless you specify an overwrite.