Releases: rh-marketingops/fluvii
recovery offset tweak
Tweaked what the table offset gets set to once table recovery is complete as it was possible to miss a table entry by setting it to the highwater, which shouldn't have been done anyway because of the way the table tracks its own offsets.
One might argue to change this to line up with how Kafka tracks it at some point (aka the offset is the "next" offset, whereas the table tracks what offset it has read up to), which might be done in the future, but it gets a little tricky with transactions.
bugfix for table recovery
The previous bugfix attempt failed because technically the transaction._pending_table_writes
always has keys in it...a simpler solution is just checking if transaction.message
is populated.
bugfix for table recovery
There was a method that was removed/simplified in table recovery but was not adjusted for correctly.
FIx issue with table recovery
There was an issue with table recovery; since there are no consumer commits during table recovery, there was no way to stop the recovery loop with the typical TransactionNotRequired
exception since it was only thrown by the consumer during a commit. Have added this exception to be thrown during the "table commit" step during recovery. Basically, when there are more offsets remaining, but they are not consumable, then there will be no table updates, and thus this exception will be thrown as expected.
FIx for metrics logging in Producer and Consumer
Producer and Consumer were using the wrong methods for metrics logging with produced and consumed messages.
bugfix for consumer config setting
Fixed a bad consumer config setting and renamed it to make it more obvious what it is.
bugfix for push rate str
Fix an issue where the metrics push rate was defaulting to a string when it should be an int.
Oauth now implemented
Oauth for Kafka clients is now implemented correctly
Fix producer schema add function
There was a bug introduced with the last version around instantiating schemas on the producer, now fixed!
Minor Producer feature tweaks/additions
Added a very minor producer method called _get_topic_partition_count
to make it easier to retrieve a topic's partition count if you needed it, and enforced add_topic
to not re-add an existing topic unless you specify an overwrite.