Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Replaying Events From Kafka #1032

Open
onerishabh opened this issue Dec 19, 2024 · 1 comment
Open

Replaying Events From Kafka #1032

onerishabh opened this issue Dec 19, 2024 · 1 comment

Comments

@onerishabh
Copy link

Hey Team,

I'm running the connector as a Docker container. It would be nice if some pointers can be shared around if required how can I replay some events into Snowflake. I understand there is also some kind of watermarking that is done on Snowflake at the table channel level. I'm certain your response will be helpful to the wider community as well.

I have access to kafka cli on my container.

thanks!

@onerishabh
Copy link
Author

Just for context; I have tried resetting offset for consumer group on kafka but that is not enough; need to also reset channel offset of snowflake as well using SYSTEM$SNOWPIPE_STREAMING_UPDATE_CHANNEL_OFFSET_TOKEN.

Concern if SYSTEM$SNOWPIPE_STREAMING_UPDATE_CHANNEL_OFFSET_TOKEN needs an exact offset number and can't be set to null making it harder for us to rewind channels.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant