Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Retrieve status of insert token #595

Open
mlukerbrown opened this issue Oct 3, 2023 · 0 comments
Open

Retrieve status of insert token #595

mlukerbrown opened this issue Oct 3, 2023 · 0 comments

Comments

@mlukerbrown
Copy link

mlukerbrown commented Oct 3, 2023

Looking at the Confluence Snowflake Connector and some other examples the only way of finding if an insert via the ingestion SDK has been successful is by polling the channel status end point for the last successfully written request token. Here for example

This then asks the question of how long to continue to poll until it can be considered the insert request has failed or is still processing?
This kind of wait parameterisation (poll n times) is dependent on platform load and hence not reliable.

I'd like to raise a feature request for the API be able to poll the status of a request token on a channel, is it pending, processing or failed for example and not just respond with the last request token that was successful written.

Of course how long would the request token be kept around for, I would imagine a time to live would be set on the channel for all request tokens submitted or an ACK could be sent via the client API to clear the token out for example.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants