Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

gcp_logging_collect recipe fails silently when it hits Cloud Logging API limits #679

Open
bskeggs opened this issue Dec 2, 2022 · 0 comments

Comments

@bskeggs
Copy link
Collaborator

bskeggs commented Dec 2, 2022

When running the gcp_logging_collect recipe, the collection will fail silently if it exceeds the cloud logging API quota limit.

Based on my testing, this will first issue a 'google_api_exceptions.TooManyRequests' exception. Following this, all subsequent queries from the same logging client will be returned with a 'google_api_exceptions.StopIteration' exception. This occurs even when I implemented a 2 minute delay between requests after the first 'TooManyRequests' exception.

Due to this, I believe the previous logging retries fix from 32e3978 may not achieve any successful retries, as a new logging client is not generated after hitting the API limit.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant