Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PoC: fuzz streamingpromql package #10575

Draft
wants to merge 1 commit into
base: main
Choose a base branch
from
Draft

PoC: fuzz streamingpromql package #10575

wants to merge 1 commit into from

Conversation

colega
Copy link
Contributor

@colega colega commented Feb 4, 2025

This is a PoC imlementation of a fuzz test for streaming promql just taking the inputs and data from the two surrounding tests (it doesn't even try functions, etc.).

This detected that the comparision function doesn't check scalars (which I fixed), and now it fails on the some_metric[0]@1m query, which returns results for Prometheus but doesn't return any for streamingpromql.

This is a PoC because it's missing:

  • Consistent and rich data input: I took two random inputs from surrounding tests, but it would be nice it we fed more data into the storage before running the queries, as that would increase the chances of hitting the bugs.
  • Add functions to the corpus: one example query for each one of the functions would be great.
  • Add timestamps to the corpus: right now we're running the query always at the same unix timestamp, but it would be better to have that as the second argument of the corpus.

This is a PoC imlementation of a fuzz test for streaming promql just
taking the inputs and data from the two surrounding tests (it doesn't
even try functions, etc.).

This detected that the comparision function doesn't check scalars (which
I fixed), and now it fails on the `some_metric[0]@1m` query, which
returns results for Prometheus but doesn't return any for
streamingpromql.

Signed-off-by: Oleg Zaytsev <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant