Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore: remove skip from the waitForResult test #2776

Closed
wants to merge 3 commits into from

Conversation

mvares
Copy link
Contributor

@mvares mvares commented Jul 16, 2024

Checklist

  • I addedtests to prove my changes
  • I updated — all the necessary docs
  • I reviewed — the entire PR myself, using the GitHub UI
  • I described — all breaking changes and the Migration Guide

@github-actions github-actions bot added the chore Issue is a chore label Jul 16, 2024
@mvares mvares marked this pull request as ready for review July 16, 2024 13:18
@mvares
Copy link
Contributor Author

mvares commented Jul 16, 2024

The timeout defined here doesn't seem sufficient to cover the test duration. Do we need to increase the time?

@petertonysmith94
Copy link
Contributor

The timeout defined here doesn't seem sufficient to cover the test duration. Do we need to increase the time?

Did you experience any issues with this test timing out locally?

@mvares
Copy link
Contributor Author

mvares commented Jul 17, 2024

Did you experience any issues with this test timing out locally?

Nops.

@petertonysmith94
Copy link
Contributor

Did you experience any issues with this test timing out locally?

Nops.

I believe we can leave it for now - if it becomes an issue down the line then we can increment the timeout.

Copy link
Member

@arboleya arboleya left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CI is failing for all node versions.

@mvares
Copy link
Contributor Author

mvares commented Jul 17, 2024

CI is failing for all node versions.

Yes. As mentioned above, the CI environment doesn't work exactly like the local environment. I believe we still need to increase it.

@arboleya
Copy link
Member

On the topic of fixing flakiness with timeouts:

@mvares
Copy link
Contributor Author

mvares commented Jul 17, 2024

On the topic of fixing flakiness with timeouts:

What's your advice? Should we wait for #2759 to be merged?

@petertonysmith94 petertonysmith94 dismissed their stale review July 17, 2024 11:49

Assumptions made

@petertonysmith94
Copy link
Contributor

On the topic of fixing flakiness with timeouts:

What's your advice? Should we wait for #2759 to be merged?

I would say that we're not fixing flakyness here - as the POA is 17s, using the default Vitest timeout (5s) is no sufficient for the given test.

An increment to the timeout might be worthwhile after looking closer at the CI failures.

Maybe a timeout of 22s might be optimal, given that the POA is 17s and default timeout is 5s?

@mvares
Copy link
Contributor Author

mvares commented Jul 17, 2024

An increment to the timeout might be worthwhile after looking closer at the CI failures.

Maybe a timeout of 22s might be optimal, given that the POA is 17s and default timeout is 5s?

Well, I think that 22s is reasonable. We can try it.

@arboleya
Copy link
Member

arboleya commented Jul 17, 2024

I don't have the proper context and cannot dive into this right now to determine what should be done.

Besides flakiness/timeouts, another concern is when tests require so much time to run.

These intricacies here may be the reason why we were skipping the test.

@mvares
Copy link
Contributor Author

mvares commented Jul 17, 2024

The duration for keep-alive messages is already defined. What we can do is increase the time (test) or enforce a different duration. However, I think this is out of the test's scope because we wouldn't have a test reflecting reality.

@maschad
Copy link
Member

maschad commented Jul 17, 2024

@mvares thanks for taking this on, the impetus for the issue #2773 was to debug why it is that the test was failing and perhaps refactor it so that we can properly test waitForResult always waits on the transaction to be successfully completed. This test still fails when using our launchTestNode utility, even with an appropriate block production time, so I think we'd need to revisit how we are handling keep alive messages and potentially refactor getSubscriptionStreamFromFetch, I'm not sure yet, but I don't think increasing the timeout is a viable option.

This task is a bit complex and involved, I think someone from the team should take it on. My apologies about that.

@mvares
Copy link
Contributor Author

mvares commented Jul 17, 2024

Right. Should I close this PR?

@maschad
Copy link
Member

maschad commented Jul 17, 2024

Right. Should I close this PR?

Yes, thanks for the effort.

@maschad maschad closed this Jul 17, 2024
@mvares mvares deleted the mv/bug branch July 17, 2024 14:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
chore Issue is a chore
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Debug waitForResult integration test
4 participants