Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test: declare hotrestart_test as enormous to hopefully avoid timeouts. #11459

Closed
wants to merge 1 commit into from

Conversation

jmarantz
Copy link
Contributor

@jmarantz jmarantz commented Jun 5, 2020

Commit Message: we gave been seeing timeouts in CI on this test, which I find takes 220 seconds on my workstation. In CI it might take longer, so declare the test enormous and hopefully no timeouts.
Additional Description:
Risk Level: low
Testing: just that test (in asan mode).
Docs Changes: n/a
Release Notes: n/a

Signed-off-by: Joshua Marantz <jmarantz@google.com>
@mattklein123
Copy link
Member

Something must have changed here. Is this possibly related to @zuercher recent change? I can't imagine the test should take this long?

@ggreenway
Copy link
Contributor

I tested this. Before @zuercher 's commit, the test was taking 172s (on my dev box). After, it's taking 176s. I did two runs of the test with each build, and they were very consistent. So the change did slightly increase the test time, but not by a lot. It may have pushed it past the timeout in CI though.

@jmarantz
Copy link
Contributor Author

jmarantz commented Jun 5, 2020

As you can see this fails tsan, even declared as enormous. It was a functional failure though, on the hot-restart generation stat.

@mattklein123
Copy link
Member

Well, this PR is still timing out for that test in TSAN, so something is definitely broken. :(

@mattklein123
Copy link
Member

As you can see this fails tsan, even declared as enormous. It was a functional failure though, on the hot-restart generation stat.

Ah OK, maybe there is a bug/race there also that needs to be fixed?

@jmarantz
Copy link
Contributor Author

jmarantz commented Jun 5, 2020

Do we think this bug might have been introduced by #11357 ? Or was it pre-existing?

@mattklein123
Copy link
Member

No idea.

zuercher
zuercher previously approved these changes Jun 5, 2020
@zuercher zuercher dismissed their stale review June 5, 2020 21:06

found the bug

@@ -230,6 +230,7 @@ exports_files(["test_utility.sh"])

envoy_sh_test(
name = "hotrestart_test",
size = "enormous",
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We need to fix envoy_sh_test to actual pass this size flag to envoy_cc_test. I'll put up a PR that does both, since I think @jmarantz may already be offline.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

See #11478

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'll close this in favor of yours.

@jmarantz jmarantz closed this Jun 5, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants