Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test flake in cmd/quota.sh: secrets not showing up #9929

Closed
miminar opened this issue Jul 19, 2016 · 7 comments · Fixed by #10705
Closed

Test flake in cmd/quota.sh: secrets not showing up #9929

miminar opened this issue Jul 19, 2016 · 7 comments · Fixed by #10705
Assignees
Labels
kind/test-flake Categorizes issue or PR as related to test flakes. priority/P1

Comments

@miminar
Copy link

miminar commented Jul 19, 2016

FAILURE after 60.119s: test/cmd/quota.sh:25: executing 'oc describe appliedclusterresourcequota/for-deads-by-annotation -n bar --as deads' expecting any result and text 'secrets.*18'; re-trying every 0.2s until completion or 60.000s: the command timed out
Standard output from the command:
Name:       for-deads-by-annotation
Namespace:  <none>
Created:    2 seconds ago
Labels:     <none>
Annotations:    <none>
Label Selector: <null>
AnnotationSelector: map[openshift.io/requester:deads]
...

... repeated 2 times
Name:       for-deads-by-annotation
Namespace:  <none>
Created:    About a minute ago
Labels:     <none>
Annotations:    <none>
Label Selector: <null>
AnnotationSelector: map[openshift.io/requester:deads]
Resource    Used    Hard
--------    ----    ----
secrets     17  50
... repeated 3 times
There was no error output from the command.
[ERROR] jUnit test marker could not be placed, expected one test in flight, got 0
[ERROR] PID 2608: hack/lib/cmd.sh:95: `return 1` exited with status 1.
[INFO]      Stack Trace: 
[INFO]        1: hack/lib/cmd.sh:95: `return 1`
[INFO]        2: hack/lib/cmd.sh:139: os::cmd::internal::run_until_text
[INFO]        3: test/cmd/quota.sh:25: os::cmd::try_until_text
[INFO]   Exiting with code 1.

See job 3506 for details.

@danmcp danmcp added priority/P2 kind/test-flake Categorizes issue or PR as related to test flakes. labels Jul 19, 2016
@deads2k
Copy link
Contributor

deads2k commented Jul 19, 2016

@stevekuznetsov The etcd dump for the linked build doesn't have any data in it. Any idea where it went?

@stevekuznetsov
Copy link
Contributor

Looking ... the jUnit stuff failed as well. Weird.

@deads2k
Copy link
Contributor

deads2k commented Jul 19, 2016

Looking ... the jUnit stuff failed as well. Weird.

Thanks. I'd like to know why my secrets aren't getting created. Getting less than 18 secrets means that something won't work.

@stevekuznetsov
Copy link
Contributor

I mean let's be honest here, 18 is a lot of secrets. Can't we just live with, 15 or so?

@stevekuznetsov
Copy link
Contributor

As an aside, can you do a jsonpath into the object instead of a grep on the output of describe?

@stevekuznetsov
Copy link
Contributor

Fixed the jUnit bug. but since the cleanup for test-cmd is still a) special and b) inside set +o errexit we really can't tell if that curl succeeded or not, sorry. There's no logs and I guess it just failed silently?

@deads2k
Copy link
Contributor

deads2k commented Aug 29, 2016

This is the "off by one" (off by X since we started batching the updates) that is caused by a reconciliation check that doesn't get a complete list that includes secrets about to be created. The design here: kubernetes/kubernetes#20113 ought to resolve it.

I'll address this by loosening the regex to eliminate the flake.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/test-flake Categorizes issue or PR as related to test flakes. priority/P1
Projects
None yet
Development

Successfully merging a pull request may close this issue.

5 participants