Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AutoTLS UT fails #27711

Closed
Tracked by #25899
zhouqiang-cl opened this issue Sep 1, 2021 · 6 comments · Fixed by #27744
Closed
Tracked by #25899

AutoTLS UT fails #27711

zhouqiang-cl opened this issue Sep 1, 2021 · 6 comments · Fixed by #27744
Assignees
Labels
component/test severity/major sig/sql-infra SIG: SQL Infra type/bug The issue is confirmed as a bug.

Comments

@zhouqiang-cl
Copy link
Contributor

Bug Report

Please answer these questions before submitting your issue. Thanks!

1. Minimal reproduce step (Required)

[2021-09-01T02:08:09.469Z] FAIL: tidb_test.go:878: tidbTestSerialSuite.TestTLSAuto

[2021-09-01T02:08:09.469Z] 

[2021-09-01T02:08:09.469Z] tidb_test.go:898:

[2021-09-01T02:08:09.469Z]     c.Assert(err, IsNil)

[2021-09-01T02:08:09.469Z] ... value *errors.withStack = dsn:root@tcp(127.0.0.1:33034)/test?tls=skip-verify: TLS requested but server does not support TLS ("dsn:root@tcp(127.0.0.1:33034)/test?tls=skip-verify: TLS requested but server does not support TLS")

2. What did you expect to see? (Required)

in ci https://ci.pingcap.net/blue/organizations/jenkins/tidb-unit-test-nightly/detail/tidb-unit-test-nightly/9958/pipeline/127

3. What did you see instead (Required)

4. What is your TiDB version? (Required)

@zhouqiang-cl zhouqiang-cl added the type/bug The issue is confirmed as a bug. label Sep 1, 2021
@zhouqiang-cl
Copy link
Contributor Author

@dveeden PTAL

@dveeden
Copy link
Contributor

dveeden commented Sep 1, 2021

This looks like a one-time issue where creation of TLS Certificates failed. It looks like the temp storage wasn't created which caused the code creating the certificates to fail on opening cert.pem for writing.

[2021-09-01T02:07:16.049Z] [2021/09/01 10:07:15.937 +08:00] [WARN] [misc.go:456] ["TLS Certificate creation failed"] [error="open /tmp/1000_tidb/MC4wLjAuMDo0MDAwLzAuMC4wLjA6MTAwODA=/tmp-storage/cert.pem: no such file or directory"]
[2021-09-01T02:07:16.049Z] [2021/09/01 10:07:15.937 +08:00] [ERROR] [server.go:222] ["secure connection cert/key/ca load fail"] [error="open /tmp/1000_tidb/MC4wLjAuMDo0MDAwLzAuMC4wLjA6MTAwODA=/tmp-storage/cert.pem: no such file or directory"]
[2021-09-01T02:07:16.049Z] [2021/09/01 10:07:15.937 +08:00] [INFO] [server.go:245] ["server is running MySQL protocol"] [addr=127.0.0.1:0]
[2021-09-01T02:07:16.308Z] 
[2021-09-01T02:07:16.308Z] ----------------------------------------------------------------------
[2021-09-01T02:07:16.308Z] FAIL: tidb_test.go:878: tidbTestSerialSuite.TestTLSAuto
[2021-09-01T02:07:16.308Z] 
[2021-09-01T02:07:16.308Z] tidb_test.go:898:
[2021-09-01T02:07:16.308Z]     c.Assert(err, IsNil)
[2021-09-01T02:07:16.308Z] ... value *errors.withStack = dsn:root@tcp(127.0.0.1:33034)/test?tls=skip-verify: TLS requested but server does not support TLS ("dsn:root@tcp(127.0.0.1:33034)/test?tls=skip-verify: TLS requested but server does not support TLS")
[2021-09-01T02:07:16.308Z] 

@zhouqiang-cl
Copy link
Contributor Author

This looks like a one-time issue where creation of TLS Certificates failed. It looks like the temp storage wasn't created which caused the code creating the certificates to fail on opening cert.pem for writing.

[2021-09-01T02:07:16.049Z] [2021/09/01 10:07:15.937 +08:00] [WARN] [misc.go:456] ["TLS Certificate creation failed"] [error="open /tmp/1000_tidb/MC4wLjAuMDo0MDAwLzAuMC4wLjA6MTAwODA=/tmp-storage/cert.pem: no such file or directory"]
[2021-09-01T02:07:16.049Z] [2021/09/01 10:07:15.937 +08:00] [ERROR] [server.go:222] ["secure connection cert/key/ca load fail"] [error="open /tmp/1000_tidb/MC4wLjAuMDo0MDAwLzAuMC4wLjA6MTAwODA=/tmp-storage/cert.pem: no such file or directory"]
[2021-09-01T02:07:16.049Z] [2021/09/01 10:07:15.937 +08:00] [INFO] [server.go:245] ["server is running MySQL protocol"] [addr=127.0.0.1:0]
[2021-09-01T02:07:16.308Z] 
[2021-09-01T02:07:16.308Z] ----------------------------------------------------------------------
[2021-09-01T02:07:16.308Z] FAIL: tidb_test.go:878: tidbTestSerialSuite.TestTLSAuto
[2021-09-01T02:07:16.308Z] 
[2021-09-01T02:07:16.308Z] tidb_test.go:898:
[2021-09-01T02:07:16.308Z]     c.Assert(err, IsNil)
[2021-09-01T02:07:16.308Z] ... value *errors.withStack = dsn:root@tcp(127.0.0.1:33034)/test?tls=skip-verify: TLS requested but server does not support TLS ("dsn:root@tcp(127.0.0.1:33034)/test?tls=skip-verify: TLS requested but server does not support TLS")
[2021-09-01T02:07:16.308Z] 

Seems it fails very frequently https://ci.pingcap.net/blue/organizations/jenkins/tidb-unit-test-nightly/detail/tidb-unit-test-nightly/9962/pipeline/135

@dveeden
Copy link
Contributor

dveeden commented Sep 1, 2021

/assign @dveeden

@github-actions
Copy link

github-actions bot commented Sep 2, 2021

Please check whether the issue should be labeled with 'affects-x.y' or 'backport-x.y.z',
and then remove 'needs-more-info' label.

@dveeden
Copy link
Contributor

dveeden commented Sep 2, 2021

/unlabel needs-more-info

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
component/test severity/major sig/sql-infra SIG: SQL Infra type/bug The issue is confirmed as a bug.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants