Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[CI] AzureSnapshotRepoTestKitIT testRepositoryAnalysis failing #107502

Closed
kkrik-es opened this issue Apr 16, 2024 · 2 comments · Fixed by #108336
Closed

[CI] AzureSnapshotRepoTestKitIT testRepositoryAnalysis failing #107502

kkrik-es opened this issue Apr 16, 2024 · 2 comments · Fixed by #108336
Labels
:Distributed/Discovery-Plugins Anything related to our integration plugins with EC2, GCP and Azure low-risk An open issue or test failure that is a low risk to future releases Team:Distributed Meta label for distributed team >test-failure Triaged test failures from CI

Comments

@kkrik-es
Copy link
Contributor

Looks similar to #94868

Build scan:
https://gradle-enterprise.elastic.co/s/vophwovpli5t2/tests/:x-pack:plugin:snapshot-repo-test-kit:qa:azure:javaRestTest/org.elasticsearch.repositories.blobstore.testkit.AzureSnapshotRepoTestKitIT/testRepositoryAnalysis

Reproduction line:

./gradlew ':x-pack:plugin:snapshot-repo-test-kit:qa:azure:javaRestTest' --tests "org.elasticsearch.repositories.blobstore.testkit.AzureSnapshotRepoTestKitIT.testRepositoryAnalysis" -Dtests.seed=68359F16DA9F0872 -Dtests.locale=en-PH -Dtests.timezone=Africa/El_Aaiun -Druntime.java=21

Applicable branches:
main

Reproduces locally?:
Didn't try

Failure history:
Failure dashboard for org.elasticsearch.repositories.blobstore.testkit.AzureSnapshotRepoTestKitIT#testRepositoryAnalysis

Failure excerpt:

org.elasticsearch.client.ResponseException: method [POST], host [http://[::1]:33961], URI [/_snapshot/repository/_analyze?blob_count=10&seed=-5068554895358180987&max_blob_size=1mb&timeout=120s&concurrency=4], status line [HTTP/1.1 500 Internal Server Error]
{"error":{"root_cause":[{"type":"repository_verification_exception","reason":"[repository] uncontended register operation failed: expected [2] but did not observe any value"}],"type":"repository_verification_exception","reason":"[repository] analysis failed, you may need to manually remove [temp-analysis-0hYz9m2ERni19RiUj12sqA]","caused_by":{"type":"repository_verification_exception","reason":"[repository] uncontended register operation failed: expected [2] but did not observe any value"}},"status":500}

  at __randomizedtesting.SeedInfo.seed([68359F16DA9F0872:91083E7804043B9B]:0)
  at org.elasticsearch.client.RestClient.convertResponse(RestClient.java:351)
  at org.elasticsearch.client.RestClient.performRequest(RestClient.java:317)
  at org.elasticsearch.client.RestClient.performRequest(RestClient.java:292)
  at org.elasticsearch.repositories.blobstore.testkit.AbstractSnapshotRepoTestKitRestTestCase.testRepositoryAnalysis(AbstractSnapshotRepoTestKitRestTestCase.java:35)
  at jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:103)
  at java.lang.reflect.Method.invoke(Method.java:580)
  at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1758)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:946)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:982)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:996)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at org.junit.rules.RunRules.evaluate(RunRules.java:20)
  at org.apache.lucene.tests.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:48)
  at org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
  at org.apache.lucene.tests.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:45)
  at org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
  at org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
  at org.junit.rules.RunRules.evaluate(RunRules.java:20)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:843)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:490)
  at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:955)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:840)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:891)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:902)
  at org.elasticsearch.test.cluster.local.DefaultLocalElasticsearchCluster$1.evaluate(DefaultLocalElasticsearchCluster.java:47)
  at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
  at org.junit.rules.RunRules.evaluate(RunRules.java:20)
  at org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at org.apache.lucene.tests.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at org.apache.lucene.tests.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
  at org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
  at org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
  at org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
  at org.apache.lucene.tests.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:47)
  at org.junit.rules.RunRules.evaluate(RunRules.java:20)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:850)
  at java.lang.Thread.run(Thread.java:1583)
@kkrik-es kkrik-es added :Distributed/Discovery-Plugins Anything related to our integration plugins with EC2, GCP and Azure >test-failure Triaged test failures from CI Team:Distributed Meta label for distributed team labels Apr 16, 2024
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-distributed (Team:Distributed)

@volodk85 volodk85 added low-risk An open issue or test failure that is a low risk to future releases and removed blocker labels Apr 22, 2024
@kkrik-es
Copy link
Contributor Author

kkrik-es commented May 1, 2024

Still failing: https://gradle-enterprise.elastic.co/s/nhneq4q2gs47i

@kkrik-es kkrik-es mentioned this issue May 1, 2024
Merged
elasticsearchmachine pushed a commit that referenced this issue May 1, 2024
@kkrik-es
Mute AzureSnapshotRepoTestKitIT.testRepositoryAnalysis (#108120)
848e210 
Related to #107502
ywangd added a commit to ywangd/elasticsearch that referenced this issue May 7, 2024
@ywangd
Unmute Azure 3rd party tests
f7c123c 
Unmute Azure 3rd party tests (again) after re-generating credentials
following the updated guide.

Relates: elastic#107928
Fixes: elastic#107720
Fixes: elastic#107502
@ywangd ywangd mentioned this issue May 7, 2024
Merged
@arteam arteam closed this as completed in eba6a84 May 7, 2024
ywangd added a commit to ywangd/elasticsearch that referenced this issue May 7, 2024
@ywangd
Unmute Azure 3rd party tests (elastic#108336)
d334d4c 
Unmute Azure 3rd party tests (again) after re-generating credentials
following the updated guide.

Relates: elastic#107928
Fixes: elastic#107720
Fixes: elastic#107502
(cherry picked from commit eba6a84)

# Conflicts:
#	modules/repository-azure/src/internalClusterTest/java/org/elasticsearch/repositories/azure/AzureStorageCleanupThirdPartyTests.java
#	x-pack/plugin/snapshot-repo-test-kit/qa/azure/src/javaRestTest/java/org/elasticsearch/repositories/blobstore/testkit/AzureSnapshotRepoTestKitIT.java
elasticsearchmachine pushed a commit that referenced this issue May 7, 2024
@ywangd
[8.14] Unmute Azure 3rd party tests (#108336) (#108344)
a3195f4 
* Unmute Azure 3rd party tests (#108336)

Unmute Azure 3rd party tests (again) after re-generating credentials
following the updated guide.

Relates: #107928
Fixes: #107720
Fixes: #107502
(cherry picked from commit eba6a84)

# Conflicts:
#	modules/repository-azure/src/internalClusterTest/java/org/elasticsearch/repositories/azure/AzureStorageCleanupThirdPartyTests.java
#	x-pack/plugin/snapshot-repo-test-kit/qa/azure/src/javaRestTest/java/org/elasticsearch/repositories/blobstore/testkit/AzureSnapshotRepoTestKitIT.java

* remove redundant change
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
:Distributed/Discovery-Plugins Anything related to our integration plugins with EC2, GCP and Azure low-risk An open issue or test failure that is a low risk to future releases Team:Distributed Meta label for distributed team >test-failure Triaged test failures from CI
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Unmute Azure 3rd party tests ywangd/elasticsearch
3 participants
@elasticsearchmachine @volodk85 @kkrik-es