Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failing ES Promotion: x-pack/test/functional/apps/remote_clusters/feature_controls/remote_clusters_security·ts.Remote Clusters app feature controls security global dashboard all with license_management_user should render the "Data" section with Remote Clusters #89181

Closed
mistic opened this issue Jan 25, 2021 · 7 comments · Fixed by #89723
Closed

Failing ES Promotion: x-pack/test/functional/apps/remote_clusters/feature_controls/remote_clusters_security·ts.Remote Clusters app feature controls security global dashboard all with license_management_user should render the "Data" section with Remote Clusters #89181

mistic opened this issue Jan 25, 2021 · 7 comments · Fixed by #89723
Labels
blocker failed-es-promotion skipped-test Team:Kibana Management Dev Tools, Index Management, Upgrade Assistant, ILM, Ingest Node Pipelines, and more Team:Security Team focused on: Auth, Users, Roles, Spaces, Audit Logging, and more! v7.12.0

Comments

@mistic
Copy link
Member

mistic commented Jan 25, 2021

This failure is preventing the promotion of the current Elasticsearch nightly snapshot.

https://kibana-ci.elastic.co/job/elasticsearch+snapshots+verify/2137/testReport/junit/Chrome%20X-Pack%20UI%20Functional%20Tests/x-pack_test_functional_apps_remote_clusters_feature_controls_remote_clusters_security%C2%B7ts/Kibana_Pipeline___kibana_xpack_agent___Remote_Clusters_app_feature_controls_security_global_dashboard_all_with_license_management_user_should_render_the__Data__section_with_Remote_Clusters_2/

For more information on the Elasticsearch snapshot promotion process: https://www.elastic.co/guide/en/kibana/master/development-es-snapshots.html

Failed Tests Reporter:
  - Test has failed 1 times on tracked branches: https://dryrun

[00:00:00]       │
[00:16:12]         └-: Remote Clusters app
[00:16:12]           └-> "before all" hook
[00:16:12]           └-: feature controls
[00:16:12]             └-> "before all" hook
[00:16:12]             └-: security
[00:16:12]               └-> "before all" hook
[00:16:12]               └-> "before all" hook
[00:16:12]                 │ info [empty_kibana] Loading "mappings.json"
[00:16:12]                 │ info [o.e.c.m.MetadataDeleteIndexService] [kibana-ci-immutable-centos-tests-xl-1611581573293805582] [.kibana_1/reFzXwnqShWr3exWVl5lzA] deleting index
[00:16:12]                 │ info [o.e.c.m.MetadataDeleteIndexService] [kibana-ci-immutable-centos-tests-xl-1611581573293805582] [.kibana_2/mtrV94VkTN6nPR9MuALShQ] deleting index
[00:16:12]                 │ info [empty_kibana] Deleted existing index [".kibana_2",".kibana_1"]
[00:16:12]                 │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-centos-tests-xl-1611581573293805582] [.kibana] creating index, cause [api], templates [], shards [1]/[1]
[00:16:12]                 │ info [empty_kibana] Created index ".kibana"
[00:16:12]                 │ debg [empty_kibana] ".kibana" settings {"index":{"number_of_replicas":"1","number_of_shards":"1"}}
[00:16:12]                 │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-centos-tests-xl-1611581573293805582] [.kibana/SrwBiaFaTBeKwUOng71dMw] update_mapping [_doc]
[00:16:12]                 │ debg Migrating saved objects
[00:16:12]                 │ proc [kibana]   log   [14:42:35.870] [info][savedobjects-service] Creating index .kibana_2.
[00:16:12]                 │ proc [kibana]   log   [14:42:35.872] [info][savedobjects-service] Creating index .kibana_task_manager_25.
[00:16:12]                 │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-centos-tests-xl-1611581573293805582] [.kibana_task_manager_25] creating index, cause [api], templates [], shards [1]/[1]
[00:16:12]                 │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-centos-tests-xl-1611581573293805582] updating number_of_replicas to [0] for indices [.kibana_task_manager_25]
[00:16:12]                 │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-centos-tests-xl-1611581573293805582] [.kibana_2] creating index, cause [api], templates [], shards [1]/[1]
[00:16:12]                 │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-centos-tests-xl-1611581573293805582] updating number_of_replicas to [0] for indices [.kibana_2]
[00:16:12]                 │ proc [kibana]   log   [14:42:35.951] [info][savedobjects-service] Migrating .kibana_task_manager_24 saved objects to .kibana_task_manager_25
[00:16:12]                 │ proc [kibana]   log   [14:42:35.968] [info][savedobjects-service] Reindexing .kibana to .kibana_1
[00:16:12]                 │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-centos-tests-xl-1611581573293805582] [.kibana_task_manager_25/Rn_oRqguRtirv_50MpszNQ] update_mapping [_doc]
[00:16:12]                 │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-centos-tests-xl-1611581573293805582] [.kibana_1] creating index, cause [api], templates [], shards [1]/[1]
[00:16:12]                 │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-centos-tests-xl-1611581573293805582] updating number_of_replicas to [0] for indices [.kibana_1]
[00:16:12]                 │ proc [kibana]   log   [14:42:36.022] [info][savedobjects-service] Pointing alias .kibana_task_manager to .kibana_task_manager_25.
[00:16:12]                 │ info [o.e.t.LoggingTaskListener] [kibana-ci-immutable-centos-tests-xl-1611581573293805582] 31883 finished with response BulkByScrollResponse[took=1.1ms,timed_out=false,sliceId=null,updated=0,created=0,deleted=0,batches=0,versionConflicts=0,noops=0,retries=0,throttledUntil=0s,bulk_failures=[],search_failures=[]]
[00:16:12]                 │ proc [kibana]   log   [14:42:36.056] [info][savedobjects-service] Finished in 185ms.
[00:16:12]                 │ info [o.e.c.m.MetadataDeleteIndexService] [kibana-ci-immutable-centos-tests-xl-1611581573293805582] [.kibana/SrwBiaFaTBeKwUOng71dMw] deleting index
[00:16:12]                 │ proc [kibana]   log   [14:42:36.316] [info][savedobjects-service] Migrating .kibana_1 saved objects to .kibana_2
[00:16:12]                 │ proc [kibana]   log   [14:42:36.319] [info][savedobjects-service] Pointing alias .kibana to .kibana_2.
[00:16:12]                 │ proc [kibana]   log   [14:42:36.345] [info][savedobjects-service] Finished in 477ms.
[00:16:12]                 │ debg applying update to kibana config: {"accessibility:disableAnimations":true,"dateFormat:tz":"UTC","visualization:visualize:legacyChartsLibrary":true}
[00:16:12]                 │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-centos-tests-xl-1611581573293805582] [.kibana_2/ZofgeAyhQQm9pXMGok6ciQ] update_mapping [_doc]
[00:16:14]                 │ debg navigating to home url: http://localhost:6121/app/home#/
[00:16:14]                 │ debg navigate to: http://localhost:6121/app/home#/
[00:16:14]                 │ debg browser[INFO] http://localhost:6121/app/home?_t=1611585757940#/ 341 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:16:14]                 │
[00:16:14]                 │ debg browser[INFO] http://localhost:6121/bootstrap.js 42:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:16:14]                 │ debg ... sleep(700) start
[00:16:15]                 │ debg ... sleep(700) end
[00:16:15]                 │ debg returned from get, calling refresh
[00:16:15]                 │ debg browser[INFO] http://localhost:6121/app/home?_t=1611585757940#/ 341 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:16:15]                 │
[00:16:15]                 │ debg browser[INFO] http://localhost:6121/bootstrap.js 42:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:16:16]                 │ debg currentUrl = http://localhost:6121/app/home#/
[00:16:16]                 │          appUrl = http://localhost:6121/app/home#/
[00:16:16]                 │ debg TestSubjects.find(kibanaChrome)
[00:16:16]                 │ debg Find.findByCssSelector('[data-test-subj="kibanaChrome"]') with timeout=60000
[00:16:16]                 │ debg ... sleep(501) start
[00:16:17]                 │ debg ... sleep(501) end
[00:16:17]                 │ debg in navigateTo url = http://localhost:6121/app/home#/
[00:16:17]                 │ debg TestSubjects.exists(statusPageContainer)
[00:16:17]                 │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="statusPageContainer"]') with timeout=2500
[00:16:19]                 │ debg --- retry.tryForTime error: [data-test-subj="statusPageContainer"] is not displayed
[00:16:35]               └-: global dashboard all with license_management_user
[00:16:35]                 └-> "before all" hook
[00:16:35]                 └-> "before all" hook
[00:16:35]                   │ debg set roles = global_dashboard_all,license_management_user
[00:16:35]                   │ debg creating user test_user
[00:16:35]                   │ info [o.e.x.s.a.u.TransportPutUserAction] [kibana-ci-immutable-centos-tests-xl-1611581573293805582] updated user [test_user]
[00:16:35]                   │ debg created user test_user
[00:16:35]                   │ debg TestSubjects.exists(kibanaChrome)
[00:16:35]                   │ debg Find.existsByCssSelector('[data-test-subj="kibanaChrome"]') with timeout=2500
[00:16:35]                   │ debg TestSubjects.find(kibanaChrome)
[00:16:35]                   │ debg Find.findByCssSelector('[data-test-subj="kibanaChrome"]') with timeout=100000
[00:16:35]                   │ debg browser[INFO] http://localhost:6121/app/management?_t=1611585770968 341 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:16:35]                   │
[00:16:35]                   │ debg browser[INFO] http://localhost:6121/bootstrap.js 42:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:16:37]                 └-> should show the Stack Management nav link
[00:16:37]                   └-> "before each" hook: global before each
[00:16:37]                   │ debg isGlobalLoadingIndicatorVisible
[00:16:37]                   │ debg TestSubjects.exists(globalLoadingIndicator)
[00:16:37]                   │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="globalLoadingIndicator"]') with timeout=1500
[00:16:38]                   │ debg --- retry.tryForTime error: [data-test-subj="globalLoadingIndicator"] is not displayed
[00:16:39]                   │ debg TestSubjects.exists(globalLoadingIndicator-hidden)
[00:16:39]                   │ debg Find.existsByCssSelector('[data-test-subj="globalLoadingIndicator-hidden"]') with timeout=100000
[00:16:39]                   │ debg TestSubjects.exists(collapsibleNav)
[00:16:39]                   │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="collapsibleNav"]') with timeout=2500
[00:16:41]                   │ debg --- retry.tryForTime error: [data-test-subj="collapsibleNav"] is not displayed
[00:16:42]                   │ debg TestSubjects.click(toggleNavButton)
[00:16:42]                   │ debg Find.clickByCssSelector('[data-test-subj="toggleNavButton"]') with timeout=10000
[00:16:42]                   │ debg Find.findByCssSelector('[data-test-subj="toggleNavButton"]') with timeout=10000
[00:16:42]                   │ debg TestSubjects.find(collapsibleNav)
[00:16:42]                   │ debg Find.findByCssSelector('[data-test-subj="collapsibleNav"]') with timeout=10000
[00:16:42]                   │ debg Find.existsByCssSelector('[data-test-subj=collapsibleNav] > button') with timeout=2500
[00:16:42]                   │ debg Find.findByCssSelector('[data-test-subj=collapsibleNav] > button') with timeout=10000
[00:16:42]                   │ debg Find.clickByCssSelector('[data-test-subj=collapsibleNav] > button') with timeout=10000
[00:16:42]                   │ debg Find.findByCssSelector('[data-test-subj=collapsibleNav] > button') with timeout=10000
[00:16:42]                   └- ✓ pass  (5.5s) "Remote Clusters app feature controls security global dashboard all with license_management_user should show the Stack Management nav link"
[00:16:42]                 └-> should render the "Data" section with Remote Clusters
[00:16:42]                   └-> "before each" hook: global before each
[00:16:42]                   │ debg navigating to management url: http://localhost:6121/app/management
[00:16:42]                   │ debg navigate to: http://localhost:6121/app/management
[00:16:42]                   │ debg browser[INFO] http://localhost:6121/app/management?_t=1611585785932 341 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:16:42]                   │
[00:16:42]                   │ debg browser[INFO] http://localhost:6121/bootstrap.js 42:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:16:42]                   │ debg ... sleep(700) start
[00:16:43]                   │ debg ... sleep(700) end
[00:16:43]                   │ debg returned from get, calling refresh
[00:16:43]                   │ debg browser[INFO] http://localhost:6121/app/management?_t=1611585785932 341 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:16:43]                   │
[00:16:43]                   │ debg browser[INFO] http://localhost:6121/bootstrap.js 42:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:16:44]                   │ debg currentUrl = http://localhost:6121/app/management
[00:16:44]                   │          appUrl = http://localhost:6121/app/management
[00:16:44]                   │ debg TestSubjects.find(kibanaChrome)
[00:16:44]                   │ debg Find.findByCssSelector('[data-test-subj="kibanaChrome"]') with timeout=60000
[00:16:44]                   │ debg ... sleep(501) start
[00:16:45]                   │ debg ... sleep(501) end
[00:16:45]                   │ debg in navigateTo url = http://localhost:6121/app/management
[00:16:45]                   │ debg TestSubjects.exists(statusPageContainer)
[00:16:45]                   │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="statusPageContainer"]') with timeout=2500
[00:16:47]                   │ debg --- retry.tryForTime error: [data-test-subj="statusPageContainer"] is not displayed
[00:16:48]                   │ debg Find.allByCssSelector('.mgtSideBarNav > .euiSideNav__content > .euiSideNavItem') with timeout=10000
[00:16:48]                   │ info Taking screenshot "/dev/shm/workspace/kibana/x-pack/test/functional/screenshots/failure/Remote Clusters app feature controls security global dashboard all with license_management_user should render the _Data_ section with Remote Clusters.png"
[00:16:48]                   │ info Current URL is: http://localhost:6121/app/management
[00:16:48]                   │ info Saving page source to: /dev/shm/workspace/kibana/x-pack/test/functional/failure_debug/html/Remote Clusters app feature controls security global dashboard all with license_management_user should render the _Data_ section with Remote Clusters.html
[00:16:48]                   └- ✖ fail: Remote Clusters app feature controls security global dashboard all with license_management_user should render the "Data" section with Remote Clusters
[00:16:48]                   │       Error: expected { sectionId: 'data',
[00:16:48]                   │   sectionLinks: 
[00:16:48]                   │    [ 'index_management',
[00:16:48]                   │      'index_lifecycle_management',
[00:16:48]                   │      'snapshot_restore',
[00:16:48]                   │      'transform',
[00:16:48]                   │      'remote_clusters' ] } to sort of equal { sectionId: 'data',
[00:16:48]                   │   sectionLinks: 
[00:16:48]                   │    [ 'index_management',
[00:16:48]                   │      'index_lifecycle_management',
[00:16:48]                   │      'snapshot_restore',
[00:16:48]                   │      'rollup_jobs',
[00:16:48]                   │      'transform',
[00:16:48]                   │      'remote_clusters' ] }
[00:16:48]                   │       + expected - actual
[00:16:48]                   │ 
[00:16:48]                   │          "sectionLinks": [
[00:16:48]                   │            "index_management"
[00:16:48]                   │            "index_lifecycle_management"
[00:16:48]                   │            "snapshot_restore"
[00:16:48]                   │       +    "rollup_jobs"
[00:16:48]                   │            "transform"
[00:16:48]                   │            "remote_clusters"
[00:16:48]                   │          ]
[00:16:48]                   │        }
[00:16:48]                   │       
[00:16:48]                   │       at Assertion.assert (/dev/shm/workspace/kibana/packages/kbn-expect/expect.js:100:11)
[00:16:48]                   │       at Assertion.eql (/dev/shm/workspace/kibana/packages/kbn-expect/expect.js:244:8)
[00:16:48]                   │       at Context.<anonymous> (test/functional/apps/remote_clusters/feature_controls/remote_clusters_security.ts:62:32)
[00:16:48]                   │       at runMicrotasks (<anonymous>)
[00:16:48]                   │       at processTicksAndRejections (internal/process/task_queues.js:93:5)
[00:16:48]                   │       at Object.apply (/dev/shm/workspace/kibana/packages/kbn-test/src/functional_test_runner/lib/mocha/wrap_function.js:73:16)
[00:16:48]                   │ 
[00:16:48]                   │ 
REST API
Jenkins 2.252
@mistic mistic added blocker Team:Security Team focused on: Auth, Users, Roles, Spaces, Audit Logging, and more! v8.0.0 skipped-test failed-es-promotion labels Jan 25, 2021
@elasticmachine
Copy link
Contributor

Pinging @elastic/kibana-security (Team:Security)

mistic added a commit that referenced this issue Jan 25, 2021
@mistic
skip failing es promotion suite (#89181)
342f9fb
@mistic
Copy link
Member Author

mistic commented Jan 25, 2021 •
edited by spalger
Loading

Skipped:

master/8.0: 342f9fb
7.x/7.12: aadbe32

@legrego legrego added the Team:Kibana Management Dev Tools, Index Management, Upgrade Assistant, ILM, Ingest Node Pipelines, and more label Jan 25, 2021
@elasticmachine
Copy link
Contributor

Pinging @elastic/es-ui (Team:Elasticsearch UI)

@legrego legrego mentioned this issue Jan 26, 2021
Closed
@legrego
Copy link
Member

legrego commented Jan 26, 2021

See #89180 (comment) for analysis. Likely the same root cause.

@spalger
Copy link
Contributor

spalger commented Jan 27, 2021

Just failed 7.12 snapshot verification, skipping there too https://kibana-ci.elastic.co/job/elasticsearch+snapshots+verify/2161

spalger pushed a commit that referenced this issue Jan 27, 2021
@mistic @spalger
skip failing es promotion suite (#89181)
aadbe32 
(cherry picked from commit 342f9fb)
@legrego
Copy link
Member

legrego commented Jan 27, 2021

This is a known bad snapshot, do we really want to skip the failing test to promote?

@spalger
Copy link
Contributor

spalger commented Jan 27, 2021 •
edited
Loading

Honestly, I'm just replicating what Tiago did for master. I'm not a big fan of skipping tests in order to "fix" (not really fixing anything) incompatibility with ES, but I think we either need to move faster to fix the incompatibility, revert the change in ES, or skip the test.

@spalger spalger added v7.12.0 and removed v8.0.0 labels Jan 27, 2021
@legrego legrego mentioned this issue Jan 29, 2021
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
blocker failed-es-promotion skipped-test Team:Kibana Management Dev Tools, Index Management, Upgrade Assistant, ILM, Ingest Node Pipelines, and more Team:Security Team focused on: Auth, Users, Roles, Spaces, Audit Logging, and more! v7.12.0
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Reenable skipped CCR & Remote Cluster tests legrego/kibana
4 participants
@spalger @legrego @mistic @elasticmachine