Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failing test: Chrome X-Pack UI Functional Tests.x-pack/test/functional_with_es_ssl/apps/ml/alert_flyout·ts - ML app anomaly detection alert overview page alert flyout controls can create an anomaly detection alert #102012

Closed
kibanamachine opened this issue Jun 12, 2021 · 31 comments · Fixed by #102030 or #102368
Closed

Failing test: Chrome X-Pack UI Functional Tests.x-pack/test/functional_with_es_ssl/apps/ml/alert_flyout·ts - ML app anomaly detection alert overview page alert flyout controls can create an anomaly detection alert #102012

kibanamachine opened this issue Jun 12, 2021 · 31 comments · Fixed by #102030 or #102368
Assignees
@pheyos
Labels
failed-test A test failure on a tracked branch, potentially flaky-test :ml

Comments

@kibanamachine
Copy link
Contributor

kibanamachine commented Jun 12, 2021 •
edited
Loading

A test failed on a tracked branch

Error: expected 'Found 12 anomalies in the last 2y.' to sort of equal 'Found 13 anomalies in the last 2y.'
    at Assertion.assert (/dev/shm/workspace/parallel/11/kibana/node_modules/@kbn/expect/expect.js:100:11)
    at Assertion.eql (/dev/shm/workspace/parallel/11/kibana/node_modules/@kbn/expect/expect.js:244:8)
    at Object.checkPreview (test/functional/services/ml/alerting.ts:100:33)
    at runMicrotasks (<anonymous>)
    at processTicksAndRejections (internal/process/task_queues.js:95:5)
    at Context.<anonymous> (test/functional_with_es_ssl/apps/ml/alert_flyout.ts:122:9)
    at Object.apply (/dev/shm/workspace/parallel/11/kibana/node_modules/@kbn/test/src/functional_test_runner/lib/mocha/wrap_function.js:73:16) {
  actual: 'Found 12 anomalies in the last 2y.',
  expected: 'Found 13 anomalies in the last 2y.',
  showDiff: true
}

First failure: Jenkins Build
@kibanamachine kibanamachine added the failed-test A test failure on a tracked branch, potentially flaky-test label Jun 12, 2021
@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

@botelastic botelastic bot added the needs-team Issues missing a team label label Jun 12, 2021
@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

1 similar comment
@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

1 similar comment
@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

tylersmalley added a commit that referenced this issue Jun 12, 2021
@tylersmalley
skip flaky suite (#102012)
7b476b7
tylersmalley added a commit that referenced this issue Jun 12, 2021
@tylersmalley
skip flaky suite (#102012)
344b631
@tylersmalley
Copy link
Contributor

Skipped

master: 344b631
7.x: 7b476b7

@elasticmachine
Copy link
Contributor

Pinging @elastic/ml-ui (:ml)

@botelastic botelastic bot removed the needs-team Issues missing a team label label Jun 12, 2021
@tylersmalley
Copy link
Contributor

These tests seem to have suddenly begun failing pretty consistently.

@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

1 similar comment
@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

tylersmalley added a commit that referenced this issue Jun 13, 2021
@tylersmalley
skip flaky suite (#102012)
3ce4f22
@tylersmalley
Copy link
Contributor

Also skipped the suite on the 7.13 branch (3ce4f22). It's important we understand if this issue is related to the test or the actual code.

@pheyos pheyos self-assigned this Jun 14, 2021
@pheyos pheyos mentioned this issue Jun 14, 2021
Merged
gmmorris added a commit to gmmorris/kibana that referenced this issue Jun 14, 2021
@gmmorris
Merge branch 'master' into task-manager/capacity-estimation
4b96500 
* master: (68 commits)
  skip flaky suite (elastic#94043)
  skip flaky suite (elastic#102012)
  [esArchive] Persists updates for management/saved_objects/* (elastic#101992)
  skip flaky suite (elastic#101449)
  remove unnecessary hack (elastic#101909)
  [Exploratory View] Use human readable formats (elastic#101520)
  [Expressions] Refactor expression functions to use observables underneath (elastic#100409)
  [esArchives] Persist migrated Kibana archives (elastic#101950)
  [kbnArchiver] fix save to non-existent file (elastic#101974)
  [Enterprise Search] Add owner and description properties to kibana.json (elastic#101957)
  [DOCS] Fixes terminology in Stack Monitoring:Kibana alerts (elastic#101696)
  [Observability] [Cases] Cases in the observability app (elastic#101487)
  [Alerting][Docs] Combine rule creation and management pages (elastic#101498)
  temporarily disable build-buddy
  [Fleet] Fix fleet server collector in case settings are not set (elastic#101752)
  [Event Log] Populated rule.* ECS fields for alert events. (elastic#101132)
  [APM] Fleet support for merging input.config values with other nested properties in the policy input (elastic#101690)
  Add comments to some alerting plugin public API items (elastic#101551)
  [Alerting][Docs] Moving alerting setup to its own page (elastic#101323)
  remove uptime public API, it's not used. (elastic#101799)
  ...
tylersmalley added a commit that referenced this issue Jun 15, 2021
@tylersmalley
skip flaky suite (#102012)
874d51c
tylersmalley added a commit that referenced this issue Jun 15, 2021
@tylersmalley
skip flaky suite (#102012)
035f617
@kibanamachine kibanamachine reopened this Jun 16, 2024
@kibanamachine
Copy link
Contributor Author

New failure: kibana-7-dot-17-es-8-dot-13-forward-compatibility - 7.17

@kibanamachine
Copy link
Contributor Author

New failure: kibana-7-dot-17-es-8-dot-15-forward-compatibility - 7.17

@kibanamachine
Copy link
Contributor Author

New failure: kibana-7-dot-17-es-8-dot-14-forward-compatibility - 7.17

@kibanamachine
Copy link
Contributor Author

New failure: kibana-7-dot-17-es-8-dot-13-forward-compatibility - 7.17

@kibanamachine
Copy link
Contributor Author

New failure: kibana-7-dot-17-es-8-dot-15-forward-compatibility - 7.17

@kibanamachine
Copy link
Contributor Author

New failure: kibana-elasticsearch-snapshot-verify - 7.17

@kibanamachine
Copy link
Contributor Author

New failure: kibana-elasticsearch-snapshot-verify - 7.17

@delanni
Copy link
Contributor

delanni commented Jun 17, 2024

/skip

kibanamachine added a commit that referenced this issue Jun 17, 2024
@kibanamachine
skip failing test suite (#102012)
f44506c
@kibanamachine
Copy link
Contributor Author

Skipped

7.17: f44506c

@darnautov darnautov mentioned this issue Jun 21, 2024
Merged
1 task
darnautov added a commit that referenced this issue Jun 24, 2024
@darnautov
[ML] Update esarchive ecommerce dataset, enable alerting flyout tests (…
745abf7 
…#186630)

## Summary

Closes #186261 and #102012

- Updates timestamps in the esarchive ecommerce data set (from 2019 to
2023)
- Enables anomaly detection alert flyout tests 



### Checklist

- [x] [Unit or functional
tests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)
were updated or added to match the most common scenarios
darnautov added a commit to darnautov/kibana that referenced this issue Jun 26, 2024
@darnautov
[ML] Update esarchive ecommerce dataset, enable alerting flyout tests (…
0602ba2 
…elastic#186630)

## Summary

Closes elastic#186261 and elastic#102012

- Updates timestamps in the esarchive ecommerce data set (from 2019 to
2023)
- Enables anomaly detection alert flyout tests

### Checklist

- [x] [Unit or functional
tests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)
were updated or added to match the most common scenarios

(cherry picked from commit 745abf7)

# Conflicts:
#	x-pack/test/api_integration/apis/aiops/test_data.ts
#	x-pack/test/api_integration/apis/ml/fields_service/time_field_range.ts
#	x-pack/test/api_integration/apis/ml/job_validation/validate.ts
#	x-pack/test/functional/apps/ml/anomaly_detection/multi_metric_job.ts
#	x-pack/test/functional/apps/ml/anomaly_detection_jobs/convert_jobs_to_advanced_job.ts
#	x-pack/test/functional/apps/transform/creation/index_pattern/continuous_transform.ts
#	x-pack/test/functional/apps/transform/creation_index_pattern.ts
#	x-pack/test/functional_with_es_ssl/apps/ml/alert_flyout.ts
darnautov added a commit to darnautov/kibana that referenced this issue Jun 26, 2024
@darnautov
[ML] Update esarchive ecommerce dataset, enable alerting flyout tests (…
361c200 
…elastic#186630)

## Summary

Closes elastic#186261 and elastic#102012

- Updates timestamps in the esarchive ecommerce data set (from 2019 to
2023)
- Enables anomaly detection alert flyout tests

### Checklist

- [x] [Unit or functional
tests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)
were updated or added to match the most common scenarios

(cherry picked from commit 745abf7)

# Conflicts:
#	x-pack/test/api_integration/apis/aiops/test_data.ts
#	x-pack/test/api_integration/apis/ml/fields_service/time_field_range.ts
#	x-pack/test/api_integration/apis/ml/job_validation/validate.ts
#	x-pack/test/functional/apps/ml/anomaly_detection/multi_metric_job.ts
#	x-pack/test/functional/apps/ml/anomaly_detection_jobs/convert_jobs_to_advanced_job.ts
#	x-pack/test/functional/apps/transform/creation/index_pattern/continuous_transform.ts
#	x-pack/test/functional/apps/transform/creation_index_pattern.ts
#	x-pack/test/functional_with_es_ssl/apps/ml/alert_flyout.ts
@darnautov darnautov mentioned this issue Jul 3, 2024
Merged
darnautov added a commit that referenced this issue Jul 3, 2024
@darnautov
[7.17] [ML] Update esarchive ecommerce dataset, enable alerting flyou…
626d296 
…t tests (#186630) (#186943)

# Backport

Closes #102012

This will backport the following commits from `main` to `7.17`:
- [[ML] Update esarchive ecommerce dataset, enable alerting flyout tests
(#186630)](#186630)

<!--- Backport version: 8.9.8 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sqren/backport)

<!--BACKPORT [{"author":{"name":"Dima
Arnautov","email":"dmitrii.arnautov@elastic.co"},"sourceCommit":{"committedDate":"2024-06-24T13:55:29Z","message":"[ML]
Update esarchive ecommerce dataset, enable alerting flyout tests
(#186630)\n\n## Summary\r\n\r\nCloses #186261 and #102012\r\n\r\n-
Updates timestamps in the esarchive ecommerce data set (from 2019
to\r\n2023)\r\n- Enables anomaly detection alert flyout tests
\r\n\r\n\r\n\r\n### Checklist\r\n\r\n- [x] [Unit or
functional\r\ntests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)\r\nwere
updated or added to match the most common
scenarios","sha":"745abf7624c98105ef273d8d1d57730a33728c32","branchLabelMapping":{"^v8.15.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":[":ml","test_ui_functional","release_note:skip","backport:skip","Team:ML","v8.15.0"],"number":186630,"url":"https://github.com/elastic/kibana/pull/186630","mergeCommit":{"message":"[ML]
Update esarchive ecommerce dataset, enable alerting flyout tests
(#186630)\n\n## Summary\r\n\r\nCloses #186261 and #102012\r\n\r\n-
Updates timestamps in the esarchive ecommerce data set (from 2019
to\r\n2023)\r\n- Enables anomaly detection alert flyout tests
\r\n\r\n\r\n\r\n### Checklist\r\n\r\n- [x] [Unit or
functional\r\ntests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)\r\nwere
updated or added to match the most common
scenarios","sha":"745abf7624c98105ef273d8d1d57730a33728c32"}},"sourceBranch":"main","suggestedTargetBranches":[],"targetPullRequestStates":[{"branch":"main","label":"v8.15.0","labelRegex":"^v8.15.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/186630","number":186630,"mergeCommit":{"message":"[ML]
Update esarchive ecommerce dataset, enable alerting flyout tests
(#186630)\n\n## Summary\r\n\r\nCloses #186261 and #102012\r\n\r\n-
Updates timestamps in the esarchive ecommerce data set (from 2019
to\r\n2023)\r\n- Enables anomaly detection alert flyout tests
\r\n\r\n\r\n\r\n### Checklist\r\n\r\n- [x] [Unit or
functional\r\ntests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)\r\nwere
updated or added to match the most common
scenarios","sha":"745abf7624c98105ef273d8d1d57730a33728c32"}}]}]
BACKPORT-->
@darnautov
Copy link
Contributor

Closed by #186943

adelisle pushed a commit to Makila-AI/kibana that referenced this issue Aug 5, 2024
@kibanamachine @adelisle
skip failing test suite (elastic#102012)
41910fd
adelisle pushed a commit to Makila-AI/kibana that referenced this issue Aug 5, 2024
@darnautov @adelisle
[7.17] [ML] Update esarchive ecommerce dataset, enable alerting flyou…
a2247f3 
…t tests (elastic#186630) (elastic#186943)

# Backport

Closes elastic#102012

This will backport the following commits from `main` to `7.17`:
- [[ML] Update esarchive ecommerce dataset, enable alerting flyout tests
(elastic#186630)](elastic#186630)

<!--- Backport version: 8.9.8 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sqren/backport)

<!--BACKPORT [{"author":{"name":"Dima
Arnautov","email":"dmitrii.arnautov@elastic.co"},"sourceCommit":{"committedDate":"2024-06-24T13:55:29Z","message":"[ML]
Update esarchive ecommerce dataset, enable alerting flyout tests
(elastic#186630)\n\n## Summary\r\n\r\nCloses elastic#186261 and elastic#102012\r\n\r\n-
Updates timestamps in the esarchive ecommerce data set (from 2019
to\r\n2023)\r\n- Enables anomaly detection alert flyout tests
\r\n\r\n\r\n\r\n### Checklist\r\n\r\n- [x] [Unit or
functional\r\ntests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)\r\nwere
updated or added to match the most common
scenarios","sha":"745abf7624c98105ef273d8d1d57730a33728c32","branchLabelMapping":{"^v8.15.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":[":ml","test_ui_functional","release_note:skip","backport:skip","Team:ML","v8.15.0"],"number":186630,"url":"https://github.com/elastic/kibana/pull/186630","mergeCommit":{"message":"[ML]
Update esarchive ecommerce dataset, enable alerting flyout tests
(elastic#186630)\n\n## Summary\r\n\r\nCloses elastic#186261 and elastic#102012\r\n\r\n-
Updates timestamps in the esarchive ecommerce data set (from 2019
to\r\n2023)\r\n- Enables anomaly detection alert flyout tests
\r\n\r\n\r\n\r\n### Checklist\r\n\r\n- [x] [Unit or
functional\r\ntests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)\r\nwere
updated or added to match the most common
scenarios","sha":"745abf7624c98105ef273d8d1d57730a33728c32"}},"sourceBranch":"main","suggestedTargetBranches":[],"targetPullRequestStates":[{"branch":"main","label":"v8.15.0","labelRegex":"^v8.15.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/186630","number":186630,"mergeCommit":{"message":"[ML]
Update esarchive ecommerce dataset, enable alerting flyout tests
(elastic#186630)\n\n## Summary\r\n\r\nCloses elastic#186261 and elastic#102012\r\n\r\n-
Updates timestamps in the esarchive ecommerce data set (from 2019
to\r\n2023)\r\n- Enables anomaly detection alert flyout tests
\r\n\r\n\r\n\r\n### Checklist\r\n\r\n- [x] [Unit or
functional\r\ntests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)\r\nwere
updated or added to match the most common
scenarios","sha":"745abf7624c98105ef273d8d1d57730a33728c32"}}]}]
BACKPORT-->
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@pheyos pheyos

Labels
failed-test A test failure on a tracked branch, potentially flaky-test :ml
Projects
None yet
Milestone
No milestone
6 participants
@tylersmalley @pheyos @delanni @darnautov @elasticmachine @kibanamachine