Failing test: Chrome X-Pack UI Functional Tests.x-pack/test/functional/apps/canvas/custom_elements·ts - Canvas app custom elements deletes custom element when prompted

[kibanamachine]

A test failed on a tracked branch

Error: retry.try timeout: Error: expected [ { _webElement: { driver_: [Object], id_: {} },
    locator: null,
    webDriver: 
     { driver: [Object],
       By: 
        [Function: name(name) {
            return By.css('*[name="' + escapeCss(name) + '"]');
          }],
       until: [Object],
       browserType: 'chrome',
       'consoleLog$': [Object] },
    timeout: 10000,
    fixedHeaderHeight: 50,
    logger: 
     { identWidth: 14,
       writers: [Object],
       'written$': [Object] },
    browserType: 'chrome',
    By: 
     [Function: name(name) {
         return By.css('*[name="' + escapeCss(name) + '"]');
       }],
    driver: 
     { session_: {},
       executor_: [Object],
       fileDetector_: null,
       onQuit_: [Function: onQuit] },
    Keys: 
     { NULL: '',
       CANCEL: '',
       HELP: '',
       BACK_SPACE: '',
       TAB: '',
       CLEAR: '',
       RETURN: '',
       ENTER: '',
       SHIFT: '',
       CONTROL: '',
       ALT: '',
       PAUSE: '',
       ESCAPE: '',
       SPACE: '',
       PAGE_UP: '',
       PAGE_DOWN: '',
       END: '',
       HOME: '',
       ARROW_LEFT: '',
       LEFT: '',
       ARROW_UP: '',
       UP: '',
       ARROW_RIGHT: '',
       RIGHT: '',
       ARROW_DOWN: '',
       DOWN: '',
       INSERT: '',
       DELETE: '',
       SEMICOLON: '',
       EQUALS: '',
       NUMPAD0: '',
       NUMPAD1: '',
       NUMPAD2: '',
       NUMPAD3: '',
       NUMPAD4: '',
       NUMPAD5: '',
       NUMPAD6: '',
       NUMPAD7: '',
       NUMPAD8: '',
       NUMPAD9: '',
       MULTIPLY: '',
       ADD: '',
       SEPARATOR: '',
       SUBTRACT: '',
       DECIMAL: '',
       DIVIDE: '',
       F1: '',
       F2: '',
       F3: '',
       F4: '',
       F5: '',
       F6: '',
       F7: '',
       F8: '',
       F9: '',
       F10: '',
       F11: '',
       F12: '',
       COMMAND: '',
       META: '',
       ZENKAKU_HANKAKU: '',
       chord: [Function] },
    isW3CEnabled: true } ] to have a length of 0 but got 1
    at Assertion.assert (/dev/shm/workspace/kibana/packages/kbn-expect/expect.js:100:11)
    at Assertion.length (/dev/shm/workspace/kibana/packages/kbn-expect/expect.js:374:8)
    at retry.try (test/functional/apps/canvas/custom_elements.ts:157:45)
    at process._tickCallback (internal/process/next_tick.js:68:7)
    at onFailure (/dev/shm/workspace/kibana/test/common/services/retry/retry_for_success.ts:28:9)
    at retryForSuccess (/dev/shm/workspace/kibana/test/common/services/retry/retry_for_success.ts:68:13)

First failure: Jenkins Build

[elasticmachine]

Pinging @elastic/kibana-test-triage (failed-test)

[kibanamachine]

New failure: Jenkins Build

[elasticmachine]

Pinging @elastic/kibana-canvas (Team:Canvas)

[kibanamachine]

New failure: Jenkins Build

[kibanamachine]

New failure: Jenkins Build

[kibanamachine]

New failure: Jenkins Build

[kibanamachine]

New failure: Jenkins Build

[spalger]

We skipped this suite when skipping for #62927

#62927 (comment)

[kibanamachine]

New failure: Jenkins Build

[kibanamachine]

New failure: Jenkins Build

[kibanamachine]

New failure: Jenkins Build

[kibanamachine]

New failure: Jenkins Build

[kibanamachine]

New failure: Jenkins Build

[kibanamachine]

New failure: Jenkins Build

[kibanamachine]

New failure: Jenkins Build

[kibanamachine]

New failure: Jenkins Build

[kibanamachine]

New failure: Jenkins Build

[kibanamachine]

New failure: Jenkins Build

[kibanamachine]

New failure: Jenkins Build

[spalger]

Skip from #62927 was backported to keep this from continually failing 7.7 and 7.6

[spalger]

@cqliu1 mind if I ask what the version labels are for? This failed in 7.8 just now: https://kibana-ci.elastic.co/job/elasticsearch+snapshots+verify/659/testReport/junit/Chrome%20X-Pack%20UI%20Functional%20Tests/x-pack_test_functional_apps_canvas_custom_elements%C2%B7ts/Kibana_Pipeline___kibana_xpack_agent___Canvas_app_custom_elements_deletes_custom_element_when_prompted/

[cqliu1]

I added the labels to keep track which versions a fix for these tests would need to be backported to. I thought this test was fixed in 7.8, but I'll keep investigating the failure and work on a fix for 7.8.

[brianseeders]

Not skipping the test unless it fails more, but it failed on 7.9/7.x as well: https://kibana-ci.elastic.co/job/elasticsearch+snapshots+verify/726/execution/node/320/log/?consoleFull

[kibanamachine]

New failure: Jenkins Build

[kibanamachine]

New failure: Jenkins Build

[crob611]

Closing this issue. Looks like it got reopened by a failure on a branch where it was not backported. It's not skipped on main anymore and we have not seen any failures in over a year.