Use new Kibana Saved Objects API in place of Dashboard Import/Export API

[ycombinator]

Taken from elastic/kibana#41439:

The dashboard import/export API has been superseded by the saved objects import/export API

Since this change introduces a new API endpoint and file format (json -> ndjson), dashboards will have to be re-exported using the new API.

Beats code needs to be enhanced to use the new API, depending on the Kibana version the Beat is talking to. Also, dashboards need to be redone to use the new format.

[andresrc]

On hold.

[elasticmachine]

Pinging @elastic/integrations (Team:Integrations)

[exekias]

It would be nice to retake this, after a few discussions I think this is where we are now:

• We want to implement the objects API as an alternative way to import dashboards, deprecating the old method in 8.0. This means the setup command will keep working in 8.0, using the new API.
• In order to do that, we will need to convert existing dashboards, @mtojek has done this already in the beats-import script. My understanding is that we will need to keep both original format and the new one (autogenerated) during 7.x. Then switch to saved objects format only in 8.0.

[exekias]

about dashboards, I guess we could keep developing them as we do now during the 7.x timeframe, adding some scripting to automatically convert those into the new format

[botelastic]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[pgayvallet]

Reopening. See #20672, this is still required, and the deadline is getting close.

[elasticmachine]

Pinging @elastic/agent (Team:Agent)

[joshdover]

I believe this and #20672 are duplicates. I am going to close this issue in favor of the other which has more details.