[Elasticsearch][Enrich] Policy name field is not correct

[constanca-m]

Summary

For the Elasticsearch enrich data stream, there is a field named elasticsearch.enrich.executing_policy.name that displays values such as executing enrich policy [users-policy] creating new enrich index [.enrich-users-policy-1687187221242]:

The name of the field suggests that it should hold the value of the policy name, however that is not happening.

Looking at the metricbeat module this field is populated by the corresponding field in the API payload, which is reported as the policy name. Given the metricbeat logic was not touched could it be the API that returns new values ?

[klacabane]

As of 8.9.0 it seems to be a change in the enrich API where name property has the same value as description property

/_enrich/_stats payload

{
  "executing_policies": [
    {
      "name": "executing enrich policy [users-policy] creating new enrich index [.enrich-users-policy-1687193734080]",
      "task": {
        "node": "siTW-zvKSTaECOi-Mry54g",
        "id": 34729,
        "type": "enrich",
        "action": "policy_execution",
        "status": {
          "phase": "RUNNING",
          "step": "UpdateSettingsRequest"
        },
        "description": "executing enrich policy [users-policy] creating new enrich index [.enrich-users-policy-1687193734080]",
        "start_time_in_millis": 1687193734080,
        "running_time_in_nanos": 1037591400,
        "cancellable": true,
        "cancelled": false,
        "parent_task_id": "siTW-zvKSTaECOi-Mry54g:34727",
        "headers": {
          "trace.id": "b666fefa7f2eee9903d227e06e398677"
        }
      }
    }
  ],
  "coordinator_stats": [
    {
      "node_id": "siTW-zvKSTaECOi-Mry54g",
      "queue_size": 0,
      "remote_requests_current": 0,
      "remote_requests_total": 0,
      "executed_searches_total": 0
    }
  ],
  "cache_stats": [
    {
      "node_id": "siTW-zvKSTaECOi-Mry54g",
      "count": 0,
      "hits": 0,
      "misses": 0,
      "evictions": 0
    }
  ]
}

[klacabane]

Created elastic/elasticsearch#97016