Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Fleet] Visualisations have "Field no longer exists in data view" errors when no data has been ingested #118941

Closed
hop-dev opened this issue Nov 17, 2021 · 3 comments
Labels
bug Fixes for quality problems that affect the customer experience Team:Fleet Team label for Observability Data Collection Fleet team

Comments

@hop-dev
Copy link
Contributor

hop-dev commented Nov 17, 2021

Kibana version: 7.11 and above

Describe the bug:

When an integration hasn't ingested any data (or only a subset of data) dashboards show "Field no longer exists in data view"
errors.

This is because since 7.11, data views dynamically generate their fields at runtime. Fleet manually builds the list of fields on the index-pattern saved object, however these are not referenced by kibana when checking fields for the visualisation.

Screenshot 2021-11-17 at 14 52 36

Steps to reproduce:
On a fresh kibana install:

  1. Setup fleet, including adding an agent with system monitoring
  2. Add an integration which will not collect any data to the agent's policy (e.g apache in this example)
  3. View the [Logs Apache] Access and error logs dashboard
  4. notice the errors as seen in the screenshot above.
  5. (optional) Notice we do have the field defined in the given index patter nby performing the following dev tools request:
GET /.kibana/_search
{
  "query": {
    "term": {
      "type": {
        "value": "index-pattern"
      }
    }
  }
}

Expected behavior:
Something telling the user that there is no data, rather than missing field error.

@hop-dev hop-dev added the bug Fixes for quality problems that affect the customer experience label Nov 17, 2021
@botelastic botelastic bot added the needs-team Issues missing a team label label Nov 17, 2021
@hop-dev hop-dev added the Team:Fleet Team label for Observability Data Collection Fleet team label Nov 17, 2021
@elasticmachine
Copy link
Contributor

Pinging @elastic/fleet (Team:Fleet)

@jen-huang
Copy link
Contributor

Thanks for filing this Mark. It is related to the issue I filed here: #99243

I suspect the difference in error messages between this issue and that one is due to each type of visualization handling errors in their own way, some present as more severe looking, and others less severe. I'm not sure what the best path forward is for that.

@jen-huang
Copy link
Contributor

This no longer appears to be an issue in 8.7 after various dashboard changes, this is after running the previous testing steps for Apache:
image

In some cases dashboards may still have field errors, but they are presented differently:
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Fixes for quality problems that affect the customer experience Team:Fleet Team label for Observability Data Collection Fleet team
Projects
None yet
Development

No branches or pull requests

3 participants