Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[O11y][Kafka] Migration for visualizations to lens in kibana 8.8.0 #5594

Merged
merged 7 commits into from
Jul 28, 2023
Merged

[O11y][Kafka] Migration for visualizations to lens in kibana 8.8.0 #5594

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
32ea877
Migrate kafka visualizations to lens in Kibana 8.6.0
harnish-elastic Mar 20, 2023
7388f08
update changelog.yml
harnish-elastic Mar 20, 2023
3d09a13
Merge branch 'main' of https://github.com/harnish-elastic/integration…
harnish-elastic Apr 3, 2023
b6fd0a9
migrate pending visualizations to lens
harnish-elastic Apr 3, 2023
9372945
Merge branch 'main' of https://github.com/harnish-elastic/integration…
harnish-elastic Jul 25, 2023
9b3b3ee
export dashboards to 8.7.0
harnish-elastic Jul 25, 2023
af34876
address review comments
harnish-elastic Jul 27, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 5 additions & 0 deletions packages/kafka/changelog.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,4 +1,9 @@
# newer versions go on top
- version: "1.9.1"
changes:
- description: Migrate visualizations to lens.
type: enhancement
link: https://github.com/elastic/integrations/pull/5594
- version: "1.9.0"
changes:
- description: Revert changes to permissions to reroute events to logs-*-* for log datastream
Expand Down
Binary file modified packages/kafka/img/filebeat-kafka-logs-overview.png
View file
Open in desktop
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In the logs overview dashboard include the below changes

  1. Have the legend for the Logs over time added to the bottom of the visualisation instead of right side
  2. Reduce the space allocated for log.level and more space added for the message

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@agithomas, We have created an enhancement issue for this task and updated the changes in this PR. Thanks!

Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified packages/kafka/img/metricbeat_kafka_dashboard.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
417 changes: 394 additions & 23 deletions packages/kafka/kibana/dashboard/kafka-943caca0-87ee-11e7-ad9c-db80de0bf8d3.json
View file
Open in desktop
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In the overview dashboard please have the below changes made

  1. Single stat representing the brokers must be the first one in the first row
  2. Have consumer partition reassignments and Kafka broker table in the second row
  3. Have kafka topic chart and table in the thrid row
  4. Have consumer group chart and table in the fourth row

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@agithomas, We have created an enhancement issue for this task and updated the changes in this PR. Thanks!

Large diffs are not rendered by default.

2,110 changes: 2,005 additions & 105 deletions packages/kafka/kibana/dashboard/kafka-ea488d90-8e63-11e8-8fa2-3d5f811fbd0f.json
View file
Open in desktop

Large diffs are not rendered by default.

32 changes: 23 additions & 9 deletions packages/kafka/kibana/search/kafka-all-kafka-logs.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,19 @@
"message"
],
"description": "",
"grid": {
"columns": {
"kafka.log.component": {
"width": 195
},
"log.level": {
"width": 109
}
}
},
"hideChart": false,
"hits": 0,
"isTextBasedQuery": false,
"kibanaSavedObjectMeta": {
"searchSourceJSON": {
"filter": [
Expand All @@ -21,18 +33,13 @@
"key": "data_stream.dataset",
"negate": false,
"params": {
"query": "kafka.log",
"type": "phrase"
"query": "kafka.log"
},
"type": "phrase",
"value": "log"
"type": "phrase"
},
"query": {
"match": {
"data_stream.dataset": {
"query": "kafka.log",
"type": "phrase"
}
"match_phrase": {
"data_stream.dataset": "kafka.log"
}
}
}
Expand All @@ -52,10 +59,17 @@
"desc"
]
],
"timeRestore": false,
"title": "All logs [Logs Kafka]",
"usesAdHocDataView": false,
"version": 1
},
"coreMigrationVersion": "8.7.0",
"created_at": "2023-07-26T06:39:08.427Z",
"id": "kafka-all-kafka-logs",
"migrationVersion": {
"search": "8.0.0"
},
"references": [
{
"id": "logs-*",
Expand Down
5 changes: 5 additions & 0 deletions packages/kafka/kibana/search/kafka-stacktraces.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -28,7 +28,12 @@
"title": "Stacktraces [Logs Kafka]",
"version": 1
},
"coreMigrationVersion": "8.7.0",
"created_at": "2023-07-26T06:39:08.427Z",
"id": "kafka-stacktraces",
"migrationVersion": {
"search": "8.0.0"
},
"references": [
{
"id": "logs-*",
Expand Down
103 changes: 0 additions & 103 deletions packages/kafka/kibana/visualization/kafka-1681f1a0-90e7-11e8-8fa2-3d5f811fbd0f.json
View file
Open in desktop

This file was deleted.

131 changes: 0 additions & 131 deletions packages/kafka/kibana/visualization/kafka-27dd5960-d2ed-11e8-8766-dbbdc39e7ba9.json
View file
Open in desktop

This file was deleted.

Loading