Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

libbeat: monitor version #26214

Merged
merged 7 commits into from
Jun 9, 2021
Merged

libbeat: monitor version #26214

merged 7 commits into from
Jun 9, 2021

Conversation

graphaelli
Copy link
Member

@graphaelli graphaelli commented Jun 8, 2021

What does this PR do?

Expand monitoring to report beat.info.version.

Why is it important?

When monitoring multiple beats version would be a useful dimension to break down metrics.

Checklist

  • My code follows the style guidelines of this project
  • [ ] I have made corresponding changes to the documentation
  • [ ] I have made corresponding change to the default configuration files
  • I have added tests that prove my fix is effective or that my feature works
  • I have added an entry in CHANGELOG.next.asciidoc or CHANGELOG-developer.next.asciidoc.

How to test this PR locally

Start a beat and note that verison information is reported:

INFO	[monitoring]	log/log.go:153	Total non-zero metrics	{"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":40,"time":{"ms":40}},"total":{"ticks":131,"time":{"ms":131},"value":131},"user":{"ticks":91,"time":{"ms":91}}},"info":{"ephemeral_id":"d0703db5-bc9d-45d8-a67b-993e1626339a","uptime":{"ms":5961},"version":"8.0.0"},"memstats":{"gc_next":16014480,"memory_alloc":13199072,"memory_sys":77153288,"memory_total":32009184,"rss":57188352},"runtime":{"goroutines":20}},"libbeat":{"config":{"module":{"running":0},"reloads":1,"scans":1},"output":{"events":{"active":0},"type":"elasticsearch"},"pipeline":{"clients":0,"events":{"active":0},"queue":{"max_events":4096}}},"system":{"cpu":{"cores":16},"load":{"1":11.8486,"15":5.3057,"5":8.9258,"norm":{"1":0.7405,"15":0.3316,"5":0.5579}}}}}}

Expand monitoring to report beat.info.version
@botelastic botelastic bot added needs_team Indicates that the issue/PR needs a Team:* label and removed needs_team Indicates that the issue/PR needs a Team:* label labels Jun 8, 2021
@graphaelli graphaelli marked this pull request as ready for review June 8, 2021 17:17
@elasticmachine
Copy link
Collaborator

Pinging @elastic/agent (Team:Agent)

@elasticmachine
Copy link
Collaborator

elasticmachine commented Jun 8, 2021

💔 Build Failed

the below badges are clickable and redirect to their specific view in the CI or DOCS
Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: graphaelli commented: /test

  • Start Time: 2021-06-09T02:53:59.916+0000

  • Duration: 39 min 17 sec

  • Commit: 96fea9a

Trends 🧪

Image of Build Times

Steps errors 2

Expand to view the steps failures

x-pack/elastic-agent-packaging-arm-arm - mage package
  • Took 22 min 51 sec . View more details on here
  • Description: mage package
Error signal
  • Took 0 min 0 sec . View more details on here
  • Description: Error 'hudson.AbortException: script returned exit code 1'

Log output

Expand to view the last 100 lines of log output

[2021-06-09T03:31:42.195Z]  Experimental:      true
[2021-06-09T03:31:42.195Z] 
[2021-06-09T03:31:42.195Z] Server: Docker Engine - Community
[2021-06-09T03:31:42.195Z]  Engine:
[2021-06-09T03:31:42.195Z]   Version:          20.10.3
[2021-06-09T03:31:42.195Z]   API version:      1.41 (minimum version 1.12)
[2021-06-09T03:31:42.195Z]   Go version:       go1.13.15
[2021-06-09T03:31:42.195Z]   Git commit:       46229ca
[2021-06-09T03:31:42.195Z]   Built:            Fri Jan 29 14:31:49 2021
[2021-06-09T03:31:42.195Z]   OS/Arch:          linux/arm64
[2021-06-09T03:31:42.195Z]   Experimental:     false
[2021-06-09T03:31:42.195Z]  containerd:
[2021-06-09T03:31:42.195Z]   Version:          1.4.3
[2021-06-09T03:31:42.195Z]   GitCommit:        269548fa27e0089a8b8278fc4fc781d7f65a939b
[2021-06-09T03:31:42.195Z]  runc:
[2021-06-09T03:31:42.195Z]   Version:          1.0.0-rc92
[2021-06-09T03:31:42.195Z]   GitCommit:        ff819c7e9184c13b7c2607fe6c30ae19403a7aff
[2021-06-09T03:31:42.195Z]  docker-init:
[2021-06-09T03:31:42.195Z]   Version:          0.19.0
[2021-06-09T03:31:42.195Z]   GitCommit:        de40ad0
[2021-06-09T03:31:42.195Z] Change ownership of all files inside the specific folder from root/root to current user/group
[2021-06-09T03:31:42.195Z] Unable to find image 'arm64v8/alpine:3' locally
[2021-06-09T03:31:43.262Z] 3: Pulling from arm64v8/alpine
[2021-06-09T03:31:43.262Z] 595b0fe564bb: Pulling fs layer
[2021-06-09T03:31:43.771Z] 595b0fe564bb: Verifying Checksum
[2021-06-09T03:31:43.771Z] 595b0fe564bb: Download complete
[2021-06-09T03:31:43.771Z] 595b0fe564bb: Pull complete
[2021-06-09T03:31:43.771Z] Digest: sha256:8f18fae117ec6e5777cc62ba78cbb3be10a8a38639ccfb949521abd95c8301a4
[2021-06-09T03:31:43.771Z] Status: Downloaded newer image for arm64v8/alpine:3
[2021-06-09T03:31:56.754Z] Change permissions with write access of all files inside the specific folder
[2021-06-09T03:31:56.960Z] Running in /var/lib/jenkins/workspace/PR-26214-8-5560b5fc-1d7e-4950-94bb-f8d76f61647d/src/github.com/elastic/beats/build
[2021-06-09T03:31:58.012Z] + rm -rf ve
[2021-06-09T03:31:58.012Z] + find . -type d -name vendor -exec rm -r {} ;
[2021-06-09T03:31:59.086Z] + python .ci/scripts/pre_archive_test.py
[2021-06-09T03:32:04.378Z] Copy ./x-pack/heartbeat/build into build/x-pack/heartbeat/build
[2021-06-09T03:32:04.379Z] Copy ./x-pack/heartbeat/build/golang-crossbuild into build/x-pack/heartbeat/build/golang-crossbuild
[2021-06-09T03:32:04.379Z] Copy ./x-pack/elastic-agent/build into build/x-pack/elastic-agent/build
[2021-06-09T03:32:04.379Z] Copy ./x-pack/elastic-agent/build/golang-crossbuild into build/x-pack/elastic-agent/build/golang-crossbuild
[2021-06-09T03:32:04.379Z] Copy ./x-pack/metricbeat/build into build/x-pack/metricbeat/build
[2021-06-09T03:32:04.379Z] Copy ./x-pack/metricbeat/build/golang-crossbuild into build/x-pack/metricbeat/build/golang-crossbuild
[2021-06-09T03:32:04.379Z] Copy ./x-pack/filebeat/build into build/x-pack/filebeat/build
[2021-06-09T03:32:04.379Z] Copy ./x-pack/filebeat/build/golang-crossbuild into build/x-pack/filebeat/build/golang-crossbuild
[2021-06-09T03:32:04.581Z] Running in /var/lib/jenkins/workspace/PR-26214-8-5560b5fc-1d7e-4950-94bb-f8d76f61647d/src/github.com/elastic/beats/build
[2021-06-09T03:32:04.658Z] Recording test results
[2021-06-09T03:32:08.504Z] None of the test reports contained any result
[2021-06-09T03:32:08.505Z] [Checks API] No suitable checks publisher found.
[2021-06-09T03:32:09.381Z] + tar --version
[2021-06-09T03:32:10.504Z] + tar --exclude=test-build-artifacts-x-pack-elastic-agent-packaging-arm-arm-tgz -czf test-build-artifacts-x-pack-elastic-agent-packaging-arm-arm-tgz .
[2021-06-09T03:32:42.602Z] + gsutil --version
[2021-06-09T03:32:54.081Z] Masking supported pattern matches of $FILE_CREDENTIAL
[2021-06-09T03:32:55.435Z] + gcloud auth activate-service-account --key-file ****
[2021-06-09T03:32:57.121Z] Activated service account credentials for: [beats-ci-gcs-plugin@elastic-ci-prod.iam.gserviceaccount.com]
[2021-06-09T03:32:58.252Z] + gsutil -m -q cp -a public-read test-build-artifacts-x-pack-elastic-agent-packaging-arm-arm-tgz gs://beats-ci-temp/Beats/beats/PR-26214-8
[2021-06-09T03:33:04.692Z] + python .ci/scripts/search_system_tests.py
[2021-06-09T03:33:04.968Z] [INFO] system-tests=''. If no empty then let's create a tarball
[2021-06-09T03:33:05.869Z] + go clean -modcache
[2021-06-09T03:33:10.288Z] Cleaning up /var/lib/jenkins/workspace/PR-26214-8-5560b5fc-1d7e-4950-94bb-f8d76f61647d
[2021-06-09T03:33:10.289Z] Client: Docker Engine - Community
[2021-06-09T03:33:10.289Z]  Version:           20.10.3
[2021-06-09T03:33:10.289Z]  API version:       1.41
[2021-06-09T03:33:10.289Z]  Go version:        go1.13.15
[2021-06-09T03:33:10.289Z]  Git commit:        48d30b5
[2021-06-09T03:33:10.289Z]  Built:             Fri Jan 29 14:33:34 2021
[2021-06-09T03:33:10.289Z]  OS/Arch:           linux/arm64
[2021-06-09T03:33:10.289Z]  Context:           default
[2021-06-09T03:33:10.289Z]  Experimental:      true
[2021-06-09T03:33:10.289Z] 
[2021-06-09T03:33:10.289Z] Server: Docker Engine - Community
[2021-06-09T03:33:10.289Z]  Engine:
[2021-06-09T03:33:10.289Z]   Version:          20.10.3
[2021-06-09T03:33:10.289Z]   API version:      1.41 (minimum version 1.12)
[2021-06-09T03:33:10.289Z]   Go version:       go1.13.15
[2021-06-09T03:33:10.289Z]   Git commit:       46229ca
[2021-06-09T03:33:10.289Z]   Built:            Fri Jan 29 14:31:49 2021
[2021-06-09T03:33:10.289Z]   OS/Arch:          linux/arm64
[2021-06-09T03:33:10.289Z]   Experimental:     false
[2021-06-09T03:33:10.289Z]  containerd:
[2021-06-09T03:33:10.289Z]   Version:          1.4.3
[2021-06-09T03:33:10.289Z]   GitCommit:        269548fa27e0089a8b8278fc4fc781d7f65a939b
[2021-06-09T03:33:10.289Z]  runc:
[2021-06-09T03:33:10.289Z]   Version:          1.0.0-rc92
[2021-06-09T03:33:10.289Z]   GitCommit:        ff819c7e9184c13b7c2607fe6c30ae19403a7aff
[2021-06-09T03:33:10.289Z]  docker-init:
[2021-06-09T03:33:10.289Z]   Version:          0.19.0
[2021-06-09T03:33:10.289Z]   GitCommit:        de40ad0
[2021-06-09T03:33:10.289Z] Change ownership of all files inside the specific folder from root/root to current user/group
[2021-06-09T03:33:11.363Z] Change permissions with write access of all files inside the specific folder
[2021-06-09T03:33:11.576Z] Running in /var/lib/jenkins/workspace/PR-26214-8-5560b5fc-1d7e-4950-94bb-f8d76f61647d
[2021-06-09T03:33:15.753Z] Failed in branch x-pack/elastic-agent-packaging-arm-arm
[2021-06-09T03:33:15.814Z] Stage "Packaging-Pipeline" skipped due to earlier failure(s)
[2021-06-09T03:33:15.860Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-26214/src/github.com/elastic/beats
[2021-06-09T03:33:16.152Z] Running on Jenkins in /var/lib/jenkins/workspace/Beats_beats_PR-26214
[2021-06-09T03:33:16.193Z] [INFO] getVaultSecret: Getting secrets
[2021-06-09T03:33:16.230Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2021-06-09T03:33:16.862Z] + chmod 755 generate-build-data.sh
[2021-06-09T03:33:16.862Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-26214/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-26214/runs/8 FAILURE 2356686
[2021-06-09T03:33:16.862Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-26214/runs/8/steps/?limit=10000 -o steps-info.json
[2021-06-09T03:33:18.206Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-26214/runs/8/tests/?status=FAILED -o tests-errors.json
[2021-06-09T03:33:18.206Z] Retry 1/3 exited 22, retrying in 1 seconds...
[2021-06-09T03:33:19.549Z] Retry 2/3 exited 22, retrying in 2 seconds...

❕ Flaky test report

No test was executed to be analysed.

Copy link
Contributor

@ph ph left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🤦 we didn't do that!

@graphaelli graphaelli added the backport-v7.14.0 Automated backport with mergify label Jun 9, 2021
@graphaelli
Copy link
Member Author

test failure is unrelated to these changes

@graphaelli
Copy link
Member Author

/test

@urso urso merged commit 383f689 into elastic:master Jun 9, 2021
@graphaelli graphaelli deleted the monitor-version branch June 9, 2021 13:05
mergify bot pushed a commit that referenced this pull request Jun 9, 2021
(cherry picked from commit 383f689)
graphaelli pushed a commit that referenced this pull request Jun 9, 2021
mdelapenya added a commit to mdelapenya/beats that referenced this pull request Jun 21, 2021
* master: (26 commits)
  Report total and free CPU for vSphere virtual machines (elastic#26167)
  [filebeat] Add preserve_original_event option to o365audit input (elastic#26273)
  Change xml processor names in script processor to match convention (elastic#26263)
  [Oracle] Fixing default values for paths in config template (elastic#26276)
  Add more ECS fields to logs (elastic#25998)
  [Heartbeat] Fix broken invocation of synth package (elastic#26228)
  rename sqs file name (elastic#26227)
  Populate the agent action result if there is no matching action handlers (elastic#26152)
  Add ISO8601 as supported timestamp type (elastic#25564)
  Move Filebeat azure module to GA (elastic#26168)
  Filebeat azure module pipeline fixes and changes (elastic#26148)
  libbeat: monitor version (elastic#26214)
  Add new parser to filestream input: container (elastic#26115)
  [Metricbeat] Add state_statefulset replicas.ready (elastic#26088)
  Disable test processors system test for windows 10 (elastic#26216)
  Fix startup with failing configuration (elastic#26126)
  Remove 32 bits version of Elastic Agent. (elastic#25708)
  Chane fleetmode detection to ony use management.enabled (elastic#26180)
  Make `filestream` input GA (elastic#26127)
  libbeat/idxmgmt/ilm: fix alias creation (elastic#26146)
  ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport-v7.14.0 Automated backport with mergify enhancement Team:Elastic-Agent Label for the Agent team v7.14.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants