[CI] fix 'no matches found within 10000' #21466
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
v1v
added
automation
ci
Team:Automation
botelastic
bot
added
needs_team
💔 Tests Failed
Expand to view the summary
Build stats
Test stats 🧪
Test errorsExpand to view the tests failures
Steps errorsExpand to view the steps failures
Log outputExpand to view the last 100 lines of log output
|
…-matches-found * upstream/master: (21 commits) Skip filestream flaky tests (elastic#21490) Ignore unsupported metrics in the azure module (elastic#21486) Do not run symlink tests on Windows (elastic#21472) Map `cloud.account.id` to azure sub id (elastic#21483) Add support for app_state metricset (elastic#20639) Include original error when metricbeat fails to connect with Kafka (elastic#21484) Prompt only when agent is already enrolled (elastic#21473) Fix leftover delpoyment example (elastic#21474) Bump version to ECS 1.6 in modules without ECS updates (elastic#21455) Clarify input type configuration options (elastic#19284) Increase index pattern size check to 10MiB (elastic#21487) Migrate S3 Input to Filebeat Input V2 (elastic#20005) [libbeat] Add configurable exponential backoff for disk queue write errors (elastic#21493) Revert "Revert "[JJBB] Set shallow cloning to 10 (elastic#21409)" (elastic#21447)" (elastic#21467) Fix format of debug messages in tlscommon (elastic#21482) [CI] Change x-pack/auditbeat build events (comments, labels) (elastic#21463) [CI] changeset from elastic#20603 was not added to CI2.0 (elastic#21464) Add new log file reader for filestream input (elastic#21450) [CI] Send slack message with build status (elastic#21428) Remove duplicated sources url in dependencies report (elastic#21462) ...
v1v
commented
Oct 5, 2020
Comment on lines
+348
to
+352
| if (isUnix()) { | ||
| cmd(label: 'Delete folders that are causing exceptions (See JENKINS-58421)', | ||
| returnStatus: true, | ||
| script: 'rm -rf ve || true; find . -type d -name vendor -exec rm -r {} \\;') | ||
| } else { log(level: 'INFO', text: 'Delete folders that are causing exceptions (See JENKINS-58421) is disabled for Windows.') } |
There was a problem hiding this comment.
Clean the build artifacts when the folder is too big!
v1v
commented
Oct 5, 2020
| if (isUnix()) { | ||
| cmd(label: 'Delete folders that are causing exceptions (See JENKINS-58421)', | ||
| returnStatus: true, | ||
| script: 'rm -rf ve || true; find . -type d -name vendor -exec rm -r {} \\;') |
There was a problem hiding this comment.
I've no clue where the ve folder is defined, but it's there for the libbeat
[2020-10-05T11:59:25.997Z] + echo libbeat-build
[2020-10-05T11:59:25.998Z] libbeat-build
[2020-10-05T11:59:25.998Z] + ls -ltrah
[2020-10-05T11:59:25.998Z] total 20K
[2020-10-05T11:59:25.998Z] drwxr-xr-x 258 jenkins jenkins 4.0K Oct 5 11:51 docker-gocache
[2020-10-05T11:59:25.998Z] drwxr-xr-x 3 jenkins jenkins 4.0K Oct 5 11:56 ve
[2020-10-05T11:59:25.998Z] drwxr-xr-x 3 jenkins jenkins 4.0K Oct 5 11:59 libbeat
[2020-10-05T11:59:25.998Z] drwxr-xr-x 5 jenkins jenkins 4.0K Oct 5 11:59 .
[2020-10-05T11:59:25.998Z] drwxr-xr-x 26 jenkins jenkins 4.0K Oct 5 11:59 ..
[2020-10-05T11:59:25.998Z] + find . -name build -ls
[2020-10-05T11:59:25.998Z] 5167709 4 drwxr-xr-x 3 jenkins jenkins 4096 Oct 5 11:59 ./libbeat/build
[2020-10-05T11:59:25.998Z] 5430897 4 drwxr-xr-x 3 jenkins jenkins 4096 Oct 5 11:57 ./ve/docker/lib/python3.7/site-packages/pip/_internal/operations/build
``
There was a problem hiding this comment.
IIRC it's created for the integration tests and is created by a Makefile target. It's a Python virtual environment. Should be safe to delete.
v1v
commented
Oct 5, 2020
| junitAndStore(allowEmptyResults: true, keepLongStdio: true, testResults: args.testResults, stashedTestReports: stashedTestReports, id: args.id) | ||
| archiveArtifacts(allowEmptyArchive: true, artifacts: args.artifacts) | ||
| tar(file: "test-build-artifacts-${args.id}.tgz", dir: '.', archive: true, allowMissing: true) |
There was a problem hiding this comment.
This might help us to avoid the interruption error even when the cleanup defined above happened:
[2020-10-05T12:09:17.924Z] drwxr-xr-x 26 jenkins jenkins 4.0K Oct 5 12:09 ..
[2020-10-05T12:09:17.924Z] + find . -name build -ls
[2020-10-05T12:09:17.924Z] 5170689 4 drwxr-xr-x 4 jenkins jenkins 4096 Oct 5 12:09 ./metricbeat/build
[2020-10-05T12:09:17.924Z] 5168179 4 drwxr-xr-x 3 jenkins jenkins 4096 Oct 5 11:39 ./ve/docker/lib/python3.7/site-packages/pip/_internal/operations/build
[2020-10-05T12:09:17.934Z] [Pipeline] isUnix
[2020-10-05T12:09:17.937Z] [Pipeline] sh
[2020-10-05T12:09:18.224Z] + rm -rf ve
[2020-10-05T12:09:18.224Z] + find . -type d -name vendor -exec rm -r {} ;
[2020-10-05T12:09:18.239Z] [Pipeline] junit
[2020-10-05T12:09:18.239Z] WARNING: Unknown parameter(s) found for class type 'hudson.tasks.junit.pipeline.JUnitResultsStep': id,stashedTestReports
[2020-10-05T12:09:18.242Z] Recording test results
[2020-10-05T12:09:19.975Z] [Pipeline] stash
[2020-10-05T12:09:20.208Z] Stashed 1 file(s)
[2020-10-05T12:09:20.213Z] [Pipeline] archiveArtifacts
[2020-10-05T12:09:20.219Z] Archiving artifacts
[2020-10-05T12:09:20.450Z] java.lang.InterruptedException: no matches found within 10000
[2020-10-05T12:09:20.450Z] at hudson.FilePath$ValidateAntFileMask.hasMatch(FilePath.java:2865)
[2020-10-05T12:09:20.450Z] at hudson.FilePath$ValidateAntFileMask.invoke(FilePath.java:2744)
[2020-10-05T12:09:20.450Z] at hudson.FilePath$ValidateAntFileMask.invoke(FilePath.java:2725)
[2020-10-05T12:09:20.450Z] at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3112)
[2020-10-05T12:09:20.450Z] Also: hudson.remoting.Channel$CallSiteStackTrace: Remote call to JNLP4-connect connection from beats-ci-immutable-ubuntu-1804-1601897573326600637.c.elastic-ci-prod.internal/10.224.1.213:57106
cachedout
approved these changes
Oct 5, 2020
| if (isUnix()) { | ||
| cmd(label: 'Delete folders that are causing exceptions (See JENKINS-58421)', | ||
| returnStatus: true, | ||
| script: 'rm -rf ve || true; find . -type d -name vendor -exec rm -r {} \\;') |
There was a problem hiding this comment.
IIRC it's created for the integration tests and is created by a Makefile target. It's a Python virtual environment. Should be safe to delete.
kuisathaverat
approved these changes
Oct 5, 2020
v1v
added a commit
to v1v/beats
that referenced
this pull request
Oct 5, 2020
v1v
added a commit
to v1v/beats
that referenced
this pull request
Oct 5, 2020
v1v
added a commit
that referenced
this pull request
Oct 6, 2020
v1v
added a commit
that referenced
this pull request
Oct 6, 2020
v1v
added a commit
to v1v/beats
that referenced
this pull request
Oct 6, 2020
* upstream/master: [CI] Setup git config globally (elastic#21562) docs: update generate_fields_docs.py (elastic#21359) Add support for additional fields from V2 ALB logs (elastic#21540) Move Prometheus query & remote_write to GA (elastic#21507) feat: add a new step to run the e2e tests for certain parts of Beats (elastic#21100) [Elastic Agent] Add elastic agent ID and version to events from filebeat and metricbeat. (elastic#21543) Release cloudfoundry input and processor as GA (elastic#21525) [Packetbeat] New SIP protocol (elastic#21221) [Filebeat][New Module] Add support for Microsoft MTP / 365 Defender (elastic#21446) [Beats][pytest] Asserting if filebeat logs include errors (elastic#20999) junipersrx-module initial release (elastic#20017) Add a persistent cache for cloudfoundry metadata based on badger (elastic#20775) Add missing changelog entry for cisco umbrella (elastic#21550) [Elastic Agent] Add upgrade CLI to initiate upgrade of Agent locally (elastic#21425) Enable filestream input (elastic#21533) Add filestream input reader (elastic#21481) [CI] fix 'no matches found within 10000' (elastic#21466) Fix billing.go aws.GetStartTimeEndTime (elastic#21531)
v1v
added a commit
to v1v/beats
that referenced
this pull request
Oct 19, 2020
v1v
added a commit
that referenced
this pull request
Oct 30, 2020
* cherry-pick aad07ad * Add stages to Jenkins pipeline (#14484) * ci: avoid to modify go.mod file (#16842) * Ensure install scripts only install if needed (#20349) * ci: fix warnings with wildcards and archive system-tests (#18695) * ci: run test on Windows (#15570) * [CI] fail if not possible to install python3 (#19164) * [CI] lint stage doesn't produce test reports (#21888) * [CI] Add stage name in the step (#21887) * [CI] kind setup fails sometimes (#21857) * [CI] refactor runbld post build action (#21256) * [CI] Archive build reasons (#21347) * [CI] Fix runbld when workspace does not exist (#21350) * [CI] Send slack message with build status (#21428) * [CI] Setup git config globally (#21562) * [CI] fix 'no matches found within 10000' (#21466) * [CI] Change notification channel (#21559) * [CI] Support skip-ci label (#21377) * [BUILD][CI] fetch dependencies with retry (#21614) * Disable x-pack/metricbeat in linux since build is broken #21962 * Disable tests for windows in auditbeat. See #21958 * Disable integration testing for libbeat. See #21959 * Disable integration testing for metricbeat. See #21961 * Disable windows build for auditbeat. See #21958 * Disable build for libbeat. See #21959 * Disable build for metricbeat. See #21961 * Disable windows build for metricbeat. See #22257 * Disable build for x-pack/metricbeat. See #21962 * Disable windows build for x-pack/winlogbeat. See #22263 * Disable windows build for x-pack/filebeat. See #21963 * integration-tests-environment is not available for winlogbeat. see #22265 * integration-tests-environment is not available for packetbeat. see #22266 * Build not available for x-pack/metricbeats in 6.8. See #22269 * Cherry-pick 96c60d0
leweafan
pushed a commit
to leweafan/beats
that referenced
this pull request
Apr 28, 2023
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What does this PR do?
Tar the
buildfolder rather than archiving the giving list of files.Delete cached folder that are causing the stacktrace reported in JENKINS-58421
Why is it important?
Avoid corruption in the builds.
Issues
#18695 was the initial approach to reduce those stacktrace errors, but there were 3 cases that were not fixed though!
Tests