Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Nightly bundle builds do not include full bundle until T-14 days to release. #1140

Closed
mch2 opened this issue Nov 23, 2021 · 2 comments
Closed

Comments

@mch2
Copy link
Member

mch2 commented Nov 23, 2021

This is a suggestion to improve the release template and release cycle.

While performance testing for the 1.2 release we found a performance degradation in the bundle. To try and diagnose the issue we pulled older nightly builds at various times and re-ran perf tests to identify when a degradation may have been introduced. Ideally we would have these performance tests running nightly. However, even when that is completed we will unfortunately be running against different configurations of the bundle because components are added to the manifest only T-14 days before release.

For example - right now for 2.0 and 1.3 releases, we have no components being built nightly other than OpenSearch.

After every release we would have a functioning manifest for the next major and minor release that includes the known components at that time. This will help us identify when an issue was introduced and will further aid us when we are running nightly benchmarks against the full bundle.

I have opened #1139 as a suggestion. An alternative here is we cut the release issue for the next release immediately on release day and ensure the manifest is updated right away.

@dblock
Copy link
Member

dblock commented Nov 23, 2021

We already have an issue for 1.3.0, but what we don't have is issues in every component. For that to happen we should have a release manager for 1.3.0 now (earlier) that can go do all that prep work.

@gaiksaya gaiksaya added ci-test-automation untriaged Issues that have not yet been triaged labels Dec 10, 2021
@zelinh zelinh removed the untriaged Issues that have not yet been triaged label Dec 16, 2021
@dblock
Copy link
Member

dblock commented Jan 11, 2022

I've updated the template to prepare for next development iteration in #1377 and it will kick off the process that together with #1375 will get us to produce the complete bundle a lot earlier. I'll close this because the latter captures the work to fix this specific problem (a dup).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants