Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add performance E2E test #6569

Merged
merged 2 commits into from
Aug 16, 2023
Merged

Conversation

qiuming-best
Copy link
Contributor

@qiuming-best qiuming-best commented Aug 1, 2023

Thank you for contributing to Velero!

Please add a summary of your change

Does your change fix a particular issue?

Fixes #(issue)
#6088

This pr has moved all common libraries in test/e2e into the test path and added one new test/perf path for the performance test
It's one performance test frame that includes:

  • Makefile for the performance test
  • Basic Performance E2E test frame
  • Three basic backup and restore related test cases
  • Metrics about Pod, NFS, Minio
  • Report Generator

Please indicate you've done the following:

  • Accepted the DCO. Commits without the DCO will delay acceptance.
  • Created a changelog file or added /kind changelog-not-required as a comment on this pull request.
  • Updated the corresponding documentation in site/content/docs/main.

@github-actions github-actions bot added the Dependencies Pull requests that update a dependency file label Aug 1, 2023
@qiuming-best
Copy link
Contributor Author

qiuming-best commented Aug 1, 2023

The test report would be like below:

Test Description: velero performance test
Do backup and restore resources for performance test:
    Minio disk usage:
        minio: 25 GiB
    NFS disk usage:
        nfs: 15G
    Resource consumption:
        - node-agent-6nl8k:
            Average CPU: 387 mili core
            Average Memory: 623 MiB
            Max CPU: 1.00 core
            MaxMemory: 970 MiB
        - velero-799b457548-tgp56:
            Average CPU: 1 mili core
            Average Memory: 73 MiB
            Max CPU: 22 mili core
            MaxMemory: 87 MiB
    Time cost:
        Backup Time Cost: 4m8s
        Destroy Resources Time Cost: 1m25s
        Restore Time Cost: 7m29s
        Total time cost: 13m6s

@codecov-commenter
Copy link

codecov-commenter commented Aug 1, 2023

Codecov Report

Merging #6569 (f890033) into main (713792d) will increase coverage by 0.13%.
Report is 2 commits behind head on main.
The diff coverage is n/a.

@@            Coverage Diff             @@
##             main    #6569      +/-   ##
==========================================
+ Coverage   60.18%   60.31%   +0.13%     
==========================================
  Files         242      242              
  Lines       25712    25924     +212     
==========================================
+ Hits        15475    15637     +162     
- Misses       9156     9186      +30     
- Partials     1081     1101      +20     

see 4 files with indirect coverage changes

@reasonerjt reasonerjt added this to the v1.12 milestone Aug 9, 2023
Signed-off-by: Ming Qiu <mqiu@vmware.com>
@qiuming-best
Copy link
Contributor Author

For E2E test only one test failed:
image

For [APIGroup][APIVersion] case after the fix and run success locally:
image

@qiuming-best
Copy link
Contributor Author

this pr including fix issue #6503 #6504 #6569 #6505

@qiuming-best qiuming-best merged commit e3b6063 into vmware-tanzu:main Aug 16, 2023
24 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Dependencies Pull requests that update a dependency file has-changelog has-e2e-tests
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants