Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Lower overhead of Windows CI tests #610

Merged
merged 8 commits into from
Feb 7, 2024
Merged

Conversation

mlxd
Copy link
Member

@mlxd mlxd commented Feb 7, 2024

Before submitting

Please complete the following checklist when submitting a PR:

  • All new features must include a unit test.
    If you've fixed a bug or added code that should be tested, add a test to the
    tests directory!

  • All new functions and code must be clearly commented and documented.
    If you do make documentation changes, make sure that the docs build and
    render correctly by running make docs.

  • Ensure that the test suite passes, by running make test.

  • Add a new entry to the .github/CHANGELOG.md file, summarizing the
    change, and including a link back to the PR.

  • Ensure that code is properly formatted by running make format.

When all the above are checked, delete everything above the dashed
line and fill in the pull request template.


Context: The Windows test suite often takes a long time to complete, or hangs on coverage generation during tests. Improving the Windows CI test runtime will help unblock other PRs in the ecosystem, where Windows CI runners are often timing out.

Description of the Change: This PR removes system-level debug files from the OpenCPPCoverage PDB paths, caches the vcpkg generated builds, and uses a RelWithDebInfo build for the coverage tests under Windows, following support in OpeCPPCoverage.

Benefits: Unblocks the Windows CI tests of incoming PRs.

Possible Drawbacks: Time-out issue may still occur, though frequency of occurrence dropped during testing of this PR.

Related GitHub Issues:

Copy link
Contributor

github-actions bot commented Feb 7, 2024

Hello. You may have forgotten to update the changelog!
Please edit .github/CHANGELOG.md with:

  • A one-to-two sentence description of the change. You may include a small working example for new features.
  • A link back to this PR.
  • Your name (or GitHub username) in the contributors section.

@codecov-commenter
Copy link

codecov-commenter commented Feb 7, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Comparison is base (f3beabc) 98.48% compared to head (eb5b282) 97.60%.
Report is 23 commits behind head on update/lgpu_cuda12.

Additional details and impacted files
@@                  Coverage Diff                   @@
##           update/lgpu_cuda12     #610      +/-   ##
======================================================
- Coverage               98.48%   97.60%   -0.89%     
======================================================
  Files                     169      169              
  Lines                   24760    24299     -461     
======================================================
- Hits                    24386    23717     -669     
- Misses                    374      582     +208     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@mlxd mlxd changed the base branch from master to update/lgpu_cuda12 February 7, 2024 19:40
@mlxd mlxd changed the base branch from update/lgpu_cuda12 to master February 7, 2024 19:43
@mlxd mlxd changed the base branch from master to update/lgpu_cuda12 February 7, 2024 19:44
@mlxd mlxd marked this pull request as ready for review February 7, 2024 19:49
@mlxd
Copy link
Member Author

mlxd commented Feb 7, 2024

Note that the CUDA 12 PR is required to pass the final tests, so this will first be merged onto that.

Copy link
Contributor

@AmintorDusko AmintorDusko left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Beautiful! Thank you for that!

@mlxd mlxd changed the title Cache vcpkg libs and reuse for windows tests Lower overhead of Windows CI tests Feb 7, 2024
Copy link
Member

@maliasadi maliasadi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🙌

.github/workflows/tests_windows.yml Show resolved Hide resolved
@mlxd mlxd merged commit a52e40f into update/lgpu_cuda12 Feb 7, 2024
81 of 84 checks passed
@mlxd mlxd deleted the update/cache_win_req branch February 7, 2024 22:08
mlxd added a commit that referenced this pull request Feb 12, 2024
* Add build and test support for CUDA 12

* Auto update version

* Fix name

* Avoid overstepping with CUDA 11 on 12

* Fix wheel output naming

* Remove unneeded strings

* Add missing 0 to CUDA 11 install

* Trigger CI

* Update to allow CUDA 11 wheels to build also

* Update fromJSON usage

* Update int to str in json map

* Aim to keep cuda 11.5 wheels for now

* Remove CUDA 11

* Migrate windows tests to clangcl to avoid failures

* Ensure VS generator used

* Update for auditwheel 6.0 changes

* Ensure devtoolset values are used in CUDA 12 build

* Remove unneeded deref

* Retry installing cuda 12.0

* Fix auditwheel arch check

* Fix auditwheel arch check again

* Revert windows tests

* Lower overhead of Windows CI tests (#610)

* Cache vcpkg libs and reuse

* Auto update version

* Trigger CI

* Fix matrix tests for windows

* Add excluded modules for OpenCPPCoverage

* Convert dash to underscore

* Use optimized build for Windows coverage

* Retrigger CI

---------

Co-authored-by: Dev version update bot <github-actions[bot]@users.noreply.github.com>

* Update changelog

* Remove trainability from stateprep in test

* Update dev reqs to use cu12

* Fix formatting

* Update the MPI modules in CI

* Add ls to module dirs

* Remove additional cu11 deps

* Use mpirun from PATH

* Update to cu12 in missing locations

* Remove opt path specifics

* Ensure cuda version env vars are inlcuded on Python tests for MPI

---------

Co-authored-by: Dev version update bot <github-actions[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants