Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FEA] update UCX documentation for branch 21.06 #2286

Closed
abellina opened this issue Apr 28, 2021 · 2 comments · Fixed by #2475
Closed

[FEA] update UCX documentation for branch 21.06 #2286

abellina opened this issue Apr 28, 2021 · 2 comments · Fixed by #2475
Assignees
@abellina
Labels
documentation Improvements or additions to documentation feature request New feature or request
Milestone
May 24 - Jun 4

Comments

@abellina
Copy link
Collaborator

abellina commented Apr 28, 2021 •
edited
Loading

This is to track UCX documentation updates for branch-21.06:

  1. Update UCX version suggested
  2. Update recommended configs
  3. Ensure we cover the TCP-only loopback issue: UCX 1.10 with TCP-only is unable to reach destination openucx/ucx#6695. This would be to clarify what version of UCX to use in these cases since the loopback interface will be disabled off by default in UCX 1.10.1
  4. Document/explain/follow up on "UCP vs UCX core" version mismatch: JUCX 1.11 says it's not compatible with UCX 1.10 openucx/ucx#6694. This is a warning that shows up in stdout in the executors.
@abellina abellina added feature request New feature or request ? - Needs Triage Need team to review and classify labels Apr 28, 2021
@abellina abellina mentioned this issue Apr 28, 2021
Merged
@abellina abellina self-assigned this Apr 28, 2021
@jlowe jlowe added documentation Improvements or additions to documentation and removed ? - Needs Triage Need team to review and classify labels Apr 28, 2021
@sameerz sameerz added this to the May 24 - Jun 4 milestone May 20, 2021
@abellina abellina changed the title [FEA] update UCX documentation for branch 0.6 [FEA] update UCX documentation for branch 21.06 May 21, 2021
@abellina
Copy link
Collaborator Author

Noting that for UCX 1.10.1, the license hasn't changed since June 2020: https://github.com/openucx/ucx/blob/v1.10.1/LICENSE, and we have those changes in 21.06: https://github.com/NVIDIA/spark-rapids/blob/branch-21.06/NOTICE-binary

@abellina abellina mentioned this issue May 21, 2021
Merged
@abellina
Copy link
Collaborator Author

Ensure we cover the TCP-only loopback issue: openucx/ucx#6695. This would be to clarify what version of UCX to use in these cases since the loopback interface will be disabled off by default in UCX 1.10.1

We are recommending UCX 1.10.1, which fixes the TCP issue raised here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@abellina abellina

Labels
documentation Improvements or additions to documentation feature request New feature or request
Projects
None yet
Milestone
May 24 - Jun 4
Development

Successfully merging a pull request may close this issue.

Update shuffle documentation for branch-21.06 and UCX 1.10.1 abellina/spark-rapids
3 participants
@jlowe @abellina @sameerz