Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make new build default and combine into dist package #3411

Merged
merged 113 commits into from
Sep 10, 2021

Commits on Aug 25, 2021

  1. Update to cudf conditional join change that removes null equality arg…

    …ument
    
    Signed-off-by: Jason Lowe <jlowe@nvidia.com>
    jlowe committed Aug 25, 2021
    Configuration menu
    Copy the full SHA
    53f665b View commit details
    Browse the repository at this point in the history

Commits on Sep 2, 2021

  1. dist initial working

    Signed-off-by: Thomas Graves <tgraves@nvidia.com>
    tgravescs committed Sep 2, 2021
    Configuration menu
    Copy the full SHA
    b80cb31 View commit details
    Browse the repository at this point in the history
  2. add classes files

    tgravescs committed Sep 2, 2021
    Configuration menu
    Copy the full SHA
    5e1cacb View commit details
    Browse the repository at this point in the history

Commits on Sep 3, 2021

  1. Parallel world ServiceLoader

    Signed-off-by: Gera Shegalov <gera@apache.org>
    gerashegalov committed Sep 3, 2021
    Configuration menu
    Copy the full SHA
    07526a3 View commit details
    Browse the repository at this point in the history
  2. Implement per-shim parallel world jar classloader

    Signed-off-by: Gera Shegalov <gera@apache.org>
    gerashegalov committed Sep 3, 2021
    Configuration menu
    Copy the full SHA
    a8f5949 View commit details
    Browse the repository at this point in the history
  3. working

    tgravescs committed Sep 3, 2021
    Configuration menu
    Copy the full SHA
    8ffc90e View commit details
    Browse the repository at this point in the history
  4. checkpoint

    tgravescs committed Sep 3, 2021
    Configuration menu
    Copy the full SHA
    8cb180e View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    d2453b7 View commit details
    Browse the repository at this point in the history
  6. working

    tgravescs committed Sep 3, 2021
    Configuration menu
    Copy the full SHA
    9ee5eeb View commit details
    Browse the repository at this point in the history
  7. review and test fix

    gerashegalov committed Sep 3, 2021
    Configuration menu
    Copy the full SHA
    0d5b11c View commit details
    Browse the repository at this point in the history

Commits on Sep 4, 2021

  1. Adding shuffle manager

    Signed-off-by: Gera Shegalov <gera@apache.org>
    gerashegalov committed Sep 4, 2021
    Configuration menu
    Copy the full SHA
    fbacdbe View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    72dd879 View commit details
    Browse the repository at this point in the history
  3. wip

    gerashegalov committed Sep 4, 2021
    Configuration menu
    Copy the full SHA
    59503cd View commit details
    Browse the repository at this point in the history
  4. test fix

    gerashegalov committed Sep 4, 2021
    Configuration menu
    Copy the full SHA
    aca6e8e View commit details
    Browse the repository at this point in the history
  5. test fix

    gerashegalov committed Sep 4, 2021
    Configuration menu
    Copy the full SHA
    9fbe630 View commit details
    Browse the repository at this point in the history

Commits on Sep 7, 2021

  1. Configuration menu
    Copy the full SHA
    fb0399a View commit details
    Browse the repository at this point in the history
  2. working

    tgravescs committed Sep 7, 2021
    Configuration menu
    Copy the full SHA
    3331515 View commit details
    Browse the repository at this point in the history
  3. really working

    tgravescs committed Sep 7, 2021
    Configuration menu
    Copy the full SHA
    4e24306 View commit details
    Browse the repository at this point in the history
  4. cleanup old profiles

    tgravescs committed Sep 7, 2021
    Configuration menu
    Copy the full SHA
    34dd324 View commit details
    Browse the repository at this point in the history
  5. cdh building again

    tgravescs committed Sep 7, 2021
    Configuration menu
    Copy the full SHA
    6ab79ad View commit details
    Browse the repository at this point in the history
  6. format

    tgravescs committed Sep 7, 2021
    Configuration menu
    Copy the full SHA
    4d8df72 View commit details
    Browse the repository at this point in the history
  7. Working on 311db

    Signed-off-by: Thomas Graves <tgraves@nvidia.com>
    tgravescs committed Sep 7, 2021
    Configuration menu
    Copy the full SHA
    9ffe27d View commit details
    Browse the repository at this point in the history
  8. fix int tests

    tgravescs committed Sep 7, 2021
    Configuration menu
    Copy the full SHA
    b8513e5 View commit details
    Browse the repository at this point in the history
  9. fix individual

    tgravescs committed Sep 7, 2021
    Configuration menu
    Copy the full SHA
    df4d48e View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    662a76f View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    120d359 View commit details
    Browse the repository at this point in the history
  12. Merge branch 'builddistnewwithclass2' of github.com:tgravescs/spark-r…

    …apids into builddistnewwithclass2
    tgravescs committed Sep 7, 2021
    Configuration menu
    Copy the full SHA
    ca832e7 View commit details
    Browse the repository at this point in the history
  13. add file

    tgravescs committed Sep 7, 2021
    Configuration menu
    Copy the full SHA
    c6611ff View commit details
    Browse the repository at this point in the history
  14. 301 databricks building

    Signed-off-by: Thomas Graves <tgraves@nvidia.com>
    tgravescs committed Sep 7, 2021
    Configuration menu
    Copy the full SHA
    64bf62d View commit details
    Browse the repository at this point in the history
  15. remove aggregator

    tgravescs committed Sep 7, 2021
    Configuration menu
    Copy the full SHA
    1d7abb3 View commit details
    Browse the repository at this point in the history
  16. remove aggregator dir

    tgravescs committed Sep 7, 2021
    Configuration menu
    Copy the full SHA
    ac74331 View commit details
    Browse the repository at this point in the history
  17. remove profiles db

    tgravescs committed Sep 7, 2021
    Configuration menu
    Copy the full SHA
    cdbe13d View commit details
    Browse the repository at this point in the history
  18. update build scripts

    tgravescs committed Sep 7, 2021
    Configuration menu
    Copy the full SHA
    8974e60 View commit details
    Browse the repository at this point in the history
  19. cleanup

    tgravescs committed Sep 7, 2021
    Configuration menu
    Copy the full SHA
    8e8d61a View commit details
    Browse the repository at this point in the history
  20. cleanup

    tgravescs committed Sep 7, 2021
    Configuration menu
    Copy the full SHA
    b5a30b8 View commit details
    Browse the repository at this point in the history
  21. format

    tgravescs committed Sep 7, 2021
    Configuration menu
    Copy the full SHA
    6c4c788 View commit details
    Browse the repository at this point in the history
  22. fix cdh

    tgravescs committed Sep 7, 2021
    Configuration menu
    Copy the full SHA
    c1a104f View commit details
    Browse the repository at this point in the history
  23. Fix xdist

    tgravescs committed Sep 7, 2021
    Configuration menu
    Copy the full SHA
    dd2660a View commit details
    Browse the repository at this point in the history
  24. fix another xdist

    tgravescs committed Sep 7, 2021
    Configuration menu
    Copy the full SHA
    43fab8a View commit details
    Browse the repository at this point in the history
  25. Configuration menu
    Copy the full SHA
    381c624 View commit details
    Browse the repository at this point in the history
  26. Merge branch 'builddistnewwithclass2' of github.com:tgravescs/spark-r…

    …apids into builddistnewwithclass2
    tgravescs committed Sep 7, 2021
    Configuration menu
    Copy the full SHA
    6b82784 View commit details
    Browse the repository at this point in the history
  27. Configuration menu
    Copy the full SHA
    c823f8a View commit details
    Browse the repository at this point in the history
  28. 3.1.1

    tgravescs committed Sep 7, 2021
    Configuration menu
    Copy the full SHA
    85418a3 View commit details
    Browse the repository at this point in the history
  29. fiiles for 3.0.1

    tgravescs committed Sep 7, 2021
    Configuration menu
    Copy the full SHA
    451c293 View commit details
    Browse the repository at this point in the history
  30. fix build scripts

    tgravescs committed Sep 7, 2021
    Configuration menu
    Copy the full SHA
    ee30c59 View commit details
    Browse the repository at this point in the history
  31. Configuration menu
    Copy the full SHA
    3194a65 View commit details
    Browse the repository at this point in the history
  32. reviews

    Signed-off-by: Gera Shegalov <gera@apache.org>
    gerashegalov committed Sep 7, 2021
    Configuration menu
    Copy the full SHA
    2ce74fc View commit details
    Browse the repository at this point in the history
  33. fixes and build updates

    tgravescs committed Sep 7, 2021
    Configuration menu
    Copy the full SHA
    34cb2ed View commit details
    Browse the repository at this point in the history
  34. commens

    gerashegalov committed Sep 7, 2021
    Configuration menu
    Copy the full SHA
    0e5ad4e View commit details
    Browse the repository at this point in the history
  35. Configuration menu
    Copy the full SHA
    e59f44f View commit details
    Browse the repository at this point in the history

Commits on Sep 8, 2021

  1. dist package updates and cleanup

    Signed-off-by: Thomas Graves <tgraves@nvidia.com>
    tgravescs committed Sep 8, 2021
    Configuration menu
    Copy the full SHA
    e47c4fd View commit details
    Browse the repository at this point in the history
  2. update comment

    tgravescs committed Sep 8, 2021
    Configuration menu
    Copy the full SHA
    3746e9c View commit details
    Browse the repository at this point in the history
  3. add missing files

    tgravescs committed Sep 8, 2021
    Configuration menu
    Copy the full SHA
    67e6c52 View commit details
    Browse the repository at this point in the history
  4. working and jar complete

    tgravescs committed Sep 8, 2021
    Configuration menu
    Copy the full SHA
    ae339a7 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    ef7f5f3 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    7ad7d94 View commit details
    Browse the repository at this point in the history
  7. fix comment type

    tgravescs committed Sep 8, 2021
    Configuration menu
    Copy the full SHA
    c8a9772 View commit details
    Browse the repository at this point in the history
  8. add clean to build script

    tgravescs committed Sep 8, 2021
    Configuration menu
    Copy the full SHA
    d581ba8 View commit details
    Browse the repository at this point in the history
  9. Add docs to contributing

    tgravescs committed Sep 8, 2021
    Configuration menu
    Copy the full SHA
    f6c2980 View commit details
    Browse the repository at this point in the history
  10. remove shimmed lcasses

    tgravescs committed Sep 8, 2021
    Configuration menu
    Copy the full SHA
    aa472c9 View commit details
    Browse the repository at this point in the history
  11. doc buildver

    tgravescs committed Sep 8, 2021
    Configuration menu
    Copy the full SHA
    04ba876 View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    bd47113 View commit details
    Browse the repository at this point in the history
  13. fix premerge build script

    tgravescs committed Sep 8, 2021
    Configuration menu
    Copy the full SHA
    317c051 View commit details
    Browse the repository at this point in the history
  14. add readme for dist

    tgravescs committed Sep 8, 2021
    Configuration menu
    Copy the full SHA
    32c78c8 View commit details
    Browse the repository at this point in the history
  15. quotes

    tgravescs committed Sep 8, 2021
    Configuration menu
    Copy the full SHA
    792e83f View commit details
    Browse the repository at this point in the history
  16. put spark320 into buildall

    tgravescs committed Sep 8, 2021
    Configuration menu
    Copy the full SHA
    ec1c539 View commit details
    Browse the repository at this point in the history
  17. Configuration menu
    Copy the full SHA
    3bf66f6 View commit details
    Browse the repository at this point in the history
  18. Configuration menu
    Copy the full SHA
    6057940 View commit details
    Browse the repository at this point in the history
  19. Configuration menu
    Copy the full SHA
    c46a0c4 View commit details
    Browse the repository at this point in the history
  20. Configuration menu
    Copy the full SHA
    d38bfee View commit details
    Browse the repository at this point in the history
  21. review comments

    tgravescs committed Sep 8, 2021
    Configuration menu
    Copy the full SHA
    a041fe6 View commit details
    Browse the repository at this point in the history
  22. nightly updates

    tgravescs committed Sep 8, 2021
    Configuration menu
    Copy the full SHA
    56effd6 View commit details
    Browse the repository at this point in the history

Commits on Sep 9, 2021

  1. ProxyShuffleManager cannot be dedupped, so undoing

    - WIP directory renames
    gerashegalov committed Sep 9, 2021
    Configuration menu
    Copy the full SHA
    21873ef View commit details
    Browse the repository at this point in the history
  2. dir cleanup

    gerashegalov committed Sep 9, 2021
    Configuration menu
    Copy the full SHA
    c89a65c View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    bf79e74 View commit details
    Browse the repository at this point in the history
  4. source code layout doc

    gerashegalov committed Sep 9, 2021
    Configuration menu
    Copy the full SHA
    871e12d View commit details
    Browse the repository at this point in the history
  5. than

    tgravescs committed Sep 9, 2021
    Configuration menu
    Copy the full SHA
    b3a4df7 View commit details
    Browse the repository at this point in the history
  6. Merge branch 'builddistnewwithclass2' of github.com:tgravescs/spark-r…

    …apids into builddistnewwithclass2
    tgravescs committed Sep 9, 2021
    Configuration menu
    Copy the full SHA
    ed24fe9 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    698363e View commit details
    Browse the repository at this point in the history
  8. fixes after upmerge

    tgravescs committed Sep 9, 2021
    Configuration menu
    Copy the full SHA
    0da6108 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    51db94e View commit details
    Browse the repository at this point in the history
  10. Fix databricks 311 build

    tgravescs committed Sep 9, 2021
    Configuration menu
    Copy the full SHA
    5c4b5fb View commit details
    Browse the repository at this point in the history
  11. Fix databricks 301 build

    Signed-off-by: Thomas Graves <tgraves@nvidia.com>
    tgravescs committed Sep 9, 2021
    Configuration menu
    Copy the full SHA
    b787b29 View commit details
    Browse the repository at this point in the history
  12. upmerge fixes

    Signed-off-by: Thomas Graves <tgraves@nvidia.com>
    tgravescs committed Sep 9, 2021
    Configuration menu
    Copy the full SHA
    b6bc59d View commit details
    Browse the repository at this point in the history
  13. Merge branch 'builddistnewwithclass2' of github.com:tgravescs/spark-r…

    …apids into builddistnewwithclass2
    tgravescs committed Sep 9, 2021
    Configuration menu
    Copy the full SHA
    15d534f View commit details
    Browse the repository at this point in the history
  14. update readme

    tgravescs committed Sep 9, 2021
    Configuration menu
    Copy the full SHA
    1f83a3d View commit details
    Browse the repository at this point in the history
  15. preview

    gerashegalov committed Sep 9, 2021
    Configuration menu
    Copy the full SHA
    9a43800 View commit details
    Browse the repository at this point in the history
  16. whitespace

    gerashegalov committed Sep 9, 2021
    Configuration menu
    Copy the full SHA
    6ec561a View commit details
    Browse the repository at this point in the history
  17. inclusive

    gerashegalov committed Sep 9, 2021
    Configuration menu
    Copy the full SHA
    44fbfac View commit details
    Browse the repository at this point in the history
  18. Configuration menu
    Copy the full SHA
    b70d527 View commit details
    Browse the repository at this point in the history
  19. Configuration menu
    Copy the full SHA
    7d43de1 View commit details
    Browse the repository at this point in the history
  20. Configuration menu
    Copy the full SHA
    a7db8e7 View commit details
    Browse the repository at this point in the history
  21. scalastyle violations

    gerashegalov committed Sep 9, 2021
    Configuration menu
    Copy the full SHA
    d905db3 View commit details
    Browse the repository at this point in the history
  22. Configuration menu
    Copy the full SHA
    9ab165f View commit details
    Browse the repository at this point in the history
  23. xfail test to unblock build

    jlowe committed Sep 9, 2021
    Configuration menu
    Copy the full SHA
    a094c94 View commit details
    Browse the repository at this point in the history
  24. Configuration menu
    Copy the full SHA
    371329f View commit details
    Browse the repository at this point in the history
  25. Configuration menu
    Copy the full SHA
    c4060a7 View commit details
    Browse the repository at this point in the history
  26. Configuration menu
    Copy the full SHA
    9411c30 View commit details
    Browse the repository at this point in the history
  27. Configuration menu
    Copy the full SHA
    62e7da8 View commit details
    Browse the repository at this point in the history
  28. fix upmerge

    tgravescs committed Sep 9, 2021
    Configuration menu
    Copy the full SHA
    60a3faa View commit details
    Browse the repository at this point in the history

Commits on Sep 10, 2021

  1. Configuration menu
    Copy the full SHA
    5c9936a View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    78596ca View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    7dadfb7 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    ee15d31 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    9ded15a View commit details
    Browse the repository at this point in the history
  6. wip

    gerashegalov committed Sep 10, 2021
    Configuration menu
    Copy the full SHA
    48f281e View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    2297962 View commit details
    Browse the repository at this point in the history
  8. fix configs.md doc

    tgravescs committed Sep 10, 2021
    Configuration menu
    Copy the full SHA
    b42c158 View commit details
    Browse the repository at this point in the history
  9. add clean to nightly

    tgravescs committed Sep 10, 2021
    Configuration menu
    Copy the full SHA
    339d10f View commit details
    Browse the repository at this point in the history
  10. fix inclusion

    tgravescs committed Sep 10, 2021
    Configuration menu
    Copy the full SHA
    895216b View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    f20c79d View commit details
    Browse the repository at this point in the history
  12. Fix classloading via ProxyRapidsShuffleManager

    - created profile representative shims for each FEATURE version and a
      vendor shim
    - Use VisibleShuffleManager mostly for tagging, so stop inheriting
      ShuffleManager
    - prevent ClassCastExceptions when casting to VisibleShuffleManager
      by not using it in the ShimLoader method signatures
    
    Signed-off-by: Gera Shegalov <gera@apache.org>
    gerashegalov committed Sep 10, 2021
    Configuration menu
    Copy the full SHA
    0d078a7 View commit details
    Browse the repository at this point in the history
  13. Merge pull request #3 from gerashegalov/builddistnewwithclass2+gerafixes

     Fix classloading via ProxyRapidsShuffleManager
    tgravescs authored Sep 10, 2021
    Configuration menu
    Copy the full SHA
    b13a61c View commit details
    Browse the repository at this point in the history