Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add an explain only mode to the plugin #4322

Merged
merged 33 commits into from
Jan 14, 2022
Merged

Add an explain only mode to the plugin #4322

merged 33 commits into from
Jan 14, 2022

Commits on Dec 1, 2021

  1. Add an explain only mode configuration to run plugin on CPU to get wh… 

    …at would have run on GPU

Signed-off-by: Thomas Graves <tgraves@apache.org>
    @tgravescs
    tgravescs committed Dec 1, 2021
    Configuration menu
    Copy the full SHA
    8eb81f6 View commit details
    Browse the repository at this point in the history

  2. Updates

    @tgravescs
    tgravescs committed Dec 1, 2021
    Configuration menu
    Copy the full SHA
    1fca5ef View commit details
    Browse the repository at this point in the history

Commits on Dec 2, 2021

  1. Don't allocate gpu or enable shuffle for explain only mode

    @tgravescs
    tgravescs committed Dec 2, 2021
    Configuration menu
    Copy the full SHA
    f043f86 View commit details
    Browse the repository at this point in the history

  2. explain only mode check for rapids shuffle internal manager

    @tgravescs
    tgravescs committed Dec 2, 2021
    Configuration menu
    Copy the full SHA
    431426c View commit details
    Browse the repository at this point in the history

  3. update doc

    @tgravescs
    tgravescs committed Dec 2, 2021
    Configuration menu
    Copy the full SHA
    3541832 View commit details
    Browse the repository at this point in the history

Commits on Dec 3, 2021

  1. Change how we check explain with sql enabled

    @tgravescs
    tgravescs committed Dec 3, 2021
    Configuration menu
    Copy the full SHA
    6ec51d0 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'explainonlymode' of github.com:tgravescs/spark-rapids i… 

    …nto explainonlymode
    @tgravescs
    tgravescs committed Dec 3, 2021
    Configuration menu
    Copy the full SHA
    21a79ca View commit details
    Browse the repository at this point in the history

  3. update not work message:

    @tgravescs
    tgravescs committed Dec 3, 2021
    Configuration menu
    Copy the full SHA
    b8e9e26 View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'origin/branch-22.02' into explainonlymode

    @tgravescs
    tgravescs committed Dec 3, 2021
    Configuration menu
    Copy the full SHA
    c15b786 View commit details
    Browse the repository at this point in the history

Commits on Dec 6, 2021

  1. fix spacing

    @tgravescs
    tgravescs committed Dec 6, 2021
    Configuration menu
    Copy the full SHA
    ba3b355 View commit details
    Browse the repository at this point in the history

  2. Update doc adding explain option

    @tgravescs
    tgravescs committed Dec 6, 2021
    Configuration menu
    Copy the full SHA
    42aa80f View commit details
    Browse the repository at this point in the history

  3. update docs

    @tgravescs
    tgravescs committed Dec 6, 2021
    Configuration menu
    Copy the full SHA
    278d96c View commit details
    Browse the repository at this point in the history

  4. Add explian only mode test to make sure runs on cpu

    @tgravescs
    tgravescs committed Dec 6, 2021
    Configuration menu
    Copy the full SHA
    2a3b228 View commit details
    Browse the repository at this point in the history

Commits on Dec 7, 2021

  1. add note about adaptive

    @tgravescs
    tgravescs committed Dec 7, 2021
    Configuration menu
    Copy the full SHA
    3bdf4f2 View commit details
    Browse the repository at this point in the history

  2. get rest of broadcast shims

    @tgravescs
    tgravescs committed Dec 7, 2021
    Configuration menu
    Copy the full SHA
    4b88718 View commit details
    Browse the repository at this point in the history

  3. Update logging of enabled and explain only mode

    @tgravescs
    tgravescs committed Dec 7, 2021
    Configuration menu
    Copy the full SHA
    8f9301a View commit details
    Browse the repository at this point in the history

  4. update config docs

    @tgravescs
    tgravescs committed Dec 7, 2021
    Configuration menu
    Copy the full SHA
    d79c9a4 View commit details
    Browse the repository at this point in the history

Commits on Jan 12, 2022

  1. Merge remote-tracking branch 'origin/branch-22.02' into explainonlymode

    @tgravescs
    tgravescs committed Jan 12, 2022
    Configuration menu
    Copy the full SHA
    6402631 View commit details
    Browse the repository at this point in the history

  2. Update to use the spark.rapids.sql.mode config 

    Signed-off-by: Thomas Graves <tgraves@nvidia.com>
    @tgravescs
    tgravescs committed Jan 12, 2022
    Configuration menu
    Copy the full SHA
    ab49521 View commit details
    Browse the repository at this point in the history

  3. update config doc and formatting

    @tgravescs
    tgravescs committed Jan 12, 2022
    Configuration menu
    Copy the full SHA
    ce38223 View commit details
    Browse the repository at this point in the history

  4. update docs

    @tgravescs
    tgravescs committed Jan 12, 2022
    Configuration menu
    Copy the full SHA
    b1dd70e View commit details
    Browse the repository at this point in the history

  5. fix typo

    @tgravescs
    tgravescs committed Jan 12, 2022
    Configuration menu
    Copy the full SHA
    c94d732 View commit details
    Browse the repository at this point in the history

  6. update configs.md

    @tgravescs
    tgravescs committed Jan 12, 2022
    Configuration menu
    Copy the full SHA
    0003e4e View commit details
    Browse the repository at this point in the history

Commits on Jan 13, 2022

  1. Change to check for isSqlEnabled and the mode separately because we may 

    want to initialize stuff on startup with the plugin disabled and
dynamically enable it afterwards
    @tgravescs
    tgravescs committed Jan 13, 2022
    Configuration menu
    Copy the full SHA
    77c82a2 View commit details
    Browse the repository at this point in the history

  2. fix spacing

    @tgravescs
    tgravescs committed Jan 13, 2022
    Configuration menu
    Copy the full SHA
    c02dae5 View commit details
    Browse the repository at this point in the history

  3. update auto generated configs doc

    @tgravescs
    tgravescs committed Jan 13, 2022
    Configuration menu
    Copy the full SHA
    2afeb2b View commit details
    Browse the repository at this point in the history

Commits on Jan 14, 2022

  1. Update docs/get-started/getting-started-workload-qualification.md 

    Co-authored-by: Jason Lowe <jlowe@nvidia.com>
    @tgravescs @jlowe
    tgravescs and jlowe authored Jan 14, 2022
    Configuration menu
    Copy the full SHA
    dae6749 View commit details
    Browse the repository at this point in the history

  2. Update docs/get-started/getting-started-workload-qualification.md 

    Co-authored-by: Jason Lowe <jlowe@nvidia.com>
    @tgravescs @jlowe
    tgravescs and jlowe authored Jan 14, 2022
    Configuration menu
    Copy the full SHA
    0ec5e1f View commit details
    Browse the repository at this point in the history

  3. update copyrights and change text from plugin to Rapids Accelerator

    @tgravescs
    tgravescs committed Jan 14, 2022
    Configuration menu
    Copy the full SHA
    8e84659 View commit details
    Browse the repository at this point in the history

  4. Update sql-plugin/src/main/scala/com/nvidia/spark/rapids/RapidsConf.s… 

    …cala

Co-authored-by: Jason Lowe <jlowe@nvidia.com>
    @tgravescs @jlowe
    tgravescs and jlowe authored Jan 14, 2022
    Configuration menu
    Copy the full SHA
    6aaacf8 View commit details
    Browse the repository at this point in the history

  5. Update sql-plugin/src/main/scala/com/nvidia/spark/rapids/RapidsConf.s… 

    …cala

Co-authored-by: Jason Lowe <jlowe@nvidia.com>
    @tgravescs @jlowe
    tgravescs and jlowe authored Jan 14, 2022
    Configuration menu
    Copy the full SHA
    f6f9d67 View commit details
    Browse the repository at this point in the history

  6. Update sql-plugin/src/main/scala/com/nvidia/spark/rapids/RapidsConf.s… 

    …cala

Co-authored-by: Jason Lowe <jlowe@nvidia.com>
    @tgravescs @jlowe
    tgravescs and jlowe authored Jan 14, 2022
    Configuration menu
    Copy the full SHA
    fc5a1c2 View commit details
    Browse the repository at this point in the history

  7. update configs doc

    @tgravescs
    tgravescs committed Jan 14, 2022
    Configuration menu
    Copy the full SHA
    a3f1039 View commit details
    Browse the repository at this point in the history