Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[TASK] Add params to support specify test cases for Databricks CI scripts #9903

Closed
NvTimLiu opened this issue Nov 30, 2023 · 0 comments · Fixed by #9904
Closed

[TASK] Add params to support specify test cases for Databricks CI scripts #9903

NvTimLiu opened this issue Nov 30, 2023 · 0 comments · Fixed by #9904
Assignees
@NvTimLiu
Labels
build Related to CI / CD or cleanly building

Comments

@NvTimLiu
Copy link
Collaborator

NvTimLiu commented Nov 30, 2023 •
edited
Loading

Describe the bug

Add params to support specify build, test args on Databricks for CI scripts, e.g.

python jenkins/databricks/run-build.py -e SKIP_DEP_INSTALL=1 : Run maven build on Databricks and skip installing dependencies into maven repo

python jenkins/databricks/run-test.py -e TEST_MODE=DELTA_LAKE_ONLY : only run Delta Lake test cases on Databricks
@NvTimLiu NvTimLiu added bug Something isn't working ? - Needs Triage Need team to review and classify labels Nov 30, 2023
@NvTimLiu NvTimLiu self-assigned this Nov 30, 2023
NvTimLiu added a commit to NvTimLiu/spark-rapids that referenced this issue Nov 30, 2023
@NvTimLiu
Params for build and test CI scripts on Databricks
d6b9f41 
To fix NVIDIA#9903

Add params to support specify build, test args on Databricks for CI scripts, e.g.

    `python jenkins/databricks/run-build.py -e SKIP_DEP_INSTALL=1` : Run maven build on Databricks and skip installing dependencies into maven repo

    `python jenkins/databricks/run-test.py -e TEST_MODE=DELTA_LAKE_ONLY` : only run deltalake integration tests on Databricks

Signed-off-by: Tim Liu <timl@nvidia.com>
NvTimLiu added a commit to NvTimLiu/spark-rapids that referenced this issue Nov 30, 2023
@NvTimLiu
Params for build and test CI scripts on Databricks
9bdde1c 
To fix NVIDIA#9903

Add params to support specify build, test args on Databricks for CI scripts, e.g.

   `python jenkins/databricks/run-build.py -e SKIP_DEP_INSTALL=1` : Run maven build on Databricks and skip installing dependencies into maven repo

   `python jenkins/databricks/run-test.py -e TEST_MODE=DELTA_LAKE_ONLY` : only run Delta Lake  test cases on Databricks

Signed-off-by: Tim Liu <timl@nvidia.com>
@NvTimLiu NvTimLiu mentioned this issue Nov 30, 2023
Merged
NvTimLiu added a commit that referenced this issue Dec 3, 2023
@NvTimLiu
Params for build and test CI scripts on Databricks (#9904)
557680b 
* Params for build and test CI scripts on Databricks

To fix #9903

Add params to support specify build, test args on Databricks for CI scripts, e.g.

   `python jenkins/databricks/run-build.py -e SKIP_DEP_INSTALL=1` : Run maven build on Databricks and skip installing dependencies into maven repo

   `python jenkins/databricks/run-test.py -e TEST_MODE=DELTA_LAKE_ONLY` : only run Delta Lake  test cases on Databricks

Signed-off-by: Tim Liu <timl@nvidia.com>

* Print extra environments

Signed-off-by: Tim Liu <timl@nvidia.com>

---------

Signed-off-by: Tim Liu <timl@nvidia.com>
@sameerz sameerz added build Related to CI / CD or cleanly building and removed bug Something isn't working ? - Needs Triage Need team to review and classify labels Dec 10, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@NvTimLiu NvTimLiu

Labels
build Related to CI / CD or cleanly building
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Params for build and test CI scripts on Databricks NvTimLiu/spark-rapids
2 participants
@sameerz @NvTimLiu