Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix 332db build failure [databricks] #10070

Merged
merged 2 commits into from
Dec 19, 2023

Conversation

andygrove
Copy link
Contributor

@andygrove andygrove commented Dec 18, 2023

Closes #10063

Builds were failing with:

[ERROR] /home/ubuntu/spark-rapids/tests/src/test/scala/org/apache/spark/sql/rapids/metrics/source/MockTaskContext.scala:69: 

method getKillReason has weaker access privileges; it should be public

overriding method getKillReason in class TaskContext of type ()Option[String];

This PR makes the method public to fix the compilation error.

Signed-off-by: Andy Grove <andygrove@nvidia.com>
@andygrove andygrove self-assigned this Dec 18, 2023
@andygrove andygrove added the build Related to CI / CD or cleanly building label Dec 18, 2023
@andygrove
Copy link
Contributor Author

build

@andygrove andygrove changed the title [IGNORE] Checking to see if a build failure still exists [databricks] Fix 332db build failure [databricks] Dec 18, 2023
@andygrove andygrove marked this pull request as ready for review December 18, 2023 16:57
@andygrove
Copy link
Contributor Author

build

@razajafri
Copy link
Collaborator

Any context on why this started to fail? The line was added 3 years ago

razajafri added a commit to razajafri/spark-rapids that referenced this pull request Dec 19, 2023
@winningsix
Copy link
Collaborator

added

Is it due to new DBX Spark version we support?

@gerashegalov
Copy link
Collaborator

Any context on why this started to fail? The line was added 3 years ago

Databricks Runtime releases maintenance updates bi-weekly. So presumably in the mid-December update they relaxed the signature for getKillReason and now our un-shimmed code without this PR looks like trying to turn it back to private via an override .

Also see #8587. Of note is that per #1320 we actually do not run unit / ScalaTests on Databricks. We could stop building test jars there.

@winningsix
Copy link
Collaborator

build

@andygrove andygrove merged commit 06e214a into NVIDIA:branch-24.02 Dec 19, 2023
37 of 38 checks passed
@andygrove andygrove deleted the fix-databricks-build branch December 19, 2023 14:22
razajafri added a commit that referenced this pull request Dec 25, 2023
* Added 351 snapshot shim

* Signing off

Signed-off-by: Raza Jafri <rjafri@nvidia.com>

* updated 2.13 pom.xml

* Fixed Decimal 128 Multiplication

* added comments to highlight the change in multiply128

* Removed the import alias

* Fixed Sequence size limit check

* changes to use the new multiply128. Changed the name of the shim to reflect the method name

* Handle empty partitions

* pulled in change from #10070

* Fixed the overflow check for addition and subtraction

* Updated test conditions

* Revert "Updated test conditions"

This reverts commit 533504f.

* addressed review comments

* renamed

---------

Signed-off-by: Raza Jafri <rjafri@nvidia.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
build Related to CI / CD or cleanly building
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BUG] CI build failure with 341db: method getKillReason has weaker access privileges; it should be public
5 participants