-
Notifications
You must be signed in to change notification settings - Fork 230
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Commonize v2 shim [databricks] #4235
Conversation
Signed-off-by: Chong Gao <res_life@163.com>
build |
It would be better to give a short introduction of your change in the PR description. |
@firestarman @tgravescs Please help to review. |
...plugin/src/main/301until310-nondb/scala/com/nvidia/spark/rapids/shims/v2/Spark30XShims.scala
Outdated
Show resolved
Hide resolved
Signed-off-by: Chong Gao <res_life@163.com>
build |
looks like there are compile errors on data bricks. 4 I think in total, here is one: 06:04:24 [ERROR] /home/ubuntu/spark-rapids/sql-plugin/src/main/301until330-all/scala/com/nvidia/spark/rapids/shims/v2/Spark30Xuntil33XShims.scala:323: type mismatch; |
.../src/main/301until330-all/scala/com/nvidia/spark/rapids/shims/v2/Spark30Xuntil33XShims.scala
Outdated
Show resolved
Hide resolved
This reverts commit 2554927.
Signed-off-by: Chong Gao <res_life@163.com>
build |
@@ -441,12 +440,12 @@ | |||
<source>${project.basedir}/src/main/301+-nondb/scala</source> | |||
<source>${project.basedir}/src/main/301until320-all/scala</source> | |||
<source>${project.basedir}/src/main/301until320-nondb/scala</source> | |||
<source>${project.basedir}/src/main/301until330-all/scala</source> |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
👍
|
||
override def getSparkShimVersion: ShimVersion = SparkShimServiceProvider.VERSION | ||
|
||
override def hasCastFloatTimestampUpcast: Boolean = true |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
nit: why reorder methods?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Reverted.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
Signed-off-by: Chong Gao <res_life@163.com>
build |
After reordering two methods, pre-merge failed, this should not impact the pre-merge. |
build |
Signed-off-by: Chong Gao <res_life@163.com>
build |
* Commonize v2 shim Signed-off-by: Chong Gao <res_life@163.com> * Reuse some codes Signed-off-by: Chong Gao <res_life@163.com> * Revert "Reuse some codes" This reverts commit 2554927. * Reuse codes Signed-off-by: Chong Gao <res_life@163.com> * Revert a file Signed-off-by: Chong Gao <res_life@163.com>
Rename SparkBaseShims to Spark30XShims, delete unused 312db sources directory in sql-plugin.
Fixes #3660
Signed-off-by: Chong Gao res_life@163.com