-
Notifications
You must be signed in to change notification settings - Fork 230
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Decimal Average Support #3898
Decimal Average Support #3898
Conversation
Signed-off-by: Robert (Bobby) Evans <bobby@apache.org>
Signed-off-by: Robert (Bobby) Evans <bobby@apache.org>
From my side, I'll come up with a patch against this (but I may need your help to test it), so I wouldn't worry too much about the conflict. I am also fine if it doesn't go into branch-21.12 yet, so I don't think we need to worry about the two diverging. |
Signed-off-by: Robert (Bobby) Evans <bobby@apache.org>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
mostly nits
shims/spark320/src/main/scala/com/nvidia/spark/rapids/shims/spark320/Spark320Shims.scala
Show resolved
Hide resolved
// First pass replace any operations that should be totally replaced. | ||
val replacePass = expr.transformDown { | ||
case GpuWindowExpression( | ||
GpuAggregateExpression(rep: GpuReplaceWindowFunction, _, _, _, _), spec) => |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Indentation seems a little off
sql-plugin/src/main/scala/org/apache/spark/sql/rapids/AggregateFunctions.scala
Outdated
Show resolved
Hide resolved
for the doc request, I think we can just do as a follow up too. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Minor nits but otherwise lgtm.
shims/spark320/src/main/scala/com/nvidia/spark/rapids/shims/spark320/Spark320Shims.scala
Outdated
Show resolved
Hide resolved
sql-plugin/src/main/scala/org/apache/spark/sql/rapids/AggregateFunctions.scala
Outdated
Show resolved
Hide resolved
@abellina @jlowe @sperlingxx please take another look |
This depends on #3891
It also includes some rework of reduction by @abellina but he is working on a more complete fix from what I understand in #3833 so we might have to redo things yet again depending on how that goes in.
This fixes #3880