Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Join support for DecimalType #1475

Merged
merged 3 commits into from
Jan 8, 2021
Merged

Conversation

nartal1
Copy link
Collaborator

@nartal1 nartal1 commented Jan 8, 2021

This fixes #1326 and #1325

Signed-off-by: Niranjan Artal <nartal@nvidia.com>
Signed-off-by: Niranjan Artal <nartal@nvidia.com>
@nartal1 nartal1 added the feature request New feature or request label Jan 8, 2021
@nartal1 nartal1 added this to the Jan 4 - Jan 15 milestone Jan 8, 2021
@nartal1 nartal1 self-assigned this Jan 8, 2021
@@ -23,7 +23,9 @@
all_gen = [StringGen(), ByteGen(), ShortGen(), IntegerGen(), LongGen(),
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Its better to use the all_gen in data_gen.py and add the stuff missing

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

So I really hate all_gen being in data_gen.py because it is not really generating everything (all). I let it through before so I didn't say anything when it was reused, but if you do use it I would want it to be renamed so it is clear what is in it.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

all_gen in data_gen.py is missing these 2 gens: null_gen, decimal_gen_neg_scale .
Please let me know if below would be acceptable name if we want to rename it for better readability?

  1. all_gen_minus_null_gen_and_decimal_gen_neg_scale OR all_gen_excluding_null_gen_and_decimal_gen_neg_scale (problem I see with this is we may have to rename it again if we add any other gen in the future which is not included in this variable).
    Suggestions are welcome on variable name :) .

Or would you prefer to keep all_gen local to the test files and remove it from data_gen.py ?(I can create follow on PR for that as it involves changing other files).

Copy link
Collaborator

@razajafri razajafri Jan 8, 2021

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I can't think of a name suitable. @jlowe is better at naming things may be he has something

The right thing to do in my mind would be to add everything in all_gen and let tests create local versions of a list if they need something different. Considering it might break tests if you add everything in all_gen lets create a follow-on for this as a lower priority task

@@ -23,7 +23,9 @@
all_gen = [StringGen(), ByteGen(), ShortGen(), IntegerGen(), LongGen(),
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

So I really hate all_gen being in data_gen.py because it is not really generating everything (all). I let it through before so I didn't say anything when it was reused, but if you do use it I would want it to be renamed so it is clear what is in it.

@revans2
Copy link
Collaborator

revans2 commented Jan 8, 2021

build

@razajafri razajafri merged commit 563b763 into NVIDIA:branch-0.4 Jan 8, 2021
nartal1 added a commit to nartal1/spark-rapids that referenced this pull request Jun 9, 2021
* DecimalType support for joins

Signed-off-by: Niranjan Artal <nartal@nvidia.com>

* update copyrights

Signed-off-by: Niranjan Artal <nartal@nvidia.com>
nartal1 added a commit to nartal1/spark-rapids that referenced this pull request Jun 9, 2021
* DecimalType support for joins

Signed-off-by: Niranjan Artal <nartal@nvidia.com>

* update copyrights

Signed-off-by: Niranjan Artal <nartal@nvidia.com>
tgravescs pushed a commit to tgravescs/spark-rapids that referenced this pull request Nov 30, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[FEA] Add in Broadcast support for decimal values
3 participants