Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix the errors for Pandas UDF tests on DB13.3 [databricks] #10813

Merged
merged 1 commit into from
May 14, 2024

Conversation

firestarman
Copy link
Collaborator

@firestarman firestarman commented May 14, 2024

Fix #10797

This PR uses a new config relevant to arrow batch slicing for the arrow python runner pick. Meanwhile, apply the pick rule of the arrow python runner to GpuAggreagteInPandasExec in addition to GpuFlatMapGroupInPandasExec.

Signed-off-by: Firestarman <firestarmanllc@gmail.com>
@firestarman firestarman changed the title Fix the errors for Pandas UDF tests on DB13.3 Fix the errors for Pandas UDF tests on DB13.3 [databricks] May 14, 2024
@firestarman
Copy link
Collaborator Author

build

Copy link
Member

@jlowe jlowe left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Description is a bit confusing since it mentions it introduces a new config, but no new config was added. It's using a new config available in Spark, so maybe that is what was meant.

@sameerz sameerz added the bug Something isn't working label May 14, 2024
@GaryShen2008 GaryShen2008 merged commit 44c6e6b into NVIDIA:branch-24.06 May 14, 2024
44 of 45 checks passed
@firestarman
Copy link
Collaborator Author

Description is a bit confusing since it mentions it introduces a new config, but no new config was added. It's using a new config available in Spark, so maybe that is what was meant.

Thx for review. Updated

@firestarman firestarman deleted the udf-fix branch May 15, 2024 01:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
4 participants