Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-39840][SQL][PYTHON] Factor PythonArrowInput out as a symmetry to PythonArrowOutput #6172

Open
amahussein opened this issue Aug 1, 2022 · 0 comments
Labels
audit_3.4.0 Audit related tasks for 3.4.0 P1 Nice to have for release

Comments

@amahussein
Copy link
Collaborator

amahussein commented Aug 1, 2022

Spark-context

apache/spark@2e1467f748

What changes were proposed in SPARK pull request?

Similar to the refactor done PythonArrowOutput in SPARK-29317, this PR factors the Arrow input code path out as PythonArrowInput

Why are the changes needed in Spark?

Code-refactor

Does this PR introduce any user-facing change?

No

Why it might affect RAPIDS?

Currently, We define a trait GpuPythonArrowOutput which is used
in declaring class GpuArrowPythonRunner

We will need to change GpuArrowPythonRunner to be aware of the two traits

class GpuArrowPythonRunner(

) with GpuPythonArrowInput GpuPythonArrowOutput { }

Impact on Testing?

No

Requires Doc update?

No

@amahussein amahussein added ? - Needs Triage Need team to review and classify audit_3.4.0 Audit related tasks for 3.4.0 labels Aug 1, 2022
@sameerz sameerz added P1 Nice to have for release and removed ? - Needs Triage Need team to review and classify labels Aug 2, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
audit_3.4.0 Audit related tasks for 3.4.0 P1 Nice to have for release
Projects
None yet
Development

No branches or pull requests

2 participants