Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[AUDIT][SPARK-43123][SQL] Internal field metadata should not be leaked to catalogs #8844

Closed
parthosa opened this issue Jul 27, 2023 · 0 comments · Fixed by #10630
Closed

[AUDIT][SPARK-43123][SQL] Internal field metadata should not be leaked to catalogs #8844

parthosa opened this issue Jul 27, 2023 · 0 comments · Fixed by #10630
Assignees
@parthosa
Labels
audit_3.5.0

Comments

@parthosa
Copy link
Collaborator

This PR fixes the internal field metadata leakage by updating CTAS/RTAS commands to remove such metadata before table creation. Our definition of class GpuCreateDataSourceTableAsSelectCommand might require similar changes.

Apache Commit - apache/spark@ 4c938d62d7
@parthosa parthosa added ? - Needs Triage Need team to review and classify feature request New feature or request labels Jul 27, 2023
@mattahrens mattahrens added audit_3.5.0 and removed ? - Needs Triage Need team to review and classify labels Aug 8, 2023
@parthosa parthosa self-assigned this Mar 15, 2024
@parthosa parthosa mentioned this issue Mar 25, 2024
Merged
@sameerz sameerz removed the feature request New feature or request label Mar 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@parthosa parthosa

Labels
audit_3.5.0
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Fix removal of internal metadata information in 350 shim parthosa/spark-rapids
3 participants
@mattahrens @sameerz @parthosa