Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[AUDIT][SPARK-42521][SQL] Add NULLs for INSERTs with user-specified lists of fewer columns than the target table #8118

Open
abellina opened this issue Apr 14, 2023 · 1 comment
Open

[AUDIT][SPARK-42521][SQL] Add NULLs for INSERTs with user-specified lists of fewer columns than the target table #8118

abellina opened this issue Apr 14, 2023 · 1 comment
Labels
audit_3.4.0 Audit related tasks for 3.4.0 feature request New feature or request

Comments

@abellina
Copy link
Collaborator

This changed introduced some default value handling in Spark 3.4.0 that I do not think we are testing, and I am not 100% sure how this works with our writers. So I figure to file this issue for follow up, but I am not sure if there is anyhting to do here yet.

Spark reference: apache/spark@d8fa508e53
@abellina abellina added feature request New feature or request ? - Needs Triage Need team to review and classify audit_3.4.0 Audit related tasks for 3.4.0 labels Apr 14, 2023
@mattahrens mattahrens removed the ? - Needs Triage Need team to review and classify label Apr 18, 2023
@mattahrens
Copy link
Collaborator

Scope: validate behavior that Spark is inserting nulls ahead of our plugin. If not, we may need code changes on our side.

@NVnavkumar NVnavkumar mentioned this issue May 17, 2023
Open
27 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
audit_3.4.0 Audit related tasks for 3.4.0 feature request New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@abellina @mattahrens