Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BUG] fall back to the CPU for extended year date parsing. #3530

Closed
revans2 opened this issue Sep 17, 2021 · 1 comment
Closed

[BUG] fall back to the CPU for extended year date parsing. #3530

revans2 opened this issue Sep 17, 2021 · 1 comment
Assignees
@revans2
Labels
audit_3.2.0 bug Something isn't working duplicate This issue or pull request already exists P0 Must have for release Spark 3.2+
Milestone
Sep 13 - Sep 24

Comments

@revans2
Copy link
Collaborator

revans2 commented Sep 17, 2021

Describe the bug
In Spark 3.2.0 date parsing can now support 7 digit years. We cannot support this in cudf yet, so we need to document it and fall back to the CPU by default. We already have this for timestamp parsing. We need to update that to document that 7 digit year, btu also add in a similar config for date parsing.
@revans2 revans2 added bug Something isn't working P0 Must have for release Spark 3.2+ audit_3.2.0 labels Sep 17, 2021
@revans2 revans2 added this to the Sep 13 - Sep 24 milestone Sep 17, 2021
@revans2 revans2 self-assigned this Sep 17, 2021
@revans2 revans2 changed the title [BUG] fall abck to the CPU for 7 digit year date parsing. [BUG] fall back to the CPU for 7 digit year date parsing. Sep 17, 2021
@revans2 revans2 mentioned this issue Sep 17, 2021
Merged
@revans2 revans2 changed the title [BUG] fall back to the CPU for 7 digit year date parsing. [BUG] fall back to the CPU for extended year date parsing. Sep 17, 2021
@revans2 revans2 added the duplicate This issue or pull request already exists label Sep 17, 2021
@revans2
Copy link
Collaborator Author

revans2 commented Sep 17, 2021

This is a duplicate of #3382

@revans2 revans2 closed this as completed Sep 17, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@revans2 revans2

Labels
audit_3.2.0 bug Something isn't working duplicate This issue or pull request already exists P0 Must have for release Spark 3.2+
Projects
None yet
Milestone
Sep 13 - Sep 24
Development

No branches or pull requests
1 participant
@revans2