Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support BitLength and OctetLength #4611

Merged
merged 7 commits into from
Feb 8, 2022

Conversation

sperlingxx
Copy link
Collaborator

@sperlingxx sperlingxx commented Jan 24, 2022

Signed-off-by: sperlingxx lovedreamf@gmail.com

Closes #4142

This PR is to provide GPU overrides for Spark SQL functions: BitLength and OctetLength

Signed-off-by: sperlingxx <lovedreamf@gmail.com>
@sperlingxx
Copy link
Collaborator Author

build

@jlowe jlowe changed the title Support GpuBitLength and GpuOctetLength Support BitLength and OctetLength Jan 24, 2022
jlowe
jlowe previously approved these changes Jan 24, 2022
@sameerz sameerz added this to the Jan 10 - Jan 28 milestone Jan 24, 2022
@sameerz sameerz added the audit_3.3.0 Audit related tasks for 3.3.0 label Jan 24, 2022
Signed-off-by: sperlingxx <lovedreamf@gmail.com>
@sperlingxx
Copy link
Collaborator Author

build

Comment on lines 405 to 406
@pytest.mark.skipif(is_before_spark_330(),
reason="octet_length and bit_length only available in 330+")
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
@pytest.mark.skipif(is_before_spark_330(),
reason="octet_length and bit_length only available in 330+")

Also should remove the (now unnecessary) import change.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, it was removed now.

Signed-off-by: sperlingxx <lovedreamf@gmail.com>
@sperlingxx
Copy link
Collaborator Author

build

Signed-off-by: sperlingxx <lovedreamf@gmail.com>
@sperlingxx
Copy link
Collaborator Author

build

jlowe
jlowe previously approved these changes Jan 28, 2022
Signed-off-by: sperlingxx <lovedreamf@gmail.com>
@sperlingxx
Copy link
Collaborator Author

build

@revans2
Copy link
Collaborator

revans2 commented Feb 7, 2022

@tgravescs do you plan on handling updating the 2.x explain or do we need to start enforcing it on new PRs?

@sperlingxx sperlingxx merged commit 43d26cc into NVIDIA:branch-22.04 Feb 8, 2022
@sperlingxx sperlingxx deleted the add_str_byteLen branch February 8, 2022 02:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
audit_3.3.0 Audit related tasks for 3.3.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Audit][FEA][SPARK-36751] Accelerate more flavors of string length like bit_length
4 participants