Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FEA] Make LZ4_CHUNK_SIZE configurable #2867

Closed
abellina opened this issue Jul 2, 2021 · 1 comment
Closed

[FEA] Make LZ4_CHUNK_SIZE configurable #2867

abellina opened this issue Jul 2, 2021 · 1 comment
Assignees
@jbrennan333
Labels
feature request New feature or request P1 Nice to have for release shuffle things that impact the shuffle plugin

Comments

@abellina
Copy link
Collaborator

abellina commented Jul 2, 2021

Currently LZ4_CHUNK_SIZE is hardcoded to 64KB, but we'd like to be able to configure this to try out different chunk sizes.

This is to create an internal config that makes it possible to change, keeping a 64KB default.
@abellina abellina added feature request New feature or request ? - Needs Triage Need team to review and classify shuffle things that impact the shuffle plugin labels Jul 2, 2021
@abellina abellina self-assigned this Jul 2, 2021
@abellina abellina added this to the July 5 - July 16 milestone Jul 2, 2021
@Salonijain27 Salonijain27 added P1 Nice to have for release and removed ? - Needs Triage Need team to review and classify labels Jul 6, 2021
@sameerz sameerz removed this from the July 5 - July 16 milestone Jul 16, 2021
@abellina abellina assigned jbrennan333 and unassigned abellina Nov 12, 2021
@abellina
Copy link
Collaborator Author

Handled by @jbrennan333 #3757

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@jbrennan333 jbrennan333

Labels
feature request New feature or request P1 Nice to have for release shuffle things that impact the shuffle plugin
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@abellina @sameerz @Salonijain27 @jbrennan333