Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GH-34385: [Go] Read IPC files with compression enabled but uncompressed buffers #34476

Merged
merged 2 commits into from
Mar 7, 2023

Conversation

zeroshade
Copy link
Member

@zeroshade zeroshade commented Mar 6, 2023

Rationale for this change

Fixing a bug in compressing buffers by prepending -1 when a buffer is not compressed due to size.

Are these changes tested?

Unit tests added, and other tests will be enabled via integration tests in #15194

@github-actions
Copy link

github-actions bot commented Mar 6, 2023

@github-actions
Copy link

github-actions bot commented Mar 6, 2023

⚠️ GitHub issue #34385 has been automatically assigned in GitHub to PR creator.

@github-actions github-actions bot added the awaiting review Awaiting review label Mar 6, 2023
Copy link
Member

@lidavidm lidavidm left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we unskip the integration tests here?

Comment on lines 184 to 185
// Note that enabling this option may result in unreadable data for Arrow
// C++ versions prior to 12.0.0.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Doesn't this also apply to go? (Or else, why did we have problems in the integration test if this only affected C++ readers?)

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

gah, my fault for copying the comment, i'll fix it and update.

@github-actions github-actions bot added awaiting committer review Awaiting committer review and removed awaiting review Awaiting review labels Mar 7, 2023
@lidavidm
Copy link
Member

lidavidm commented Mar 7, 2023

Hmm, looks like CGO is having issues across multiple PRs

@zeroshade
Copy link
Member Author

@lidavidm Yea, looks like the issue is that macOS is missing the openssl lib for some reason, I 'll open a PR for it soon

@zeroshade
Copy link
Member Author

Addressed the failing macos issue with #34488

@zeroshade zeroshade merged commit 864ba82 into apache:main Mar 7, 2023
@ursabot
Copy link

ursabot commented Mar 8, 2023

Benchmark runs are scheduled for baseline = f7fbfca and contender = 864ba82. 864ba82 is a master commit associated with this PR. Results will be available as each benchmark for each run completes.
Conbench compare runs links:
[Finished ⬇️0.0% ⬆️0.0%] ec2-t3-xlarge-us-east-2
[Failed ⬇️0.21% ⬆️0.0%] test-mac-arm
[Finished ⬇️0.0% ⬆️0.0%] ursa-i9-9960x
[Finished ⬇️0.41% ⬆️0.13%] ursa-thinkcentre-m75q
Buildkite builds:
[Finished] 864ba822 ec2-t3-xlarge-us-east-2
[Finished] 864ba822 test-mac-arm
[Finished] 864ba822 ursa-i9-9960x
[Finished] 864ba822 ursa-thinkcentre-m75q
[Finished] f7fbfcaf ec2-t3-xlarge-us-east-2
[Failed] f7fbfcaf test-mac-arm
[Finished] f7fbfcaf ursa-i9-9960x
[Finished] f7fbfcaf ursa-thinkcentre-m75q
Supported benchmarks:
ec2-t3-xlarge-us-east-2: Supported benchmark langs: Python, R. Runs only benchmarks with cloud = True
test-mac-arm: Supported benchmark langs: C++, Python, R
ursa-i9-9960x: Supported benchmark langs: Python, R, JavaScript
ursa-thinkcentre-m75q: Supported benchmark langs: C++, Java

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Go] Read IPC files with compression enabled but uncompressed buffers
3 participants