Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

How to get the underlying data Vec<> of a column? I need to convert Block or Column to arrow or polars format. #219

Open
wuzhe1234 opened this issue May 20, 2024 · 3 comments
Open

How to get the underlying data Vec<> of a column? I need to convert Block or Column to arrow or polars format. #219

wuzhe1234 opened this issue May 20, 2024 · 3 comments

Comments

@wuzhe1234
Copy link

No description provided.

@wuzhe1234
Copy link
Author

The data attribute of column is private, so I can't get it directly.

@wuzhe1234 wuzhe1234 changed the title How to get the underlying data Vec<> of a column? I need to convert Block or Column to arrow or polars fomat? How to get the underlying data Vec<> of a column? I need to convert Block or Column to arrow or polars format. May 20, 2024
@wuzhe1234
Copy link
Author

right now I need to use column.iter::<u32>()?.map(|x| *x).collect::<Vec<_>>() to get it, will it cause significant performance loss?

@cristhiank
Copy link

This would be a great feature. We're also using the Arrow library, and the current copy approach is affecting performance. Direct integration with Arrow would enhance efficiency.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@cristhiank @wuzhe1234