Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEA] Port cuIO to cudf::column types #2954

Closed
3 of 5 tasks
j-ieong opened this issue Oct 3, 2019 · 2 comments
Closed
3 of 5 tasks

[FEA] Port cuIO to cudf::column types #2954

j-ieong opened this issue Oct 3, 2019 · 2 comments
Labels
cuIO cuIO issue feature request New feature or request

Comments

@j-ieong
Copy link
Contributor

j-ieong commented Oct 3, 2019

Is your feature request related to a problem? Please describe.
This issue tracks the effort for moving cuIO (readers, writers, tests) to using the new column design and associated infrastructure.

Describe the solution you'd like
Currently, cuIO uses wrappers around the C-style gdf_column to aid in storing/accessing column metadata and allocating/deallocating memory. We should be able to get rid of the custom C++ wrappers and directly use the cudf::column and cudf::table.

Prerequisites:

Describe alternatives you've considered
We may or may not need some sort of temporary wrapper or custom column class still within cuIO to temporary hold column metadata that's format-specific, for delayed column creation to save memory or other usage. The returned columns will be cudf::column and cudf:;table though.

Additional context
See other porting efforts for libcudf.

@j-ieong j-ieong added feature request New feature or request cuIO cuIO issue tech debt labels Oct 3, 2019
@j-ieong j-ieong changed the title [FEA] Port IO readers and writers to cudf::column and cudf::table [FEA] Port cuIO to cudf::column types Oct 14, 2019
@mjsamoht
Copy link
Contributor

mjsamoht commented Dec 2, 2019

Moving to 0.12 for remaining tasks.

@mjsamoht
Copy link
Contributor

mjsamoht commented Dec 4, 2019

Closing this issue. Remaining work will be tracked in #3521 and #3522.

@mjsamoht mjsamoht closed this as completed Dec 4, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cuIO cuIO issue feature request New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants