Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add the MULTI-THREADED reading support for avro #5148

Closed
Tracked by #4831
firestarman opened this issue Apr 6, 2022 · 0 comments · Fixed by #5421
Closed
Tracked by #4831

Add the MULTI-THREADED reading support for avro #5148

firestarman opened this issue Apr 6, 2022 · 0 comments · Fixed by #5421
Assignees
@firestarman
Labels
performance A performance related task/issue

Comments

@firestarman
Copy link
Collaborator

firestarman commented Apr 6, 2022 •
edited
Loading

The base reading for avro is ready, now it is time to support the MULTI-THREADED reading to try to get better performance when reading from cloud, just like what is done in GPU parquet reading.
@firestarman firestarman mentioned this issue Apr 6, 2022
Open
30 tasks
@firestarman firestarman changed the title Add the MULTI-THREADED reading support Add the MULTI-THREADED reading support for avro Apr 6, 2022
@sameerz sameerz added the performance A performance related task/issue label Apr 6, 2022
@firestarman firestarman mentioned this issue Apr 15, 2022
Closed
@firestarman firestarman mentioned this issue May 4, 2022
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@firestarman firestarman

Labels
performance A performance related task/issue
Projects
None yet
Milestone
No milestone
2 participants
@sameerz @firestarman