Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

enhance data reader logic #218

Open
HarrisChu opened this issue Oct 11, 2022 · 0 comments
Open

enhance data reader logic #218

HarrisChu opened this issue Oct 11, 2022 · 0 comments
Labels
HACKTOBERFEST type/enhancement Type: make the code neat or more efficient

Comments

@HarrisChu
Copy link
Contributor

importer read all the files in concurrent, it would cause below issues:

  1. if there're 1000+ files, it would read too many data, and would OOM.
  2. one goroutine reads one file, if there is only one file, would import slow even if there're many graph clients.
@wey-gu wey-gu mentioned this issue Oct 15, 2022
Closed
@Sophie-Xie Sophie-Xie added the type/enhancement Type: make the code neat or more efficient label Nov 29, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
HACKTOBERFEST type/enhancement Type: make the code neat or more efficient
Projects
hacktoberfest 2023
Status: Todo
hacktoberfest 2024
Status: Todo
Milestone
No milestone
Development

No branches or pull requests
3 participants
@wey-gu @HarrisChu @Sophie-Xie