Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CUDA OOM Error while importing #10

Open
DingYX0731 opened this issue Aug 15, 2024 · 1 comment
Open

CUDA OOM Error while importing #10

DingYX0731 opened this issue Aug 15, 2024 · 1 comment

Comments

@DingYX0731
Copy link

It is so weird that CUDA OOM error happens when importing package!!! My GPU is L20 48GB, which should satisfy the requirement of the experiment. Please help...
When importing from ChatDrug.task_and_evaluation.Conversational_LLMs_utils import complete and from utils import ( construct_PDDS_prompt, load_retrieval_DB, retrieve_and_feedback, load_thredhold ):
image

@DingYX0731
Copy link
Author

Note that I have change the directory of pytorch_model_ss3.bin because the path is not correct after download checkpoint according to README. However, it may not be the cause of oom error. I have observed that before loading model checkpoint, the usage of GPU suddenly comes to more than 95% and then cuda oom when the loaded model is put to the device.

Will the problem related to the tensorflow related warning? I am not familar with tensorflow so I hope someone could give me some hint/instruction. Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant