New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

训练过程OOM的问题 #41

Open

Guochry opened this issue Aug 21, 2023 · 1 comment

Guochry commented Aug 21, 2023

您好！我想要在自己的数据集上复现RRHF的工作，用原始脚本用八张A100运行会在训练开始前就报错OOM。以及RRHF的训练可以使用两张A100，打开gradient_checkpointing来实现吗？
万分感谢！

Owner

GanjinZero commented Aug 22, 2023

肯定可以打开gradient_checkpointing
OOM的话你可以再确认下max len的设置

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment