Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: error when calculating sha256 on big files #1094

Merged
merged 1 commit into from
May 16, 2024

Conversation

lstocchi
Copy link
Contributor

What does this PR do?

It avoid reading a huge file all at once, resulting in a failure when trying to calculate sha256

Screenshot / video of UI

N/A

What issues does this PR fix or reference?

it resolves #1093

How to test this PR?

  1. download a big model (> 2GB) like granite
  2. start a recipe with the downloaded model (it must already be on disk, otherwise you won't face the issue/fix)

Signed-off-by: lstocchi <lstocchi@redhat.com>
@lstocchi lstocchi requested review from benoitf and a team as code owners May 16, 2024 09:16
@lstocchi lstocchi requested a review from jeffmaury May 16, 2024 09:16
Copy link
Contributor

@jeffmaury jeffmaury left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM but I'm wondering why we check again the SHA once the model has been downloaded

@lstocchi
Copy link
Contributor Author

LGTM but I'm wondering why we check again the SHA once the model has been downloaded

My thought was that one could have a model already in the machine downloaded manually and we verify it before using it, no? Should i remove the check?

@lstocchi
Copy link
Contributor Author

Merging it for the moment so we don't have a broken main branch but let me know what to do

@lstocchi lstocchi merged commit fe447d6 into containers:main May 16, 2024
4 checks passed
@lstocchi lstocchi deleted the i1093 branch May 16, 2024 10:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Error when reading big models when calculating sha256
2 participants