Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

3818 Delete temporary thumbnail files #9637

Merged
merged 4 commits into from
Feb 14, 2024

Conversation

haarli
Copy link
Contributor

@haarli haarli commented Jun 14, 2023

What this PR does / why we need it:
With S3 storage activated, Dataverse creates temporary thumbnail files (tempFileForRescale*.tmp) for image and PDF ingests. After the thumbnails are uploaded to S3, the temporary files are not deleted. Our tmp directory currently grew up to over 180GB .

This PR deletes the tempFileForRescale*.tmp files silently after they are uploaded to S3.

Which issue(s) this PR closes:

@coveralls
Copy link

Coverage Status

coverage: 20.331% (-0.001%) from 20.332% when pulling ffad284 on MPDL:IQSS/3818_delete_thumbnail_tmp_files into fd190a3 on IQSS:develop.

@pdurbin pdurbin added Feature: File Upload & Handling Size: 3 A percentage of a sprint. 2.1 hours. labels Jun 15, 2023
Copy link
Member

@pdurbin pdurbin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I didn't test this but the code makes sense.

I'm hitting "approve" but this still need to be prioritized.

@haarli I added it near the top of the community column of the backlog. I hope it helps! Thanks for the pull request!

@sekmiller
Copy link
Contributor

@haarli, we'd like to merge this PR. Can you please update this branch with the latest from develop and see if the Jenkins build succeeds? Thanks!

@haarli
Copy link
Contributor Author

haarli commented Jan 29, 2024

@sekmiller Sure, the branch is now updated

@pdurbin
Copy link
Member

pdurbin commented Feb 14, 2024

Tests are passing. Will merge. Because @haarli said it's only a partial fix for #3818 I adjusted the description so the issue isn't closed on merge.

@pdurbin pdurbin merged commit f456e51 into IQSS:develop Feb 14, 2024
10 of 11 checks passed
@pdurbin pdurbin added this to the 6.2 milestone Feb 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Feature: File Upload & Handling Size: 3 A percentage of a sprint. 2.1 hours.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants