Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Restored em.find in the the refresh function #4

Conversation

janvanmansum
Copy link

Alternative for the current sleep of one second before setting the workflow lock. It partially reverts a change by @qqmyers from 2018 in which a call to em.find was replaced by em.merge (which is explained by a comment in the function). This turns out to lead to a lot of OptimisticLockExceptions in lockDataset, probably because the increased amount of time between the fetching of Dataset and its persistence in lockDataset.

Reverting this change for the lockDataset-scenario decreased the number of failures because of OptimisticLockException from around 170 out of 700 imports to 0. The sleep of 1 second seems to work, too, but has the disadvantage of increased overall import time (ca 27 hours for 100,000 dataset, so significant).

@qqmyers qqmyers merged commit f6a0ad1 into GlobalDataverseCommunityConsortium:DANS/7564 Mar 12, 2021
qqmyers added a commit that referenced this pull request Mar 12, 2021
qqmyers pushed a commit that referenced this pull request Nov 16, 2021
merge IQSS develop into mdm develop
qqmyers pushed a commit that referenced this pull request Sep 27, 2022
qqmyers pushed a commit that referenced this pull request Nov 3, 2022
pdurbin pushed a commit that referenced this pull request Mar 13, 2023
landreev pushed a commit that referenced this pull request Apr 19, 2024
rewrite :CVocConf docs, explain where to find readme.md
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants