-
Notifications
You must be signed in to change notification settings - Fork 1.9k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
test: lower low boundary for accuracy in test_calculate_context_similarity_on_non_matching_contexts
#3199
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
For a quick fix of main this is fine.
However, that's interesting. When did that start to fail?
I suppose there has been a new rapidfuzz
version, that is causing this. Let's make sure this is a feature and not a bug
Ok, in the failing tests we're using |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
As this is clearly caused by the new rapidfuzz
version 2.8.0
, let's better add a version pin restriction of <2.8.0
. We also need to create an issue at https://github.com/maxbachmann/RapidFuzz. I'll take care of this. After the issue has been resolved or it turns out this is a feature we can remove the version restriction.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Ok, I looked into the changes of rapidfuzz 2.8.0. This is actually a feature and should enable us to get rid of the code I wrote to boost split overlaps (calculate_context_similarity
's boost_split_overlap
option). I created an issue for that as it would need some tinkering regarding a proper threshold: #3202
Let's reference this issue in the pin comment and merge :-)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Just saw that this dependency entry is a duplicate. Let's merge it with the existing one and add a comment about the issue
…larity_on_non_matching_contexts` (#3199) * Change min value * revert test change and pin rapidfuzz<2.8.0 * duplicate
Related Issues
main
: https://github.com/deepset-ai/haystack/runs/8300467040?check_suite_focus=trueProposed Changes:
test_calculate_context_similarity_on_non_matching_contexts
from 0.99 to 0.98How did you test it?
Notes for the reviewer
pytest.approx
, but that works with equality checks only, not with larger-than checks.Checklist
I documented my code