-
Notifications
You must be signed in to change notification settings - Fork 1.9k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Fix finetuning notebook augmentation #2071
Conversation
Check out this pull request on See visual diffs & provide feedback on Jupyter Notebooks. Powered by ReviewNB |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM! 👍 Please try to run the notebook on colab as a final test: https://colab.research.google.com/github/deepset-ai/haystack/blob/fix-finetuning-notebook-augmentation/tutorials/Tutorial2_Finetune_a_model_on_your_data.ipynb#scrollTo=lHkSOXjBd0fS (with !pip install git+https://github.com/deepset-ai/haystack.git@fix-finetuning-notebook-augmentation
Proposed changes:
Previously, the data augmentation and model distillation parts of the finetuning tutorial were not working due to 2 issues:
LanguageModel
s could actually return hidden states and attentionsThis PR fixes those and uses a different dataset for model distillation in the tutorial to decrease notebook runtime (more than 1 h for distillation before).
Status (please check what you already did):