Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

save dev_pred.txt and test_pred.txt for RTE and ANLI #22

Open
ruixiangcui opened this issue Oct 6, 2022 · 2 comments
Open

save dev_pred.txt and test_pred.txt for RTE and ANLI #22

ruixiangcui opened this issue Oct 6, 2022 · 2 comments

Comments

@ruixiangcui
Copy link

Congrats on your great work! I am interested in analyzing the results of T0-3B + IA3's predictions on NLI tasks. I run the command python -m src.pl_train -c t03b.json+anli-r3.json+ia3.json -k exp_name=anli-r3 load_weight="pretrained_checkpoints/t03b_ia3_finish.pt" eval_epoch_interval=20 but only see the dev_scores.json file in the output. How can I also obtain the prediction file of the model? Thanks!
@HaokunLiu
Copy link
Collaborator

Wow, this is a repeated request. I'm sorry I didn't plan for this use case in the beginning. If you have enough bandwidth, would you mind try out the suggestion I had in #3? I can also try to add this functionality, but I am not sure when, maybe in two or three weeks.

@ruixiangcui
Copy link
Author

That would be very helpful if you could provide the support in the future. Thanks a lot!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@HaokunLiu @ruixiangcui