Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Not raising error when valid tokenizer not found #11

Merged
merged 4 commits into from
Aug 3, 2023

Conversation

kooyunmo
Copy link
Collaborator

@kooyunmo kooyunmo commented Aug 2, 2023

PR Description

Summary

  • When a valid tokenizer is not found during the checkpoint conversion process, the error is not raised anymore. Instead just gives a warning.
  • Disable styled traceback.

Type of Change

Specify the appropriate type of change and remove irrelevant options.

  • Feature update
  • Documentation update

@kooyunmo kooyunmo requested a review from pigbug419 August 2, 2023 08:12
Copy link
Collaborator

@pigbug419 pigbug419 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM with a small question.

@@ -32,6 +32,7 @@
context_settings={"help_option_names": ["-h", "--help"]},
add_completion=False,
callback=validate_cli_version,
pretty_exceptions_enable=False,
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why did you disable pretty exceptions?

Copy link
Collaborator Author

@kooyunmo kooyunmo Aug 3, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The pretty exception is too verbose and it displays too much info to users. By applying this change, it will show the normal Python traceback. Refer to https://typer.tiangolo.com/tutorial/exceptions/#disable-pretty-exceptions for more info.

@kooyunmo kooyunmo merged commit fe6008b into main Aug 3, 2023
3 checks passed
@kooyunmo kooyunmo deleted the skip-tokenizer-validation branch August 3, 2023 04:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants