-
Notifications
You must be signed in to change notification settings - Fork 75
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Handle nullable dictionaries in modular #2643
Conversation
@@ -668,7 +668,7 @@ export interface CreateCompletionRequest { | |||
* between -1 and 1 should decrease or increase likelihood of selection; values like -100 or 100 | |||
* should result in a ban or exclusive selection of the relevant token. | |||
*/ | |||
logitBias?: Record<string, number>; | |||
logitBias?: Record<string, number> | null; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This issue isn't raised up because this happened in input model so converting Record<string, number>
to Record<string, number> | null
will have no issue.
But we would have compile error if happened for output models.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Not related to this pr but I found the original typespec is
logit_bias?: Record<safeint> | null;
and there's no @clientName
decorator, we just automatically normalize the name in Modular layer, wonder if that's expected?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
interesting finding, i created an issue for that #2645. let's talk there.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM, a minor comment.
Handle the nullable dictionary in modular.
fix the azure fleet build issue.