Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feature(InferenceManager): support specific connection given a provider #1529

Closed
axel7083 opened this issue Aug 12, 2024 · 1 comment · Fixed by #1530
Closed

feature(InferenceManager): support specific connection given a provider #1529

axel7083 opened this issue Aug 12, 2024 · 1 comment · Fixed by #1530
Assignees

Comments

@axel7083
Copy link
Contributor

Is your enhancement related to a problem? Please describe

Currently the InferenceManager support a provider id as argument, however we may have multiple connection per provider.

/**
* The identifier of the container provider to use
*/
providerId?: string;

Describe the solution you'd like

Work is related to #1462

Describe alternatives you've considered

No response

Additional context

No response

@jeffmaury
Copy link
Contributor

Not sure it should be attached here as connection may be selected based on the model requirements

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Archived in project
Development

Successfully merging a pull request may close this issue.

2 participants