Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

.Net: DotNet: Remove cosmosdb memory store #2239

Merged

Conversation

awharrison-28
Copy link
Contributor

Motivation and Context

CosmosDB memory store is an extremely inefficient and expensive to store vectors in cloud storage.

If a user wishes to use Azure to host a vector indexing service, existing SK Memory alternatives that we recommend are:

Description

Removes CosmosMemoryStore from SK repo.

@awharrison-28 awharrison-28 requested a review from a team as a code owner July 31, 2023 16:49
@shawncal shawncal added .NET Issue or Pull requests regarding .NET code kernel Issues or pull requests impacting the core kernel memory connector labels Jul 31, 2023
@shawncal shawncal changed the title DotNet: Remove cosmosdb memory store .Net: DotNet: Remove cosmosdb memory store Jul 31, 2023
@shawncal shawncal requested a review from dluc July 31, 2023 18:23
@shawncal shawncal self-requested a review July 31, 2023 18:40
@dluc
Copy link
Collaborator

dluc commented Jul 31, 2023

For future visitors: in future, we might reintroduce CosmosDb support via the MongoDb API that supports vector indexes. For now Azure Cognitive Search and Postgres are the best managed options.

@shawncal shawncal added this pull request to the merge queue Aug 1, 2023
Merged via the queue into microsoft:main with commit bfb8b9c Aug 1, 2023
13 checks passed
mkarle pushed a commit to mkarle/semantic-kernel that referenced this pull request Aug 2, 2023
### Motivation and Context
CosmosDB memory store is an extremely inefficient and expensive to store
vectors in cloud storage.

If a user wishes to use Azure to host a vector indexing service,
existing SK Memory alternatives that we recommend are:
- Azure Cognitive Search
- Postgres Memory Store - pg vector can be enabled for Azure Database
for PostgreSQL
https://learn.microsoft.com/en-us/azure/postgresql/flexible-server/how-to-use-pgvector
### Description

<!-- Describe your changes, the overall approach, the underlying design.
These notes will help understanding how your code works. Thanks! -->

Removes CosmosMemoryStore from SK repo. 

<!-- Before submitting this PR, please make sure: -->

- [ ] The code builds clean without any errors or warnings
- [ ] The PR follows the [SK Contribution
Guidelines](https://github.com/microsoft/semantic-kernel/blob/main/CONTRIBUTING.md)
and the [pre-submission formatting
script](https://github.com/microsoft/semantic-kernel/blob/main/CONTRIBUTING.md#development-scripts)
raises no violations
- [ ] All unit tests pass, and I have added new tests where possible
- [ ] I didn't break anyone 😄

---------

Co-authored-by: Gil LaHaye <gillahaye@microsoft.com>
SOE-YoungS pushed a commit to SOE-YoungS/semantic-kernel that referenced this pull request Nov 1, 2023
### Motivation and Context
CosmosDB memory store is an extremely inefficient and expensive to store
vectors in cloud storage.

If a user wishes to use Azure to host a vector indexing service,
existing SK Memory alternatives that we recommend are:
- Azure Cognitive Search
- Postgres Memory Store - pg vector can be enabled for Azure Database
for PostgreSQL
https://learn.microsoft.com/en-us/azure/postgresql/flexible-server/how-to-use-pgvector
### Description

<!-- Describe your changes, the overall approach, the underlying design.
These notes will help understanding how your code works. Thanks! -->

Removes CosmosMemoryStore from SK repo. 

<!-- Before submitting this PR, please make sure: -->

- [ ] The code builds clean without any errors or warnings
- [ ] The PR follows the [SK Contribution
Guidelines](https://github.com/microsoft/semantic-kernel/blob/main/CONTRIBUTING.md)
and the [pre-submission formatting
script](https://github.com/microsoft/semantic-kernel/blob/main/CONTRIBUTING.md#development-scripts)
raises no violations
- [ ] All unit tests pass, and I have added new tests where possible
- [ ] I didn't break anyone 😄

---------

Co-authored-by: Gil LaHaye <gillahaye@microsoft.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kernel Issues or pull requests impacting the core kernel memory connector .NET Issue or Pull requests regarding .NET code
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants