Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Question]Why we need to merge edge sets after building vamana index? #538

Open
msk-apk opened this issue Apr 9, 2024 · 0 comments
Open
Labels
question Further information is requested

Comments

@msk-apk
Copy link

msk-apk commented Apr 9, 2024

while building the index the diskann paper explains about merging the edge sets of all vamana index graphs after they are built. why there is a need for merging the edge sets? Merging will not create a big graph of all 1B points in memory? What will be the output graph after merge? Like search, during indexing also we will find the closest centroid and add the new vector into that shard? During search, we find the closest medoid and execute the search in the vamana index related to that medoid.

image

@msk-apk msk-apk added the question Further information is requested label Apr 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

1 participant