Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refactor catalog/stores so the stores are unaware of the catalog #7664

Open
Tracked by #7663
abellina opened this issue Feb 3, 2023 · 0 comments
Open
Tracked by #7663

Refactor catalog/stores so the stores are unaware of the catalog #7664

abellina opened this issue Feb 3, 2023 · 0 comments
Labels
reliability Features to improve reliability or bugs that severly impact the reliability of the plugin

Comments

@abellina
Copy link
Collaborator

abellina commented Feb 3, 2023

Currently the RapidsBufferStore and subclasses define the spill cadance (who is my spill store) and they also rely on the catalog for unspill. This task is to completely remove the link store->catalog, enforcing a strict catalog->store flow.

We want to then make as much as possible private under the com.nvidia.spark.rapids.spill package. RapidsBufferCatalog has public methods that allow entry into this namespace.

@sameerz sameerz added the ? - Needs Triage Need team to review and classify label Feb 5, 2023
@abellina abellina added the reliability Features to improve reliability or bugs that severly impact the reliability of the plugin label Feb 6, 2023
@sameerz sameerz removed the ? - Needs Triage Need team to review and classify label Feb 7, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
reliability Features to improve reliability or bugs that severly impact the reliability of the plugin
Projects
None yet
Development

No branches or pull requests

2 participants