Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Backport 7.x] Increase Size and lower TTL on DLS BitSet Cache #50953

Merged
merged 1 commit into from
Jan 14, 2020
Merged

[Backport 7.x] Increase Size and lower TTL on DLS BitSet Cache #50953

merged 1 commit into from
Jan 14, 2020

Commits on Jan 14, 2020

  1. Increase Size and lower TTL on DLS BitSet Cache 

    The Document Level Security BitSet Cache (see elastic#43669) had a default
configuration of "small size, long lifetime". However, this is not
a very useful default as the cache is most valuable for BitSets that
take a long time to construct, which is (generally speaking) the same
ones that operate over a large number of documents and contain many
bytes.

This commit changes the cache to be "large size, short lifetime" so
that it can hold bitsets representing billions of documents, but
releases memory quickly.

The new defaults are 10% of heap, and 2 hours.

This also adds some logging when a single BitSet exceeds the size of
the cache and when the cache is full.

Resolves: elastic#49260
Backport of: elastic#50535
    @tvernum
    tvernum committed Jan 14, 2020
    Configuration menu
    Copy the full SHA
    e603a16 View commit details
    Browse the repository at this point in the history