Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

System index reads in separate threadpool #60927

Merged
merged 14 commits into from
Aug 11, 2020

Commits on Aug 10, 2020

  1. System index reads in separate threadpool

    This commit introduces a new thread pool, `system_read`, which is
    intended for use by system indices for all read operations (get and
    search). The `system_read` pool is a fixed thread pool with a maximum
    number of threads equal to lesser of half of the available processors
    or 5. Given the combination of both get and read operations in this
    thread pool, the queue size has been set to 2000. The motivation for
    this change is to allow system read operations to be serviced in spite
    of the number of user searches.
    
    In order to avoid a significant performance hit due to pattern matching
    on all search requests, a new metadata flag is added to mark indices
    as system or non-system. Previously created system indices will have
    flag added to their metadata upon upgrade to a version with this
    capability.
    
    Additionally, this change also introduces a new class, `SystemIndices`,
    which encapsulates logic around system indices. Currently, the class
    provides a method to check if an index is a system index and a method
    to find a matching index descriptor given the name of an index.
    
    Relates elastic#50251
    Relates elastic#37867
    Backport of elastic#57936
    jaymode committed Aug 10, 2020
    Configuration menu
    Copy the full SHA
    b0b1200 View commit details
    Browse the repository at this point in the history
  2. reenable bwc tests

    jaymode committed Aug 10, 2020
    Configuration menu
    Copy the full SHA
    e9e5a29 View commit details
    Browse the repository at this point in the history
  3. types

    jaymode committed Aug 10, 2020
    Configuration menu
    Copy the full SHA
    0885cde View commit details
    Browse the repository at this point in the history
  4. add type param

    jaymode committed Aug 10, 2020
    Configuration menu
    Copy the full SHA
    9d868e2 View commit details
    Browse the repository at this point in the history
  5. warnings

    jaymode committed Aug 10, 2020
    Configuration menu
    Copy the full SHA
    46d69d7 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    d6a762c View commit details
    Browse the repository at this point in the history
  7. set number of shards for 6x

    jaymode committed Aug 10, 2020
    Configuration menu
    Copy the full SHA
    51d96e0 View commit details
    Browse the repository at this point in the history
  8. test fixes

    jaymode committed Aug 10, 2020
    Configuration menu
    Copy the full SHA
    a98543a View commit details
    Browse the repository at this point in the history

Commits on Aug 11, 2020

  1. more test fixes

    jaymode committed Aug 11, 2020
    Configuration menu
    Copy the full SHA
    b1b22f9 View commit details
    Browse the repository at this point in the history
  2. only for pre-7

    jaymode committed Aug 11, 2020
    Configuration menu
    Copy the full SHA
    0980367 View commit details
    Browse the repository at this point in the history
  3. proper upgrade from version

    jaymode committed Aug 11, 2020
    Configuration menu
    Copy the full SHA
    d05588a View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    524d083 View commit details
    Browse the repository at this point in the history
  5. maybe

    jaymode committed Aug 11, 2020
    Configuration menu
    Copy the full SHA
    22d1fac View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    c585a37 View commit details
    Browse the repository at this point in the history