Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[7.x][Transform] implement throttling in indexer (#55011) #56002

Merged
merged 1 commit into from
Apr 30, 2020

Commits on Apr 30, 2020

  1. [Transform] implement throttling in indexer (elastic#55011)

    implement throttling in async-indexer used by rollup and transform. The added
    docs_per_second parameter is used to calculate a delay before the next
    search request is send. With re-throttle its possible to change the parameter
    at runtime. When stopping a running job, its ensured that despite throttling
    the indexer stops in reasonable time. This change contains the groundwork, but
    does not expose the new functionality.
    
    relates elastic#54862
    # Conflicts:
    #	x-pack/plugin/rollup/src/main/java/org/elasticsearch/xpack/rollup/job/RollupIndexer.java
    #	x-pack/plugin/rollup/src/main/java/org/elasticsearch/xpack/rollup/job/RollupJobTask.java
    #	x-pack/plugin/rollup/src/test/java/org/elasticsearch/xpack/rollup/job/RollupIndexerIndexingTests.java
    #	x-pack/plugin/rollup/src/test/java/org/elasticsearch/xpack/rollup/job/RollupIndexerStateTests.java
    Hendrik Muhs committed Apr 30, 2020
    Configuration menu
    Copy the full SHA
    94733b0 View commit details
    Browse the repository at this point in the history