Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update BQIO to a single scheduled executor service reduce threads #23234

Merged
merged 20 commits into from
Oct 15, 2022
Merged

Update BQIO to a single scheduled executor service reduce threads #23234

merged 20 commits into from
Oct 15, 2022

Commits on Sep 14, 2022

  1. Update to a single scheduled executor service to mitigate thread prop… 

    …ogation
    @johnjcasey
    johnjcasey committed Sep 14, 2022
    Configuration menu
    Copy the full SHA
    a7fb056 View commit details
    Browse the repository at this point in the history

  2. run spotless

    @johnjcasey
    johnjcasey committed Sep 14, 2022
    Configuration menu
    Copy the full SHA
    1e062e2 View commit details
    Browse the repository at this point in the history

  3. run spotless

    @johnjcasey
    johnjcasey committed Sep 14, 2022
    Configuration menu
    Copy the full SHA
    f2c95a9 View commit details
    Browse the repository at this point in the history

Commits on Sep 15, 2022

  1. Provide separate scheduled executor

    @johnjcasey
    johnjcasey committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    5b81a10 View commit details
    Browse the repository at this point in the history

Commits on Sep 16, 2022

  1. try scheduled thread pool again

    @johnjcasey
    johnjcasey committed Sep 16, 2022
    Configuration menu
    Copy the full SHA
    97fe2c2 View commit details
    Browse the repository at this point in the history

Commits on Sep 28, 2022

  1. Attempt to mimic Bigquery default scheduled thread pool

    @johnjcasey
    johnjcasey committed Sep 28, 2022
    Configuration menu
    Copy the full SHA
    e606856 View commit details
    Browse the repository at this point in the history

  2. run spotless

    @johnjcasey
    johnjcasey committed Sep 28, 2022
    Configuration menu
    Copy the full SHA
    62b4d5d View commit details
    Browse the repository at this point in the history

  3. update docs

    @johnjcasey
    johnjcasey committed Sep 28, 2022
    Configuration menu
    Copy the full SHA
    1de7feb View commit details
    Browse the repository at this point in the history

Commits on Sep 29, 2022

  1. Refactor Scheduled executor service to its own options file

    @johnjcasey
    johnjcasey committed Sep 29, 2022
    Configuration menu
    Copy the full SHA
    45fa683 View commit details
    Browse the repository at this point in the history

  2. clean up comments, don't accidentally create two scheduled executor s… 

    …ervices
    @johnjcasey
    johnjcasey committed Sep 29, 2022
    Configuration menu
    Copy the full SHA
    d68b2a1 View commit details
    Browse the repository at this point in the history

Commits on Sep 30, 2022

  1. clean up comments

    @johnjcasey
    johnjcasey committed Sep 30, 2022
    Configuration menu
    Copy the full SHA
    863f547 View commit details
    Browse the repository at this point in the history

  2. run spotless

    @johnjcasey
    johnjcasey committed Sep 30, 2022
    Configuration menu
    Copy the full SHA
    b3ce303 View commit details
    Browse the repository at this point in the history

Commits on Oct 5, 2022

  1. Configure scheduled executor to spin up and down core threads to mimi… 

    …c a dynamic thread pool
    @johnjcasey
    johnjcasey committed Oct 5, 2022
    Configuration menu
    Copy the full SHA
    de9acee View commit details
    Browse the repository at this point in the history

Commits on Oct 6, 2022

  1. Run spotless

    @johnjcasey
    johnjcasey committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    100cb78 View commit details
    Browse the repository at this point in the history

  2. add . for checkstyle

    @johnjcasey
    johnjcasey committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    3446728 View commit details
    Browse the repository at this point in the history

Commits on Oct 14, 2022

  1. Merge remote-tracking branch 'origin/master' into bugfix/Beam-21368-r… 

    …educe-gax-threads

# Conflicts:
#	sdks/java/extensions/google-cloud-platform-core/src/main/java/org/apache/beam/sdk/extensions/gcp/options/GcsOptions.java
    @johnjcasey
    johnjcasey committed Oct 14, 2022
    Configuration menu
    Copy the full SHA
    e8b1301 View commit details
    Browse the repository at this point in the history

  2. Update ExecutorOptions to use @lukecwik's unbounded scheduled executor

    @johnjcasey
    johnjcasey committed Oct 14, 2022
    Configuration menu
    Copy the full SHA
    8d9bb75 View commit details
    Browse the repository at this point in the history

  3. revert change to runners/google-cloud-dataflow-java/build.gradle

    @johnjcasey
    johnjcasey committed Oct 14, 2022
    Configuration menu
    Copy the full SHA
    a59e30a View commit details
    Browse the repository at this point in the history

  4. Update comments on options files

    @johnjcasey
    johnjcasey committed Oct 14, 2022
    Configuration menu
    Copy the full SHA
    eb88210 View commit details
    Browse the repository at this point in the history

  5. Update sdks/java/extensions/google-cloud-platform-core/src/main/java/… 

    …org/apache/beam/sdk/extensions/gcp/options/GcsOptions.java
    @lukecwik
    lukecwik committed Oct 14, 2022
    Configuration menu
    Copy the full SHA
    cc869f7 View commit details
    Browse the repository at this point in the history