-
Notifications
You must be signed in to change notification settings - Fork 3
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
CDPD-12081 Upgrade gcs connector to v1.9.17 from upstream in HDP 3.1-maint #8
base: HDP-3.1-maint
Are you sure you want to change the base?
Commits on Nov 1, 2018
-
Configuration menu - View commit details
-
Copy full SHA for 1447c6c - Browse repository at this point
Copy the full SHA 1447c6cView commit details
Commits on Nov 6, 2018
-
Use assertThrows where possible #cleanup
Change on 2018/11/05 by idv <idv@google.com> ------------- Created by MOE: https://github.com/google/moe MOE_MIGRATED_REVID=220160326
Configuration menu - View commit details
-
Copy full SHA for 7babc9b - Browse repository at this point
Copy the full SHA 7babc9bView commit details -
Use 'uri-path' as the default path codec.
Change on 2018/11/05 by idv <idv@google.com> ------------- Created by MOE: https://github.com/google/moe MOE_MIGRATED_REVID=220208182
Configuration menu - View commit details
-
Copy full SHA for 3608d4c - Browse repository at this point
Copy the full SHA 3608d4cView commit details
Commits on Dec 6, 2018
-
Apparently, somebody created "does-not-exist" GCS bucket that caused one of the tests (that expects that this bucket does not exist!) to fail. Change on 2018/12/05 by idv <idv@google.com> ------------- Created by MOE: https://github.com/google/moe MOE_MIGRATED_REVID=224261022
Configuration menu - View commit details
-
Copy full SHA for 2f580f8 - Browse repository at this point
Copy the full SHA 2f580f8View commit details -
Update GCS connector dependencies to latest versions.
Change on 2018/12/05 by idv <idv@google.com> ------------- Created by MOE: https://github.com/google/moe MOE_MIGRATED_REVID=224262503
Configuration menu - View commit details
-
Copy full SHA for 078cc17 - Browse repository at this point
Copy the full SHA 078cc17View commit details
Commits on Dec 11, 2018
-
Change on 2018/12/10 by idv <idv@google.com> ------------- Created by MOE: https://github.com/google/moe MOE_MIGRATED_REVID=224891096
Configuration menu - View commit details
-
Copy full SHA for cb07768 - Browse repository at this point
Copy the full SHA cb07768View commit details -
Prefetch metadata with only 1 list request.
Change on 2018/12/10 by idv <idv@google.com> ------------- Created by MOE: https://github.com/google/moe MOE_MIGRATED_REVID=224916690
Configuration menu - View commit details
-
Copy full SHA for e522221 - Browse repository at this point
Copy the full SHA e522221View commit details
Commits on Dec 14, 2018
-
Support lazy initialization of GHFS
Change on 2018/12/13 by idv <idv@google.com> ------------- Created by MOE: https://github.com/google/moe MOE_MIGRATED_REVID=225450649
Configuration menu - View commit details
-
Copy full SHA for 8978a99 - Browse repository at this point
Copy the full SHA 8978a99View commit details
Commits on Dec 15, 2018
-
Configuration menu - View commit details
-
Copy full SHA for eb8e5a9 - Browse repository at this point
Copy the full SHA eb8e5a9View commit details
Commits on Dec 17, 2018
-
Remove redundant log message before thrown exception in ResilientOper…
…ation Change on 2018/12/14 by idv <idv@google.com> ------------- Created by MOE: https://github.com/google/moe MOE_MIGRATED_REVID=225564622
Configuration menu - View commit details
-
Copy full SHA for 5068483 - Browse repository at this point
Copy the full SHA 5068483View commit details -
------------- Created by MOE: https://github.com/google/moe MOE_MIGRATED_REVID=225887390
Configuration menu - View commit details
-
Copy full SHA for 0bfa68a - Browse repository at this point
Copy the full SHA 0bfa68aView commit details
Commits on Dec 20, 2018
-
Configuration menu - View commit details
-
Copy full SHA for 15616bf - Browse repository at this point
Copy the full SHA 15616bfView commit details -
Change on 2018/12/18 by idv <idv@google.com> ------------- Created by MOE: https://github.com/google/moe MOE_MIGRATED_REVID=226058870
Configuration menu - View commit details
-
Copy full SHA for c9088d9 - Browse repository at this point
Copy the full SHA c9088d9View commit details -
LSC: Remove or broaden the visibility of @VisibleForTesting annotatio…
…ns which are accessed from production code. These annotations are being violated; they are being removed to allow the introduction of an ErrorProne check which highlights such errors. More information: [] Tested: TAP --sample for global presubmit queue [] Change on 2018/12/19 by ghm <ghm@google.com> ------------- Created by MOE: https://github.com/google/moe MOE_MIGRATED_REVID=226249949
Configuration menu - View commit details
-
Copy full SHA for 2392540 - Browse repository at this point
Copy the full SHA 2392540View commit details -
Configuration menu - View commit details
-
Copy full SHA for fc5b370 - Browse repository at this point
Copy the full SHA fc5b370View commit details -
Release GCS connector 1.9.11 and BQ connector 0.13.11.
Change on 2018/12/20 by dagang <dagang@google.com> ------------- Created by MOE: https://github.com/google/moe MOE_MIGRATED_REVID=226362653
Configuration menu - View commit details
-
Copy full SHA for 9d77d19 - Browse repository at this point
Copy the full SHA 9d77d19View commit details -
Update versions for next connectors release development
Change on 2018/12/20 by dagang <dagang@google.com> ------------- Created by MOE: https://github.com/google/moe MOE_MIGRATED_REVID=226393561
Configuration menu - View commit details
-
Copy full SHA for 03a23eb - Browse repository at this point
Copy the full SHA 03a23ebView commit details -
Configuration menu - View commit details
-
Copy full SHA for f7c90df - Browse repository at this point
Copy the full SHA f7c90dfView commit details
Commits on Dec 21, 2018
-
Configuration menu - View commit details
-
Copy full SHA for 8256670 - Browse repository at this point
Copy the full SHA 8256670View commit details -
Configuration menu - View commit details
-
Copy full SHA for c2df8f3 - Browse repository at this point
Copy the full SHA c2df8f3View commit details
Commits on Dec 23, 2018
-
Configuration menu - View commit details
-
Copy full SHA for 7b52cf8 - Browse repository at this point
Copy the full SHA 7b52cf8View commit details
Commits on Dec 24, 2018
-
Configuration menu - View commit details
-
Copy full SHA for 0cb3521 - Browse repository at this point
Copy the full SHA 0cb3521View commit details
Commits on Dec 25, 2018
-
Configuration menu - View commit details
-
Copy full SHA for 9e572ec - Browse repository at this point
Copy the full SHA 9e572ecView commit details
Commits on Dec 28, 2018
-
Fix GCS connector documentation.
Change on 2018/12/28 by idv <idv@google.com> ------------- Created by MOE: https://github.com/google/moe MOE_MIGRATED_REVID=227151680
Configuration menu - View commit details
-
Copy full SHA for dafb138 - Browse repository at this point
Copy the full SHA dafb138View commit details
Commits on Jan 3, 2019
-
Fixes: GoogleCloudDataproc#22 Change on 2019/01/03 by idv <idv@google.com> ------------- Created by MOE: https://github.com/google/moe MOE_MIGRATED_REVID=227718811
Configuration menu - View commit details
-
Copy full SHA for ab9b5ea - Browse repository at this point
Copy the full SHA ab9b5eaView commit details -
Fix partial read if exception is thrown on last retry.
Change on 2019/01/03 by idv <idv@google.com> ------------- Created by MOE: https://github.com/google/moe MOE_MIGRATED_REVID=227762104
Configuration menu - View commit details
-
Copy full SHA for 55528bc - Browse repository at this point
Copy the full SHA 55528bcView commit details
Commits on Jan 16, 2019
-
Add info logging for failed delete and rename operations.
Customers report their jobs frequently fail because of failed rename and delete operations, but it's impossible to diagnose them, because nothing is logged by default. Change on 2019/01/16 by idv <idv@google.com> ------------- Created by MOE: https://github.com/google/moe MOE_MIGRATED_REVID=229592005
Configuration menu - View commit details
-
Copy full SHA for 6ef6121 - Browse repository at this point
Copy the full SHA 6ef6121View commit details
Commits on Jan 18, 2019
-
Configuration menu - View commit details
-
Copy full SHA for 0e30d8a - Browse repository at this point
Copy the full SHA 0e30d8aView commit details
Commits on Jan 26, 2019
-
Update connectors dependencies.
Change on 2019/01/25 by idv <idv@google.com> ------------- Created by MOE: https://github.com/google/moe MOE_MIGRATED_REVID=230956801
Configuration menu - View commit details
-
Copy full SHA for 6600463 - Browse repository at this point
Copy the full SHA 6600463View commit details -
Change on 2019/01/25 by idv <idv@google.com> ------------- Created by MOE: https://github.com/google/moe MOE_MIGRATED_REVID=230994471
Configuration menu - View commit details
-
Copy full SHA for 5a9ed1c - Browse repository at this point
Copy the full SHA 5a9ed1cView commit details -
1. Correctly initialize contentChannelEnd when reading gzipped file from the beginning. 2. Exit from a read loop if reached object end. Change on 2019/01/25 by idv <idv@google.com> ------------- Created by MOE: https://github.com/google/moe MOE_MIGRATED_REVID=230998166
Configuration menu - View commit details
-
Copy full SHA for 7a7f06e - Browse repository at this point
Copy the full SHA 7a7f06eView commit details -
#cleanup test failure message formatting
Change on 2019/01/25 by idv <idv@google.com> ------------- Created by MOE: https://github.com/google/moe MOE_MIGRATED_REVID=231004001
Configuration menu - View commit details
-
Copy full SHA for 7713969 - Browse repository at this point
Copy the full SHA 7713969View commit details
Commits on Jan 28, 2019
-
Fix for error-prone UnnecessaryParentheses warning
Change on 2019/01/28 by idv <idv@google.com> ------------- Created by MOE: https://github.com/google/moe MOE_MIGRATED_REVID=231227113
Configuration menu - View commit details
-
Copy full SHA for 75ce5ee - Browse repository at this point
Copy the full SHA 75ce5eeView commit details -
Roll-back Apache HTTP Client version to fix integration tests.
Change on 2019/01/28 by idv <idv@google.com> ------------- Created by MOE: https://github.com/google/moe MOE_MIGRATED_REVID=231241840
Configuration menu - View commit details
-
Copy full SHA for 0a6a927 - Browse repository at this point
Copy the full SHA 0a6a927View commit details -
Improve GCS IO exception messages.
Change on 2019/01/28 by idv <idv@google.com> ------------- Created by MOE: https://github.com/google/moe MOE_MIGRATED_REVID=231281876
Configuration menu - View commit details
-
Copy full SHA for fcc8ede - Browse repository at this point
Copy the full SHA fcc8edeView commit details
Commits on Jan 29, 2019
-
Initial set for location restriction. Since the regions do not exist …
…yet, we are only testing for correctness of annotation. Change on 2019/01/28 by sedov <sedov@google.com> ------------- Created by MOE: https://github.com/google/moe MOE_MIGRATED_REVID=231313844
Configuration menu - View commit details
-
Copy full SHA for 1942282 - Browse repository at this point
Copy the full SHA 1942282View commit details -
Improve
testMultipleDeleteBucket
test case.Change on 2019/01/29 by idv <idv@google.com> ------------- Created by MOE: https://github.com/google/moe MOE_MIGRATED_REVID=231419710
Configuration menu - View commit details
-
Copy full SHA for 6b28380 - Browse repository at this point
Copy the full SHA 6b28380View commit details -
Parallelize get and list GCS requests and remove redundant GCS reques…
…ts in GCS FS methods. Change on 2019/01/29 by idv <idv@google.com> ------------- Created by MOE: https://github.com/google/moe MOE_MIGRATED_REVID=231424895
Configuration menu - View commit details
-
Copy full SHA for a1673fd - Browse repository at this point
Copy the full SHA a1673fdView commit details
Commits on Jan 30, 2019
-
Fix bug that could lead to data duplication when reading files with G…
…ZIP content encoding. Change on 2019/01/30 by idv <idv@google.com> ------------- Created by MOE: https://github.com/google/moe MOE_MIGRATED_REVID=231649255
Configuration menu - View commit details
-
Copy full SHA for a711b8f - Browse repository at this point
Copy the full SHA a711b8fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 8d17fe9 - Browse repository at this point
Copy the full SHA 8d17fe9View commit details -
Configuration menu - View commit details
-
Copy full SHA for adf9311 - Browse repository at this point
Copy the full SHA adf9311View commit details
Commits on Feb 4, 2019
-
Inferred directory should always have directory path (ends with "/"). Change on 2019/02/04 by idv <idv@google.com> ------------- Created by MOE: https://github.com/google/moe MOE_MIGRATED_REVID=232300172
Configuration menu - View commit details
-
Copy full SHA for 52f5055 - Browse repository at this point
Copy the full SHA 52f5055View commit details -
Configuration menu - View commit details
-
Copy full SHA for 142c51b - Browse repository at this point
Copy the full SHA 142c51bView commit details -
Configuration menu - View commit details
-
Copy full SHA for e564678 - Browse repository at this point
Copy the full SHA e564678View commit details
Commits on Feb 8, 2019
-
Configuration menu - View commit details
-
Copy full SHA for dcae140 - Browse repository at this point
Copy the full SHA dcae140View commit details -
Clean up Markdown formatting [skip ci]
* use Markdown formatting instead of HTML formatting * added link to search for all questions tagged with `google-cloud-dataproc` on SO
Configuration menu - View commit details
-
Copy full SHA for d3f61ab - Browse repository at this point
Copy the full SHA d3f61abView commit details -
Configuration menu - View commit details
-
Copy full SHA for f33f594 - Browse repository at this point
Copy the full SHA f33f594View commit details -
Fix usages of any(<Primitive>.class) matchers
In Mockito 2, if a method expects a primitive type, but an any(<Primitive>.class) matcher is used in its place, it will throw an error. To prepare for this upcoming breakage, change all existing any(<Primitive>.class) matchers to use the correct any<Primitive>() matcher. For more information see [] Tested: TAP --sample for global presubmit queue [] Change on 2019/02/04 by tvanderlippe <tvanderlippe@google.com> ------------- Created by MOE: https://github.com/google/moe MOE_MIGRATED_REVID=232301764
Configuration menu - View commit details
-
Copy full SHA for 5cabe18 - Browse repository at this point
Copy the full SHA 5cabe18View commit details
Commits on Feb 11, 2019
-
Configuration menu - View commit details
-
Copy full SHA for d9ea4b8 - Browse repository at this point
Copy the full SHA d9ea4b8View commit details -
Use daemon threads for concurrent globbing.
This will prevent Spark jobs from hanging after all work is done. Fixes GoogleCloudDataproc#150: GoogleCloudDataproc#150 Change on 2019/02/11 by idv <idv@google.com> ------------- Created by MOE: https://github.com/google/moe MOE_MIGRATED_REVID=233437145
Configuration menu - View commit details
-
Copy full SHA for 3729769 - Browse repository at this point
Copy the full SHA 3729769View commit details
Commits on Feb 14, 2019
-
Add Hadoop File System extended attributes support.
Change on 2019/02/13 by idv <idv@google.com> ------------- Created by MOE: https://github.com/google/moe MOE_MIGRATED_REVID=233877650
Configuration menu - View commit details
-
Copy full SHA for 02b17d1 - Browse repository at this point
Copy the full SHA 02b17d1View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4a428d5 - Browse repository at this point
Copy the full SHA 4a428d5View commit details -
Configuration menu - View commit details
-
Copy full SHA for e7dfbd9 - Browse repository at this point
Copy the full SHA e7dfbd9View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4e097f2 - Browse repository at this point
Copy the full SHA 4e097f2View commit details
Commits on Feb 21, 2019
-
Configuration menu - View commit details
-
Copy full SHA for c920e4e - Browse repository at this point
Copy the full SHA c920e4eView commit details -
Do not parallelize GCS list requests, because it leads to too high QP…
…S (HTTP 429 reponse). Fixes GoogleCloudDataproc#151
Configuration menu - View commit details
-
Copy full SHA for 1550a05 - Browse repository at this point
Copy the full SHA 1550a05View commit details -
Configuration menu - View commit details
-
Copy full SHA for c2c14e3 - Browse repository at this point
Copy the full SHA c2c14e3View commit details
Commits on Feb 23, 2019
-
Configuration menu - View commit details
-
Copy full SHA for 137337c - Browse repository at this point
Copy the full SHA 137337cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 9e4ace2 - Browse repository at this point
Copy the full SHA 9e4ace2View commit details
Commits on Feb 24, 2019
-
Configuration menu - View commit details
-
Copy full SHA for f81d823 - Browse repository at this point
Copy the full SHA f81d823View commit details
Commits on Feb 25, 2019
-
Eagerly fetch GoogleCloudStorageReadChannel metadata if 'fs.gs.inputs…
…tream.fast.fail.on.not.found.enable' is true
Configuration menu - View commit details
-
Copy full SHA for bde7be4 - Browse repository at this point
Copy the full SHA bde7be4View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6abbb16 - Browse repository at this point
Copy the full SHA 6abbb16View commit details
Commits on May 15, 2019
-
Configuration menu - View commit details
-
Copy full SHA for dd6b3cc - Browse repository at this point
Copy the full SHA dd6b3ccView commit details -
BigQuery connector: support nested record type in field schema.
Fixes GoogleCloudDataproc#144 Change on 2019/04/26 by dagang <dagang@google.com> ------------- Created by MOE: https://github.com/google/moe MOE_MIGRATED_REVID=245520498
Configuration menu - View commit details
-
Copy full SHA for 018749f - Browse repository at this point
Copy the full SHA 018749fView commit details -
Initialize metadata in GoogleCloudStorageReadChannel.size() method, i…
…f it wasn't initialized before. Change on 2019/05/13 by idv <idv@google.com> ------------- Created by MOE: https://github.com/google/moe MOE_MIGRATED_REVID=247978825
Configuration menu - View commit details
-
Copy full SHA for 152ff92 - Browse repository at this point
Copy the full SHA 152ff92View commit details -
Add property to parallelize GCS requests in
listStatus
and `getFile……Status` methods Note: this is essentially the same change as in [] that triggered omg/12873 in the past, but it has feature flag that turns off it by default and tests that assert number of GCS requests when parallelism is enabled. In the worst case `getFileStatus` method can make up to 3 sequential requests to GCS to get implicit directory status. After moving implicit directory repair from list to delete/rename operations this worst case could be more frequent than before, because there higher chance to encounter implicit non-repaired directory: GoogleCloudDataproc#156 This CL adds an option to execute these GCS requests in parallel which could reduce latency by up to 3 times. Change on 2019/05/13 by idv <idv@google.com> ------------- Created by MOE: https://github.com/google/moe MOE_MIGRATED_REVID=248044068
Configuration menu - View commit details
-
Copy full SHA for 1194136 - Browse repository at this point
Copy the full SHA 1194136View commit details -
Configuration menu - View commit details
-
Copy full SHA for e6f742b - Browse repository at this point
Copy the full SHA e6f742bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 6fb7795 - Browse repository at this point
Copy the full SHA 6fb7795View commit details
Commits on May 13, 2020
-
HWX: Modify pom to include HDP version
Conflicts: bigquery/pom.xml gcs/pom.xml util-hadoop/pom.xml util/pom.xml
Configuration menu - View commit details
-
Copy full SHA for 8461dc1 - Browse repository at this point
Copy the full SHA 8461dc1View commit details