CDPD-12385 Add Hadoop File System extended attributes support. #9
Conversation
Change on 2019/02/13 by idv <idv@google.com> ------------- Created by MOE: https://github.com/google/moe MOE_MIGRATED_REVID=233877650 Conflicts: gcs/CHANGES.txt gcs/src/main/java/com/google/cloud/hadoop/fs/gcs/GoogleHadoopFileSystemBase.java
|
Isn't HDP-3.1.5 getting a new version of GCS - 1.9.17?. Does that not have this patch. Otherwise, is there a jira to go with this (HOTFIX maybe?) |
|
QE doesn't have bandwidth to test GCS-1.9.17. So yes we are going with Hotfix approach. |
mukund-thakur
changed the title
|
We don't have any QE support for the hotfixes. So, lets go ahead with just xattrs backport for both hotfix 3.1.5.1.2 and 3.1-maint (unless there is some imp fix in 1.9.17). |
|
I have a preference for using 1.9.17 as is - via the HOTFIX process. There's a few potential perf improvements, and some default config changes. The version this patch was introduced in was marked as 'do-not-use' (doubt this change triggered that though). That said, if you guys want to get this in as is. +1. |
Tested by by building the gcs connector shaded jar locally and putting it into hadoop packaged local distribution. Then ran the command which was failing for the customer.
hadoop fs -Dgoogle.cloud.auth.service.account.enable=true -Dgoogle.cloud.auth.service.account.json.keyfile=gcs_service_account_keyfile.json
-setfattr -n foo -v bar gs://2bc51c33-2800-0b09-0137-4ba34f822fc6/test.txt