Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove the struct support in ORC reader #3079

Merged
merged 1 commit into from
Jul 29, 2021

Conversation

firestarman
Copy link
Collaborator

We do this because of the issue #3059, which seems not to be easy to fix in a short time.

closes #3059

Signed-off-by: Firestarman firestarmanllc@gmail.com

We do this because of the issue NVIDIA#3059,
which seems not to be easy to fix in a short time.

Signed-off-by: Firestarman <firestarmanllc@gmail.com>
@firestarman
Copy link
Collaborator Author

I will take care of the issue #3059 when enabling the struct support in the future PR for 21.10.

@firestarman
Copy link
Collaborator Author

build

@firestarman firestarman changed the title Disable the struct support for orc reader Disable the struct support in orc reader Jul 29, 2021
@firestarman firestarman changed the title Disable the struct support in orc reader Disable the struct support in ORC reader Jul 29, 2021
@firestarman firestarman changed the title Disable the struct support in ORC reader Remove the struct support in ORC reader Jul 29, 2021
@pxLi pxLi added bug Something isn't working test Only impacts tests labels Jul 29, 2021
@tgravescs
Copy link
Collaborator

we need an issue to track putting this back and specifically also make sure the test failure gets fixed.

@tgravescs
Copy link
Collaborator

reopened #2879

@jlowe jlowe merged commit f8ba1ba into NVIDIA:branch-21.08 Jul 29, 2021
@firestarman
Copy link
Collaborator Author

reopened #2879

Thanks

@firestarman firestarman deleted the orc-read branch July 30, 2021 09:24
firestarman added a commit to firestarman/spark-rapids that referenced this pull request Aug 9, 2021
Also add tests for the nested predicate pushdown, and
the support for nested column pruning.

Relevant PRs:
  NVIDIA#3079
  NVIDIA#2887

Signed-off-by: Firestarman <firestarmanllc@gmail.com>
firestarman added a commit to firestarman/spark-rapids that referenced this pull request Aug 11, 2021
Also add tests for the nested predicate pushdown, and
the support for nested column pruning.

Relevant PRs:
  NVIDIA#3079
  NVIDIA#2887

Signed-off-by: Firestarman <firestarmanllc@gmail.com>
firestarman added a commit to firestarman/spark-rapids that referenced this pull request Aug 17, 2021
Also add tests for the nested predicate pushdown, and
the support for nested column pruning.

Relevant PRs:
  NVIDIA#3079
  NVIDIA#2887

Signed-off-by: Firestarman <firestarmanllc@gmail.com>
firestarman added a commit to firestarman/spark-rapids that referenced this pull request Aug 20, 2021
Also add tests for the nested predicate pushdown, and
the support for nested column pruning.

Relevant PRs:
  NVIDIA#3079
  NVIDIA#2887

Signed-off-by: Firestarman <firestarmanllc@gmail.com>
firestarman added a commit that referenced this pull request Aug 27, 2021
* Re-enable the struct support for the orc reader.

Also add tests for the nested predicate pushdown, and
the support for nested column pruning.

Relevant PRs:
  #3079
  #2887

Signed-off-by: Firestarman <firestarmanllc@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working test Only impacts tests
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BUG] orc_test:test_pred_push_round_trip failed
5 participants