Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BUG] EGX integration test_collect_list_reductions failures #5240

Closed
tgravescs opened this issue Apr 13, 2022 · 1 comment · Fixed by #5254
Closed

[BUG] EGX integration test_collect_list_reductions failures #5240

tgravescs opened this issue Apr 13, 2022 · 1 comment · Fixed by #5254
Assignees
@sperlingxx
Labels
bug Something isn't working P0 Must have for release

Comments

@tgravescs
Copy link
Collaborator

tgravescs commented Apr 13, 2022 •
edited
Loading

Describe the bug
Tests are failing on 22.06 IT yarn and standalone:

07:47:23  FAILED integration_tests/src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Short]
07:47:23  FAILED integration_tests/src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Long]
07:47:23  FAILED integration_tests/src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Boolean]
07:47:23  FAILED integration_tests/src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Timestamp]
07:47:23  FAILED integration_tests/src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Decimal(7,3)]
07:47:23  FAILED integration_tests/src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Decimal(12,2)]
07:47:23  FAILED integration_tests/src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Array(Byte)]
07:47:23  FAILED integration_tests/src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Array(Short)]
07:47:23  FAILED integration_tests/src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Array(Integer)]
07:47:23  FAILED integration_tests/src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Array(Null)]
07:47:23  FAILED integration_tests/src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Array(Decimal(7,3))]
07:47:23  FAILED integration_tests/src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Array(Decimal(12,2))]
07:47:23  FAILED integration_tests/src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Array(Array(Short))]
07:47:23  FAILED integration_tests/src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Array(Array(String))]
07:47:23  FAILED integration_tests/src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Struct(['child0', Byte],['child1', Short],['child2', Integer],['child3', Long],['child4', Float],['child5', Double],['child6', String],['child7', Boolean],['child8', Date],['child9', Timestamp],['child10', Null])]

07:47:23 E AssertionError: GPU and CPU int values are different at [0, 'collect_list(a)', 0, 'child0']

@tgravescs tgravescs added bug Something isn't working ? - Needs Triage Need team to review and classify P0 Must have for release labels Apr 13, 2022
@tgravescs tgravescs changed the title [BUG] EGX Yarn integration test_collect_list_reductions failures [BUG] EGX integration test_collect_list_reductions failures Apr 13, 2022
@tgravescs
Copy link
Collaborator Author

egx standalone failures as well:

10:23:18  FAILED ../../src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Byte]
10:23:18  FAILED ../../src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Short]
10:23:18  FAILED ../../src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Integer]
10:23:18  FAILED ../../src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Long]
10:23:18  FAILED ../../src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Float]
10:23:18  FAILED ../../src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Double]
10:23:18  FAILED ../../src/main/python/hash_aggregate_test.py::test_collect_list_reductions[String]
10:23:18  FAILED ../../src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Boolean]
10:23:18  FAILED ../../src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Date]
10:23:18  FAILED ../../src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Timestamp]
10:23:18  FAILED ../../src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Decimal(7,3)]
10:23:18  FAILED ../../src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Decimal(12,2)]
10:23:18  FAILED ../../src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Decimal(20,2)]
10:23:18  FAILED ../../src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Array(Byte)]
10:23:18  FAILED ../../src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Array(Short)]
10:23:18  FAILED ../../src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Array(Integer)]
10:23:18  FAILED ../../src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Array(Long)]
10:23:18  FAILED ../../src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Array(Float)]
10:23:18  FAILED ../../src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Array(Double)]
10:23:18  FAILED ../../src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Array(String)]
10:23:18  FAILED ../../src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Array(Boolean)]
10:23:18  FAILED ../../src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Array(Date)]
10:23:18  FAILED ../../src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Array(Timestamp)]
10:23:18  FAILED ../../src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Array(Null)]
10:23:18  FAILED ../../src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Array(Decimal(7,3))]
10:23:18  FAILED ../../src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Array(Decimal(12,2))]
10:23:18  FAILED ../../src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Array(Decimal(20,2))]
10:23:18  FAILED ../../src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Array(Array(Short))]
10:23:18  FAILED ../../src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Array(Array(String))]
10:23:18  FAILED ../../src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Array(Struct(['child0', Byte],['child1', String],['child2', Float]))]
10:23:18  FAILED ../../src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Struct(['child0', Byte],['child1', Short],['child2', Integer],['child3', Long],['child4', Float],['child5', Double],['child6', String],['child7', Boolean],['child8', Date],['child9', Timestamp],['child10', Null])]
10:23:18  FAILED ../../src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Struct(['child0', Byte],['child1', Struct(['child0', Byte],['child1', Short],['child2', Integer],['child3', Long],['child4', Float],['child5', Double],['child6', String],['child7', Boolean],['child8', Date],['child9', Timestamp],['child10', Null])])]
10:23:18  FAILED ../../src/main/python/hash_aggregate_test.py::test_collect_list_reductions[Struct(['child0', Array(Short)],['child1', Double])]

@sameerz sameerz assigned andygrove and sperlingxx and unassigned andygrove Apr 13, 2022
@sameerz sameerz removed the ? - Needs Triage Need team to review and classify label Apr 13, 2022
@sperlingxx sperlingxx mentioned this issue Apr 14, 2022
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@sperlingxx sperlingxx

Labels
bug Something isn't working P0 Must have for release
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Fix the integration test of collect_list_reduction sperlingxx/spark-rapids
4 participants
@andygrove @tgravescs @sperlingxx @sameerz