Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fix tests failures in map_test.py #11026

Closed
Tracked by #11004
razajafri opened this issue Jun 8, 2024 · 1 comment · Fixed by #11097
Closed
Tracked by #11004

Fix tests failures in map_test.py #11026

razajafri opened this issue Jun 8, 2024 · 1 comment · Fixed by #11097
Assignees
@mythrocks
Labels
bug Something isn't working Spark 4.0+ Spark 4.0+ issues

Comments

@razajafri
Copy link
Collaborator 

FAILED ../../../../integration_tests/src/main/python/map_test.py::test_basic_scalar_map_get_map_value
FAILED ../../../../integration_tests/src/main/python/map_test.py::test_get_map_value_numeric_keys
FAILED ../../../../integration_tests/src/main/python/map_test.py::test_get_map_value_supported_keys
FAILED ../../../../integration_tests/src/main/python/map_test.py::test_transform_values
@razajafri razajafri added bug Something isn't working ? - Needs Triage Need team to review and classify labels Jun 8, 2024
@razajafri razajafri mentioned this issue Jun 8, 2024
Open
@razajafri razajafri added the Spark 4.0+ Spark 4.0+ issues label Jun 8, 2024
@mattahrens mattahrens removed the ? - Needs Triage Need team to review and classify label Jun 11, 2024
@mythrocks
Copy link
Collaborator

These tests pass with ANSI mode disabled.

@mythrocks mythrocks self-assigned this Jun 12, 2024
mythrocks added a commit to mythrocks/spark-rapids that referenced this issue Jun 25, 2024
@mythrocks
Prep miscellaneous integ tests for Spark 4
9316347 
Fixes NVIDIA#11020. (grouping_sets_test.py)
Fixes NVIDIA#11023. (dpp_test.py)
Fixes NVIDIA#11025. (date_time_test.py)
Fixes NVIDIA#11026. (map_test.py)

This commit prepares miscellaneous integration tests to be run on Spark
4.

Certain integration tests fail on Spark 4 because of ANSI mode being
enabled by default.  This commit disables ANSI on the failing tests, or
introduces other fixes so that the tests may pass correctly.

Signed-off-by: MithunR <mithunr@nvidia.com>
@mythrocks mythrocks mentioned this issue Jun 25, 2024
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@mythrocks mythrocks

Labels
bug Something isn't working Spark 4.0+ Spark 4.0+ issues
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Fix miscellaneous integ tests for Spark 4 [databricks] mythrocks/spark-rapids
3 participants
@mattahrens @mythrocks @razajafri