Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Fixes #11015.
Contributes to #11004.
This commit addresses the tests that fail in parquet_test.py, when run on Spark 4.
Some of the tests were failing as a result of [FEA] Support aggregates when ANSI mode is enabled #5114. Those tests have been disabled, at least until we get around to supporting aggregations with ANSI mode enabled.
test_parquet_check_schema_compatibility
fails on Spark 4 regardless of ANSI mode, because it tests implicit type promotions where the read schema includes wider columns than the write schema. This will require new code. The test is disabled until [BUG] Support for wider types in read schemas for Parquet Reads #11512 is addressed.test_parquet_int32_downcast
had an erroneous setup phase that fails in ANSI mode. This has been corrected. The test was refactored to run in ANSI and non-ANSI mode.