Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix match error in RapidsShuffleIterator.scala [scala2.13] #11115

Merged
merged 1 commit into from
Jul 1, 2024

Conversation

xieshuaihu
Copy link
Contributor

Fix #11103

In scala2.13, scala.collection.Seq is not same with Seq which is scala.collection.immutable.Seq, so the former couldn't match the latter.

Signed-off-by: xieshuaihu <xieshuaihu@gmail.com>
@xieshuaihu
Copy link
Contributor Author

@pxLi @abellina
The original pr was stale, so I created a new one.

@pxLi
Copy link
Collaborator

pxLi commented Jul 1, 2024

build

@pxLi pxLi added the bug Something isn't working label Jul 1, 2024
Copy link
Collaborator

@pxLi pxLi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks!

@pxLi pxLi requested a review from abellina July 1, 2024 08:39
@abellina abellina merged commit f56fe2c into NVIDIA:branch-24.08 Jul 1, 2024
46 checks passed
wjxiz1992 added a commit to nvliyuan/yuali-spark-rapids that referenced this pull request Jul 5, 2024
* Fix match error in RapidsShuffleIterator.scala [scala2.13] (NVIDIA#11115)

Signed-off-by: xieshuaihu <xieshuaihu@gmail.com>

* Spark 4: Handle ANSI mode in sort_test.py (NVIDIA#11099)

* Spark 4: Handle ANSI mode in sort_test.py

Fixes NVIDIA#11027.

With ANSI mode enabled (like the default in Spark 4), one sees that some
tests in `sort_test.py` fail, because they expect ANSI mode to be off.

This commit disables running those tests with ANSI enabled, and add a
separate test for ANSI on/off.

Signed-off-by: MithunR <mithunr@nvidia.com>

* Refactored not to use disable_ansi_mode.

These tests need not be revisited.  They test all combinations of ANSI mode,
including overflow failures.

Signed-off-by: MithunR <mithunr@nvidia.com>

---------

Signed-off-by: MithunR <mithunr@nvidia.com>

* Introduce LORE framework. (NVIDIA#11084)

* Introduce lore id

* Introduce lore id

* Fix type

* Fix type

* Conf

* style

* part

* Dump

* Introduce lore framework

* Add tests.

* Rename test case

Signed-off-by: liurenjie1024 <liurenjie2008@gmail.com>

* Fix AQE test

* Fix style

* Use args to display lore info.

* Fix build break

* Fix path in loreinfo

* Remove path

* Fix comments

* Update configs

* Fix comments

* Fix config

---------

Signed-off-by: liurenjie1024 <liurenjie2008@gmail.com>

* Support minBy on GPU

Signed-off-by: Firestarman <firestarmanllc@gmail.com>

---------

Signed-off-by: xieshuaihu <xieshuaihu@gmail.com>
Signed-off-by: MithunR <mithunr@nvidia.com>
Signed-off-by: liurenjie1024 <liurenjie2008@gmail.com>
Signed-off-by: Firestarman <firestarmanllc@gmail.com>
Co-authored-by: xieshuaihu <xieshuaihu@gmail.com>
Co-authored-by: MithunR <mithunr@nvidia.com>
Co-authored-by: Renjie Liu <liurenjie2008@gmail.com>
Co-authored-by: Firestarman <firestarmanllc@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BUG] UCX Shuffle With scala.MatchError
3 participants