-
Notifications
You must be signed in to change notification settings - Fork 230
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Fix infinite loop in MultiFileCloudPartitionReaderBase #2873
Conversation
Signed-off-by: Jason Lowe <jlowe@nvidia.com>
build |
Thx Jason, Great catch. Could we have a unit test for this? I believe we don't have such unit test for this. |
Added a unit test that fails with a StackOverflowError without the fix and passes with it. |
build |
sql-plugin/src/main/scala/com/nvidia/spark/rapids/GpuMultiFileReader.scala
Show resolved
Hide resolved
build |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thx Jason
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
While refactoring some code, I stumbled across an infinite loop in the
next()
method forMultiFileCloudPartitionReaderBase
. It recurses to itself without changing any of the state that led to the recursion point.