Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BUG] non-pinned blocking alloc with spill unit test failed in HostAllocSuite #10075

Closed
NVnavkumar opened this issue Dec 19, 2023 · 0 comments · Fixed by #10150
Closed

[BUG] non-pinned blocking alloc with spill unit test failed in HostAllocSuite #10075

NVnavkumar opened this issue Dec 19, 2023 · 0 comments · Fixed by #10150
Assignees
@jbrennan333
Labels
bug Something isn't working reliability Features to improve reliability or bugs that severly impact the reliability of the plugin

Comments

@NVnavkumar
Copy link
Collaborator

Describe the bug
Saw this unit test fail in pre-merge for #10071.

2023-12-19T00:58:39.8906442Z [2023-12-19T00:57:05.526Z] �[32mArmSuite:�[0m
2023-12-19T00:58:39.8906832Z [2023-12-19T00:57:05.526Z] �[32m- withResource for Option[AutoCloseable]�[0m
2023-12-19T00:58:39.8907177Z [2023-12-19T00:57:05.526Z] �[32m- closeOnExcept single instance�[0m
2023-12-19T00:58:39.8907544Z [2023-12-19T00:57:05.526Z] �[32m- closeOnExcept sequence�[0m
2023-12-19T00:58:39.8907862Z [2023-12-19T00:57:05.526Z] �[32m- closeOnExcept arraybuffer�[0m
2023-12-19T00:58:39.8908276Z [2023-12-19T00:57:05.526Z] �[32m- closeOnExcept suppression single instance�[0m
2023-12-19T00:58:39.8908646Z [2023-12-19T00:57:05.526Z] �[32m- closeOnExcept suppression sequence�[0m
2023-12-19T00:58:39.8909035Z [2023-12-19T00:57:05.526Z] �[32m- closeOnExcept suppression arraybuffer�[0m
2023-12-19T00:58:39.8909284Z [2023-12-19T00:57:05.526Z] �[32mHostAllocSuite:�[0m
2023-12-19T00:58:39.8909583Z [2023-12-19T00:57:12.058Z] �[32m- simple pinned tryAlloc�[0m
2023-12-19T00:58:39.8909918Z [2023-12-19T00:57:12.624Z] �[32m- simple non-pinned tryAlloc�[0m
2023-12-19T00:58:39.8910210Z [2023-12-19T00:57:13.553Z] �[32m- simple mixed tryAlloc�[0m
2023-12-19T00:58:39.8910553Z [2023-12-19T00:57:14.916Z] �[32m- simple pinned blocking alloc�[0m
2023-12-19T00:58:39.8910912Z [2023-12-19T00:57:16.279Z] �[32m- simple non-pinned blocking alloc�[0m
2023-12-19T00:58:39.8911246Z [2023-12-19T00:57:17.204Z] �[32m- simple mixed blocking alloc�[0m
2023-12-19T00:58:39.8911606Z [2023-12-19T00:57:18.129Z] �[32m- pinned blocking alloc with spill�[0m
2023-12-19T00:58:39.8912119Z [2023-12-19T00:57:21.388Z] �[31m- non-pinned blocking alloc with spill *** FAILED ***�[0m
2023-12-19T00:58:39.8912581Z [2023-12-19T00:57:21.388Z] �[31m  java.util.concurrent.TimeoutException:�[0m
2023-12-19T00:58:39.8913361Z [2023-12-19T00:57:21.388Z] �[31m  at com.nvidia.spark.rapids.HostAllocSuite$TaskThread$TaskThreadTrackingOp.get(HostAllocSuite.scala:111)�[0m
2023-12-19T00:58:39.8914135Z [2023-12-19T00:57:21.388Z] �[31m  at com.nvidia.spark.rapids.HostAllocSuite$AllocOnAnotherThread.waitForAlloc(HostAllocSuite.scala:220)�[0m
2023-12-19T00:58:39.8914804Z [2023-12-19T00:57:21.388Z] �[31m  at com.nvidia.spark.rapids.HostAllocSuite.$anonfun$new$42(HostAllocSuite.scala:602)�[0m
2023-12-19T00:58:39.8915509Z [2023-12-19T00:57:21.388Z] �[31m  at com.nvidia.spark.rapids.HostAllocSuite.$anonfun$new$42$adapted(HostAllocSuite.scala:600)�[0m
2023-12-19T00:58:39.8916023Z [2023-12-19T00:57:21.388Z] �[31m  at com.nvidia.spark.rapids.Arm$.withResource(Arm.scala:29)�[0m
2023-12-19T00:58:39.8916684Z [2023-12-19T00:57:21.388Z] �[31m  at com.nvidia.spark.rapids.HostAllocSuite.$anonfun$new$41(HostAllocSuite.scala:600)�[0m
2023-12-19T00:58:39.8917390Z [2023-12-19T00:57:21.388Z] �[31m  at com.nvidia.spark.rapids.HostAllocSuite.$anonfun$new$41$adapted(HostAllocSuite.scala:592)�[0m
2023-12-19T00:58:39.8917945Z [2023-12-19T00:57:21.388Z] �[31m  at com.nvidia.spark.rapids.Arm$.withResource(Arm.scala:29)�[0m
2023-12-19T00:58:39.8918601Z [2023-12-19T00:57:21.388Z] �[31m  at com.nvidia.spark.rapids.HostAllocSuite.$anonfun$new$40(HostAllocSuite.scala:592)�[0m
2023-12-19T00:58:39.8919233Z [2023-12-19T00:57:21.388Z] �[31m  at org.scalatest.enablers.Timed$$anon$1.timeoutAfter(Timed.scala:127)�[0m
2023-12-19T00:58:39.8919436Z [2023-12-19T00:57:21.388Z] �[31m  ...�[0m
2023-12-19T00:58:39.8919799Z [2023-12-19T00:57:21.949Z] �[32m- mixed blocking alloc with spill�[0m
2023-12-19T00:58:39.8920094Z [2023-12-19T00:57:22.205Z] �[32mGpuDeviceManagerSuite:�[0m
2023-12-19T00:58:39.8920391Z [2023-12-19T00:57:22.205Z] �[32m- Test **** gpu resource�[0m
2023-12-19T00:58:39.8920760Z [2023-12-19T00:57:22.205Z] �[32m- Test **** custom resource missed�[0m
2023-12-19T00:58:39.8921108Z [2023-12-19T00:57:22.205Z] �[32m- Test **** multiple GPUs throws�[0m
2023-12-19T00:58:39.8921428Z [2023-12-19T00:57:22.205Z] �[32m- Test **** custom resource�[0m
2023-12-19T00:58:39.8921741Z [2023-12-19T00:57:22.205Z] �[32mAlluxioConfigReaderSuite:�[0m
2023-12-19T00:58:39.8922084Z [2023-12-19T00:57:22.205Z] �[32m- testReadAlluxioMasterAndPort�[0m
2023-12-19T00:58:39.8922541Z [2023-12-19T00:57:22.205Z] �[32m- testReadAlluxioMasterAndPort, get default port�[0m
2023-12-19T00:58:39.8923039Z [2023-12-19T00:57:22.205Z] �[32m- testReadAlluxioMasterAndPort, cfg does not specify master�[0m
2023-12-19T00:58:39.8923581Z [2023-12-19T00:57:22.205Z] �[32m- testReadAlluxioMasterAndPort, cfg file does not exist�[0m
2023-12-19T00:58:39.8923849Z [2023-12-19T00:57:22.205Z] �[32mAlluxioUtilsSuite:�[0m
2023-12-19T00:58:39.8924199Z [2023-12-19T00:57:22.205Z] �[32m- updateFilesTaskTimeIfAlluxio�[0m
2023-12-19T00:58:39.8924689Z [2023-12-19T00:57:22.205Z] �[32m- updateFilesTaskTimeIfAlluxio, multiple replacing rules�[0m
2023-12-19T00:58:39.8925136Z [2023-12-19T00:57:22.460Z] �[32m- checkIfNeedsReplaced for PathsToReplace map, true�[0m
2023-12-19T00:58:39.8925604Z [2023-12-19T00:57:22.460Z] �[32m- checkIfNeedsReplaced for PathsToReplace map, false�[0m
2023-12-19T00:58:39.8926086Z [2023-12-19T00:57:22.460Z] �[32m- checkIfNeedsReplaced for PathsToReplace map, exception�[0m
2023-12-19T00:58:39.8926612Z [2023-12-19T00:57:22.460Z] �[32m- checkIfNeedsReplaced for PathsToReplace map, invalid setting�[0m
2023-12-19T00:58:39.8927008Z [2023-12-19T00:57:22.460Z] �[32m- autoMountIfNeeded, auto-mount is false�[0m
2023-12-19T00:58:39.8927392Z [2023-12-19T00:57:22.460Z] �[32m- autoMountIfNeeded, auto-mount is true�[0m
2023-12-19T00:58:39.8927752Z [2023-12-19T00:57:22.460Z] �[32mThreadFactoryBuilderTest:�[0m
2023-12-19T00:58:39.8928102Z [2023-12-19T00:57:22.460Z] �[32m- test thread factory builder�[0m
2023-12-19T00:58:39.8928582Z [2023-12-19T00:57:22.460Z] �[36mRun completed in 22 seconds, 132 milliseconds.�[0m
2023-12-19T00:58:39.8928947Z [2023-12-19T00:57:22.460Z] �[36mTotal number of tests run: 35�[0m
2023-12-19T00:58:39.8929282Z [2023-12-19T00:57:22.460Z] �[36mSuites: completed 8, aborted 0�[0m
2023-12-19T00:58:39.8929793Z [2023-12-19T00:57:22.460Z] �[36mTests: succeeded 34, failed 1, canceled 0, ignored 0, pending 0�[0m
2023-12-19T00:58:39.8930074Z [2023-12-19T00:57:22.460Z] �[31m*** 1 TEST FAILED ***�[0m
@NVnavkumar NVnavkumar added bug Something isn't working ? - Needs Triage Need team to review and classify labels Dec 19, 2023
@mattahrens mattahrens removed the ? - Needs Triage Need team to review and classify label Dec 19, 2023
@mattahrens mattahrens added the reliability Features to improve reliability or bugs that severly impact the reliability of the plugin label Jan 3, 2024
@jbrennan333 jbrennan333 mentioned this issue Jan 3, 2024
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@jbrennan333 jbrennan333

Labels
bug Something isn't working reliability Features to improve reliability or bugs that severly impact the reliability of the plugin
Projects
None yet
Milestone
No milestone
3 participants
@mattahrens @jbrennan333 @NVnavkumar