Skip to content

Commit

Permalink
resolve comments
Browse files Browse the repository at this point in the history
  • Loading branch information
wjxiz1992 committed Apr 10, 2021
1 parent 6b3ac56 commit ea09abf
Showing 1 changed file with 4 additions and 4 deletions.
8 changes: 4 additions & 4 deletions docs/additional-functionality/rapids-udfs.md
Original file line number Diff line number Diff line change
Expand Up @@ -270,10 +270,10 @@ The following configuration settings are also relevant for GPU scheduling for Pa
+- GpuArrowEvalPython
```
This means each Spark task will trigger 2 Python processes. In this case, if we set
`spark.rapids.sql.concurrentGpuTasks=2` and `concurrentPythonWorkers=2`, it will also probably
result in a hang as we allow 2 tasks running and each of them has 2 Python processes. Let's say
Task_1_Process_1 and Task_2_Process_1 acquired the semaphore, but neither of them are going to
proceed becasue both of them are waiting for their second semaphore.
`concurrentPythonWorkers=2`, it will also probably result in a hang as we allow 2 tasks running
and each of them has 2 Python processes. Let's say Task_1_Process_1 and Task_2_Process_1
acquired the semaphore, but neither of them are going to proceed becasue both of them are
waiting for their second semaphore.
To find details on the above Python configuration settings, please see the [RAPIDS Accelerator for
Apache Spark Configuration Guide](../configs.md). Search 'pandas' for a quick navigation jump.

0 comments on commit ea09abf

Please sign in to comment.