Skip to content

Commit

Permalink
remove configs from databricks that shouldn't be used by default (NVI…
Browse files Browse the repository at this point in the history
…DIA#907)

Signed-off-by: Thomas Graves <tgraves@nvidia.com>
  • Loading branch information
tgravescs authored Oct 2, 2020
1 parent 34c01a1 commit 2d89fd1
Showing 1 changed file with 0 additions and 4 deletions.
4 changes: 0 additions & 4 deletions docs/get-started/getting-started-databricks.md
Original file line number Diff line number Diff line change
Expand Up @@ -42,14 +42,10 @@ We will need to create an initialization script for the cluster that installs th

```bash
spark.plugins com.nvidia.spark.SQLPlugin
spark.sql.parquet.filterPushdown false
spark.rapids.sql.incompatibleOps.enabled true
spark.rapids.memory.pinnedPool.size 2G
spark.task.resource.gpu.amount 0.1
spark.rapids.sql.concurrentGpuTasks 2
spark.locality.wait 0s
spark.hadoop.mapreduce.fileoutputcommitter.algorithm.version 2
spark.executor.extraJavaOptions "-Dai.rapids.cudf.prefer-pinned=true"
```

![Spark Config](../img/sparkconfig.png)
Expand Down

0 comments on commit 2d89fd1

Please sign in to comment.