[BUG] RLike integration tests failing on Azure Databricks 7.3

[andygrove]

Describe the bug

string_test.py::test_rlike

07:14:27  21/10/20 12:22:16 ERROR GpuOverrideUtil: Encountered an exception applying GPU overrides java.lang.IllegalArgumentException: Part of the plan is not columnar class org.apache.spark.sql.execution.ProjectExec
07:14:27  Project [a#1930890 RLIKE a{2} AS a RLIKE a{2}#1930892, a#1930890 RLIKE a{1,3} AS a RLIKE a{1,3}#1930893, a#1930890 RLIKE a{1,} AS a RLIKE a{1,}#1930894, a#1930890 RLIKE a[bc]d AS a RLIKE a[bc]d#1930895]
07:14:27  +- Scan ExistingRDD[a#1930890]

string_test.py::test_rlike_escape

07:14:27  21/10/20 12:22:16 ERROR GpuOverrideUtil: Encountered an exception applying GPU overrides java.lang.IllegalArgumentException: Part of the plan is not columnar class org.apache.spark.sql.execution.ProjectExec
07:14:27  Project [a#1930904 RLIKE a[\-] AS a RLIKE a[\-]#1930906]
07:14:27  +- Scan ExistingRDD[a#1930904]

Steps/Code to reproduce bug
Run CI

Expected behavior
Tests should pass

Environment details (please complete the following information)
TBD

Additional context
Internal link to CI logs: https://blossom.nvidia.com/sw-gpu-spark-jenkins/job/rapids_it-AzureDatabricks-7.3/170/consoleFull

[andygrove]

I tried testing this on Databricks 7.3 and 8.2 on AWS because it is easier to test there. However, these tests passed in both cases.

[andygrove]

I also cannot reproduce on Databricks 7.3 on Azure, at least when just running the rlike tests:

+ python /home/ubuntu/spark-rapids/integration_tests/runtests.py --rootdir /home/ubuntu/spark-rapids/integration_tests /home/ubuntu/spark-rapids/integration_tests/src/main/python -n 4 -v -rfExXs '' --std_input_path=/home/ubuntu/spark-rapids/integration_tests/src/test/resources --color=yes '' --runtime_env=databricks --test_type=nightly -k test_rlike
============================================================================================================================================================================ test session starts ============================================================================================================================================================================
platform linux -- Python 3.7.10, pytest-6.2.5, py-1.10.0, pluggy-1.0.0 -- /databricks/conda/envs/databricks-ml-gpu/bin/python
cachedir: .pytest_cache
rootdir: /home/ubuntu/spark-rapids/integration_tests, configfile: pytest.ini
plugins: ordering-0.6, xdist-2.4.0, forked-1.3.0
[gw0] linux Python 3.7.10 cwd: /home/ubuntu/spark-rapids/integration_tests/target/run_dir
[gw1] linux Python 3.7.10 cwd: /home/ubuntu/spark-rapids/integration_tests/target/run_dir
[gw2] linux Python 3.7.10 cwd: /home/ubuntu/spark-rapids/integration_tests/target/run_dir
[gw3] linux Python 3.7.10 cwd: /home/ubuntu/spark-rapids/integration_tests/target/run_dir
[gw2] Python 3.7.10 (default, Jun  4 2021, 14:48:32)  -- [GCC 7.5.0]
[gw1] Python 3.7.10 (default, Jun  4 2021, 14:48:32)  -- [GCC 7.5.0]
[gw0] Python 3.7.10 (default, Jun  4 2021, 14:48:32)  -- [GCC 7.5.0]
[gw3] Python 3.7.10 (default, Jun  4 2021, 14:48:32)  -- [GCC 7.5.0]
gw0 [5] / gw1 [5] / gw2 [5] / gw3 [5]
scheduling tests via LoadScheduling

../../src/main/python/string_test.py::test_rlike 
../../src/main/python/string_test.py::test_rlike_multi_line 
../../src/main/python/string_test.py::test_rlike_missing_escape 
../../src/main/python/string_test.py::test_rlike_escape 
[gw2] [ 20%] PASSED ../../src/main/python/string_test.py::test_rlike 
../../src/main/python/string_test.py::test_rlike_nothing_to_repeat 
[gw1] [ 40%] PASSED ../../src/main/python/string_test.py::test_rlike_escape 
[gw3] [ 60%] XFAIL ../../src/main/python/string_test.py::test_rlike_missing_escape 
[gw0] [ 80%] XFAIL ../../src/main/python/string_test.py::test_rlike_multi_line 
[gw2] [100%] XFAIL ../../src/main/python/string_test.py::test_rlike_nothing_to_repeat