Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] udf_test failed in ucx standalone env #3029

Closed
pxLi opened this issue Jul 27, 2021 · 1 comment
Closed

[BUG] udf_test failed in ucx standalone env #3029

pxLi opened this issue Jul 27, 2021 · 1 comment
Labels
bug Something isn't working test Only impacts tests

Comments

@pxLi
Copy link
Collaborator

pxLi commented Jul 27, 2021

Describe the bug
We are seeing udf_test failures on egx w/ UCX enabled (spark 3.0.2 and 3.1.2)

09:40:25  FAILED ../../src/main/python/udf_test.py::test_iterator_math_udf[Byte] - Asse...
09:40:25  FAILED ../../src/main/python/udf_test.py::test_pandas_scalar_udf_nested_type[Array(Byte)]
09:40:25  FAILED ../../src/main/python/udf_test.py::test_pandas_scalar_udf_nested_type[Array(String)]
09:40:25  FAILED ../../src/main/python/udf_test.py::test_pandas_scalar_udf_nested_type[Array(Struct(['child0', Byte],['child1', String],['child2', Float]))]
09:40:25  FAILED ../../src/main/python/udf_test.py::test_pandas_scalar_udf_nested_type[Struct(['child0', Array(Short)],['child1', Struct(['child0', Byte],['child1', Short],['child2', Integer],['child3', Long],['child4', Float],['child5', Double],['child6', String],['child7', Boolean],['child8', Date],['child9', Timestamp])])]
09:40:25  FAILED ../../src/main/python/udf_test.py::test_pandas_map_udf_nested_type[Array(Short)][IGNORE_ORDER({'local': True})]
09:40:25  FAILED ../../src/main/python/udf_test.py::test_pandas_map_udf_nested_type[Array(Timestamp)][IGNORE_ORDER({'local': True})]
09:40:25  FAILED ../../src/main/python/udf_test.py::test_pandas_map_udf_nested_type[Struct(['child0', Array(Short)],['child1', Struct(['child0', Byte],['child1', Short],['child2', Integer],['child3', Long],['child4', Float],['child5', Double],['child6', String],['child7', Boolean],['child8', Date],['child9', Timestamp])])][IGNORE_ORDER({'local': True})]

detailed log,

09:40:25  cpu = [Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.date...me.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), ...]
09:40:25  gpu = [Row(c_integral=56, c_string='size56', c_fp=56.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.date...me.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[56]], c_array_string=['size56']), ...]
09:40:25  float_check = <function get_float_check.<locals>.<lambda> at 0x7f404041fd30>
09:40:25  path = []
09:40:25  
09:40:25      def _assert_equal(cpu, gpu, float_check, path):
09:40:25          t = type(cpu)
09:40:25          if (t is Row):
09:40:25              assert len(cpu) == len(gpu), "CPU and GPU row have different lengths at {} CPU: {} GPU: {}".format(path, len(cpu), len(gpu))
09:40:25              if hasattr(cpu, "__fields__") and hasattr(gpu, "__fields__"):
09:40:25                  assert cpu.__fields__ == gpu.__fields__, "CPU and GPU row have different fields at {} CPU: {} GPU: {}".format(path, cpu.__fields__, gpu.__fields__)
09:40:25                  for field in cpu.__fields__:
09:40:25                      _assert_equal(cpu[field], gpu[field], float_check, path + [field])
09:40:25              else:
09:40:25                  for index in range(len(cpu)):
09:40:25                      _assert_equal(cpu[index], gpu[index], float_check, path + [index])
09:40:25          elif (t is list):
09:40:25  >           assert len(cpu) == len(gpu), "CPU and GPU list have different lengths at {} CPU: {} GPU: {}".format(path, len(cpu), len(gpu))
09:40:25  �[1m�[31mE           AssertionError: CPU and GPU list have different lengths at [] CPU: 48 GPU: 36�[0m
09:40:25  
09:40:25  �[1m�[31m../../src/main/python/asserts.py�[0m:40: AssertionError
09:40:25  ----------------------------- Captured stdout call -----------------------------
09:40:25  ### CPU RUN ###
09:40:25  ### GPU RUN ###
09:40:25  ### COLLECT: GPU TOOK 0.3872504234313965 CPU TOOK 0.6479439735412598 ###
09:40:25  CPU OUTPUT: [Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=42, c_string='size42', c_fp=42.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[42]], c_array_string=['size42']), Row(c_integral=74, c_string='size74', c_fp=74.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[74]], c_array_string=['size74'])]
09:40:25  GPU OUTPUT: [Row(c_integral=56, c_string='size56', c_fp=56.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[56]], c_array_string=['size56']), Row(c_integral=56, c_string='size56', c_fp=56.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[56]], c_array_string=['size56']), Row(c_integral=56, c_string='size56', c_fp=56.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[56]], c_array_string=['size56']), Row(c_integral=56, c_string='size56', c_fp=56.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[56]], c_array_string=['size56']), Row(c_integral=56, c_string='size56', c_fp=56.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[56]], c_array_string=['size56']), Row(c_integral=56, c_string='size56', c_fp=56.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[56]], c_array_string=['size56']), Row(c_integral=56, c_string='size56', c_fp=56.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[56]], c_array_string=['size56']), Row(c_integral=56, c_string='size56', c_fp=56.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[56]], c_array_string=['size56']), Row(c_integral=56, c_string='size56', c_fp=56.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[56]], c_array_string=['size56']), Row(c_integral=56, c_string='size56', c_fp=56.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[56]], c_array_string=['size56']), Row(c_integral=56, c_string='size56', c_fp=56.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[56]], c_array_string=['size56']), Row(c_integral=56, c_string='size56', c_fp=56.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[56]], c_array_string=['size56']), Row(c_integral=56, c_string='size56', c_fp=56.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[56]], c_array_string=['size56']), Row(c_integral=56, c_string='size56', c_fp=56.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[56]], c_array_string=['size56']), Row(c_integral=56, c_string='size56', c_fp=56.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[56]], c_array_string=['size56']), Row(c_integral=56, c_string='size56', c_fp=56.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[56]], c_array_string=['size56']), Row(c_integral=56, c_string='size56', c_fp=56.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[56]], c_array_string=['size56']), Row(c_integral=56, c_string='size56', c_fp=56.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[56]], c_array_string=['size56']), Row(c_integral=56, c_string='size56', c_fp=56.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[56]], c_array_string=['size56']), Row(c_integral=56, c_string='size56', c_fp=56.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[56]], c_array_string=['size56']), Row(c_integral=56, c_string='size56', c_fp=56.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[56]], c_array_string=['size56']), Row(c_integral=56, c_string='size56', c_fp=56.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[56]], c_array_string=['size56']), Row(c_integral=56, c_string='size56', c_fp=56.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[56]], c_array_string=['size56']), Row(c_integral=56, c_string='size56', c_fp=56.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[56]], c_array_string=['size56']), Row(c_integral=56, c_string='size56', c_fp=56.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[56]], c_array_string=['size56']), Row(c_integral=56, c_string='size56', c_fp=56.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[56]], c_array_string=['size56']), Row(c_integral=56, c_string='size56', c_fp=56.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[56]], c_array_string=['size56']), Row(c_integral=56, c_string='size56', c_fp=56.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[56]], c_array_string=['size56']), Row(c_integral=56, c_string='size56', c_fp=56.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[56]], c_array_string=['size56']), Row(c_integral=56, c_string='size56', c_fp=56.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[56]], c_array_string=['size56']), Row(c_integral=56, c_string='size56', c_fp=56.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[56]], c_array_string=['size56']), Row(c_integral=56, c_string='size56', c_fp=56.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[56]], c_array_string=['size56']), Row(c_integral=56, c_string='size56', c_fp=56.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[56]], c_array_string=['size56']), Row(c_integral=56, c_string='size56', c_fp=56.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[56]], c_array_string=['size56']), Row(c_integral=56, c_string='size56', c_fp=56.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[56]], c_array_string=['size56']), Row(c_integral=88, c_string='size88', c_fp=88.0, c_bool=False, c_date=datetime.date(2021, 4, 2), c_time=datetime.datetime(2021, 4, 2, 0, 0), c_array_array=[[88]], c_array_string=['size88'])]

Steps/Code to reproduce bug
run integration test w/ -k udf_test on egx machine w/ UCX

@pxLi pxLi added bug Something isn't working test Only impacts tests labels Jul 27, 2021
@pxLi
Copy link
Collaborator Author

pxLi commented Jul 27, 2021

looks like there was an orphan process took GPUs, after kill it works fine. I will add more protection to that host to make sure no process was consuming GPUs before test start

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working test Only impacts tests
Projects
None yet
Development

No branches or pull requests

1 participant