Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BUG]: ZipCodes_Stops_PiP_cuSpatial failing: "geo_columns.index must equal data_columns.index" #1437

Closed
jameslamb opened this issue Aug 12, 2024 · 1 comment · Fixed by #1438
Closed

[BUG]: ZipCodes_Stops_PiP_cuSpatial failing: "geo_columns.index must equal data_columns.index" #1437

jameslamb opened this issue Aug 12, 2024 · 1 comment · Fixed by #1438
Labels
bug Something isn't working

Comments

@jameslamb
Copy link
Member

jameslamb commented Aug 12, 2024 •
edited
Loading

Version

24.10

On which installation method(s) does this occur?

Conda

Describe the issue

The ZipCodes_Stops_PiP_cuSpatial notebook is failing on 24.10, with the most recent nightlies of cuspatial and all its dependencies for those versions.

Condensed stacktrace:

ValueError                                Traceback (most recent call last)
File /tmp/tmp.wVCpnDUG6u/ZipCodes_Stops_PiP_cuSpatial-test.py:336
    330 stop_by_zipcode = stop_quadtree.point_left_join_polygon(["x", "y"], ["ZCTA5CE10"])
    333 # In[13]:
--> 336 stop_by_zipcode.head()
...
File cudf/utils/performance_tracking.py:51, in _performance_tracking.<locals>.wrapper(*args, **kwargs)
File cudf/core/indexed_frame.py:1255, in IndexedFrame.head(self, n)
File cudf/core/dataframe.py:503, in _DataFrameIlocIndexer.__getitem__(self, arg)
File cuspatial/core/geodataframe.py:195, in GeoDataFrame._slice(self, arg)
File cuspatial/core/geodataframe.py:172, in GeoDataFrame._recombine_columns(self, geo_columns, data_columns)
ValueError: geo_columns.index must equal data_columns.index
full stacktrace (click me) 
---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
File /tmp/tmp.wVCpnDUG6u/ZipCodes_Stops_PiP_cuSpatial-test.py:336
    330 stop_by_zipcode = stop_quadtree.point_left_join_polygon(["x", "y"], ["ZCTA5CE10"])
    333 # In[13]:
--> 336 stop_by_zipcode.head()
    339 # ## Zipcode counting with cuDF
    340 # 
    341 # The below uses [cuDF](https://docs.rapids.ai/api/cudf/stable/index.html) to count the number of stop signs per zip code. Then merge the geometry information from the zipcode dataset.
   (...)
    345 
    346 # Count the Stop Signs by California Zip Codes
    347 stop_counts = stop_by_zipcode.groupby("ZCTA5CE10").x.count().rename("stop_count")

File /opt/conda/envs/test/lib/python3.11/site-packages/cudf/utils/performance_tracking.py:51, in _performance_tracking.<locals>.wrapper(*args, **kwargs)
     43 if nvtx.enabled():
     44     stack.enter_context(
     45         nvtx.annotate(
     46             message=func.__qualname__,
   (...)
     49         )
     50     )
---> 51 return func(*args, **kwargs)

File /opt/conda/envs/test/lib/python3.11/site-packages/cudf/core/indexed_frame.py:1255, in IndexedFrame.head(self, n)
   1178 @_performance_tracking
   1179 def head(self, n=5):
   1180     """
   1181     Return the first `n` rows.
   1182     This function returns the first `n` rows for the object based
   (...)
   1253     1    1  11.0
   1254     """
-> 1255     return self.iloc[:n]

File /opt/conda/envs/test/lib/python3.11/site-packages/cudf/core/dataframe.py:503, in _DataFrameIlocIndexer.__getitem__(self, arg)
    501     return frame._apply_boolean_mask(row_spec.key, keep_index=True)
    502 elif isinstance(row_spec, indexing_utils.SliceIndexer):
--> 503     return frame._slice(row_spec.key)
    504 elif isinstance(row_spec, indexing_utils.ScalarIndexer):
    505     result = frame._gather(row_spec.key, keep_index=True)

File /opt/conda/envs/test/lib/python3.11/site-packages/cuspatial/core/geodataframe.py:195, in GeoDataFrame._slice(self, arg)
    190 sliced_geo_columns = GeoDataFrame(
    191     {name: geo_columns[name].iloc[arg] for name in geo_columns.columns}
    192 )
    193 sliced_data_columns = data_columns._slice(arg)
    194 return self._from_data(
--> 195     self._recombine_columns(sliced_geo_columns, sliced_data_columns),
    196     index=sliced_data_columns.index,
    197 )

File /opt/conda/envs/test/lib/python3.11/site-packages/cuspatial/core/geodataframe.py:172, in GeoDataFrame._recombine_columns(self, geo_columns, data_columns)
    165 """
    166 Combine a GeoDataFrame of only geometry columns with a DataFrame
    167 of non-geometry columns in the same order as the columns in `self`
    168 
    169 The output is meant for GeoDataFrame._from_data.
    170 """
    171 if not geo_columns.index.equals(data_columns.index):
--> 172     raise ValueError("geo_columns.index must equal data_columns.index")
    174 columns_mask = self.columns
    175 col_is_geo = (isinstance(self[col], GeoSeries) for col in columns_mask)

ValueError: geo_columns.index must equal data_columns.index
---------------------------------------------------------------

Minimum reproducible example

Observing this in the conda-notebook-tests job on all PRs targeting 24.10.

Relevant log output

No response

Environment details

output from 'print_env.sh' (click me) 
AWS_ACCESS_KEY_ID=***
AWS_DEFAULT_REGION=us-east-2
AWS_REGION=us-east-2
AWS_SECRET_ACCESS_KEY=***
AWS_SESSION_TOKEN=***
CI=true
CONDA_DEFAULT_ENV=test
CONDA_EXE=/opt/conda/bin/conda
CONDA_PREFIX=/opt/conda/envs/test
CONDA_PROMPT_MODIFIER=(test) 
CONDA_PYTHON_EXE=/opt/conda/bin/python
CONDA_SHLVL=1
CPL_ZIP_ENCODING=UTF-8
CUDA_VERSION=12.2.2
GDAL_DATA=/opt/conda/envs/test/share/gdal
GDAL_DRIVER_PATH=/opt/conda/envs/test/lib/gdalplugins
GH_TOKEN=***
GITHUB_ACTION=__run_3
GITHUB_ACTIONS=true
GITHUB_ACTION_REF=
GITHUB_ACTION_REPOSITORY=
GITHUB_ACTOR=copy-pr-bot[bot]
GITHUB_ACTOR_ID=138252374
GITHUB_API_URL=https://api.github.com
GITHUB_BASE_REF=
GITHUB_ENV=/__w/_temp/_runner_file_commands/set_env_cba6e0db-91ea-4d55-a05b-135fb3ef4631
GITHUB_EVENT_NAME=push
GITHUB_EVENT_PATH=/github/workflow/event.json
GITHUB_GRAPHQL_URL=https://api.github.com/graphql
GITHUB_HEAD_REF=
GITHUB_JOB=build
GITHUB_OUTPUT=/__w/_temp/_runner_file_commands/set_output_cba6e0db-91ea-4d55-a05b-135fb3ef4631
GITHUB_PATH=/__w/_temp/_runner_file_commands/add_path_cba6e0db-91ea-4d55-a05b-135fb3ef4631
GITHUB_REF=refs/heads/pull-request/1430
GITHUB_REF_NAME=pull-request/1430
GITHUB_REF_PROTECTED=false
GITHUB_REF_TYPE=branch
GITHUB_REPOSITORY=rapidsai/cuspatial
GITHUB_REPOSITORY_ID=199666905
GITHUB_REPOSITORY_OWNER=rapidsai
GITHUB_REPOSITORY_OWNER_ID=43887749
GITHUB_RETENTION_DAYS=90
GITHUB_RUN_ATTEMPT=1
GITHUB_RUN_ID=10321935884
GITHUB_RUN_NUMBER=1992
GITHUB_SERVER_URL=https://github.com
GITHUB_SHA=9d7b73823e1e4588c60b02878778fe9bfbd02120
GITHUB_STATE=/__w/_temp/_runner_file_commands/save_state_cba6e0db-91ea-4d55-a05b-135fb3ef4631
GITHUB_STEP_SUMMARY=/__w/_temp/_runner_file_commands/step_summary_cba6e0db-91ea-4d55-a05b-135fb3ef4631
GITHUB_TRIGGERING_ACTOR=copy-pr-bot[bot]
GITHUB_WORKFLOW=pr
GITHUB_WORKFLOW_REF=rapidsai/cuspatial/.github/workflows/pr.yaml@refs/heads/pull-request/1430
GITHUB_WORKFLOW_SHA=9d7b73823e1e4588c60b02878778fe9bfbd02120
GITHUB_WORKSPACE=/__w/cuspatial/cuspatial
GSETTINGS_SCHEMA_DIR=/opt/conda/envs/test/share/glib-2.0/schemas
GSETTINGS_SCHEMA_DIR_CONDA_BACKUP=
HOME=/github/home
HOSTNAME=e069a8f1cf3a
LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64
NVARCH=x86_64
NVIDIA_DRIVER_CAPABILITIES=compute,utility
NVIDIA_REQUIRE_CUDA=cuda>=12.2 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471 brand=tesla,driver>=525,driver<526 brand=unknown,driver>=525,driver<526 brand=nvidia,driver>=525,driver<526 brand=nvidiartx,driver>=525,driver<526 brand=geforce,driver>=525,driver<526 brand=geforcertx,driver>=525,driver<526 brand=quadro,driver>=525,driver<526 brand=quadrortx,driver>=525,driver<526 brand=titan,driver>=525,driver<526 brand=titanrtx,driver>=525,driver<526
NVIDIA_VISIBLE_DEVICES=GPU-f243c8e5-7f90-bbe2-319d-25231849054e
NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-2
NV_CUDA_CUDART_VERSION=12.2.140-1
PATH=/opt/conda/envs/test/bin:/opt/conda/condabin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
PROJ_DATA=/opt/conda/envs/test/share/proj
PROJ_NETWORK=ON
***
PYTHON_VERSION=3.11
RAPIDS_BASE_BRANCH=branch-24.10
RAPIDS_BUILD_TYPE=pull-request
RAPIDS_CONDA_BLD_OUTPUT_DIR=/tmp/conda-bld-output
RAPIDS_CONDA_BLD_ROOT_DIR=/tmp/conda-bld-workspace
RAPIDS_CUDA_VERSION=12.2.2
RAPIDS_NIGHTLY_DATE=
RAPIDS_PY_VERSION=3.11
RAPIDS_REF_NAME=pull-request/1430
RAPIDS_REPOSITORY=rapidsai/cuspatial
RAPIDS_SHA=9d7b73823e1e4588c60b02878778fe9bfbd02120
RUNNER_ARCH=X64
RUNNER_ENVIRONMENT=self-hosted
RUNNER_NAME=linux-amd64-gpu-v100-latest-1-56xmt-runner-wqwws
RUNNER_OS=Linux
RUNNER_TEMP=/__w/_temp
RUNNER_TOOL_CACHE=/__w/_tool
RUNNER_WORKSPACE=/__w/cuspatial
SHLVL=2
XML_CATALOG_FILES=file:///opt/conda/envs/test/etc/xml/catalog file:///etc/xml/catalog
_=/usr/bin/env
_CE_CONDA=
_CE_M=

RAPIDS logger » [08/09/24 16:11:47]
┌──────────────────┐
|    Print arch    |
└──────────────────┘

x86_64

RAPIDS logger » [08/09/24 16:11:47]
┌────────────────────────────┐
|    Check python version    |
└────────────────────────────┘

Python 3.11.9

RAPIDS logger » [08/09/24 16:11:47]
┌───────────────────────────────┐
|    Check conda environment    |
└───────────────────────────────┘


     active environment : test
    active env location : /opt/conda/envs/test
            shell level : 1
       user config file : /github/home/.condarc
 populated config files : /opt/conda/.condarc
          conda version : 24.7.1
    conda-build version : 24.5.1
         python version : 3.11.9.final.0
                 solver : libmamba (default)
       virtual packages : __archspec=1=broadwell
                          __conda=24.7.1=0
                          __cuda=12.4=0
                          __glibc=2.35=0
                          __linux=5.4.0=0
                          __unix=0=0
       base environment : /opt/conda  (writable)
      conda av data dir : /opt/conda/etc/conda
  conda av metadata url : None
           channel URLs : https://conda.anaconda.org/rapidsai/linux-64
                          https://conda.anaconda.org/rapidsai/noarch
                          https://conda.anaconda.org/rapidsai-nightly/linux-64
                          https://conda.anaconda.org/rapidsai-nightly/noarch
                          https://conda.anaconda.org/dask/label/dev/linux-64
                          https://conda.anaconda.org/dask/label/dev/noarch
                          https://conda.anaconda.org/pytorch/linux-64
                          https://conda.anaconda.org/pytorch/noarch
                          https://conda.anaconda.org/conda-forge/linux-64
                          https://conda.anaconda.org/conda-forge/noarch
                          https://conda.anaconda.org/nvidia/linux-64
                          https://conda.anaconda.org/nvidia/noarch
          package cache : /opt/conda/pkgs
                          /github/home/.conda/pkgs
       envs directories : /opt/conda/envs
                          /github/home/.conda/envs
               platform : linux-64
             user-agent : conda/24.7.1 requests/2.32.3 CPython/3.11.9 Linux/5.4.0-189-generic ubuntu/22.04.4 glibc/2.35 solver/libmamba conda-libmamba-solver/24.7.0 libmambapy/1.5.8
                UID:GID : 0:0
             netrc file : None
           offline mode : False


==> /opt/conda/.condarc <==
auto_update_conda: False
channels:
  - rapidsai
  - rapidsai-nightly
  - dask/label/dev
  - pytorch
  - conda-forge
  - nvidia
always_yes: True
number_channel_notices: 0
conda-build:
  set_build_id: False
  root_dir: /tmp/conda-bld-workspace
  output_folder: /tmp/conda-bld-output

==> envvars <==
allow_softlinks: False

# packages in environment at /opt/conda/envs/test:
#
# Name                    Version                   Build  Channel
_libgcc_mutex             0.1                 conda_forge    conda-forge
_openmp_mutex             4.5                       2_gnu    conda-forge
affine                    2.4.0              pyhd8ed1ab_0    conda-forge
anyio                     4.4.0              pyhd8ed1ab_0    conda-forge
argon2-cffi               23.1.0             pyhd8ed1ab_0    conda-forge
argon2-cffi-bindings      21.2.0          py311h459d7ec_4    conda-forge
arrow                     1.3.0              pyhd8ed1ab_0    conda-forge
asttokens                 2.4.1              pyhd8ed1ab_0    conda-forge
async-lru                 2.0.4              pyhd8ed1ab_0    conda-forge
attrs                     24.2.0             pyh71513ae_0    conda-forge
aws-c-auth                0.7.25               hdfe1943_2    conda-forge
aws-c-cal                 0.7.2                h87b94db_0    conda-forge
aws-c-common              0.9.23               h4ab18f5_0    conda-forge
aws-c-compression         0.2.18               he027950_7    conda-forge
aws-c-event-stream        0.4.2               h29f85be_19    conda-forge
aws-c-http                0.8.7                h45b8271_1    conda-forge
aws-c-io                  0.14.18              h6ea103f_1    conda-forge
aws-c-mqtt                0.10.4              h7eb77b2_15    conda-forge
aws-c-s3                  0.6.4                hd923058_5    conda-forge
aws-c-sdkutils            0.1.16               he027950_3    conda-forge
aws-checksums             0.1.18               he027950_7    conda-forge
aws-crt-cpp               0.27.5               hdd22b19_3    conda-forge
aws-sdk-cpp               1.11.379             h82708ae_1    conda-forge
azure-core-cpp            1.13.0               h935415a_0    conda-forge
azure-identity-cpp        1.8.0                hd126650_2    conda-forge
azure-storage-blobs-cpp   12.12.0              hd2e3451_0    conda-forge
azure-storage-common-cpp  12.7.0               h10ac4d7_1    conda-forge
azure-storage-files-datalake-cpp 12.11.0              h325d260_1    conda-forge
babel                     2.14.0             pyhd8ed1ab_0    conda-forge
beautifulsoup4            4.12.3             pyha770c72_0    conda-forge
bleach                    6.1.0              pyhd8ed1ab_0    conda-forge
blosc                     1.21.6               hef167b5_0    conda-forge
bokeh                     3.5.1              pyhd8ed1ab_0    conda-forge
branca                    0.7.2              pyhd8ed1ab_0    conda-forge
brotli                    1.1.0                hd590300_1    conda-forge
brotli-bin                1.1.0                hd590300_1    conda-forge
brotli-python             1.1.0           py311hb755f60_1    conda-forge
bzip2                     1.0.8                h4bc722e_7    conda-forge
c-ares                    1.32.3               h4bc722e_0    conda-forge
ca-certificates           2024.7.4             hbcca054_0    conda-forge
cached-property           1.5.2                hd8ed1ab_1    conda-forge
cached_property           1.5.2              pyha770c72_1    conda-forge
cachetools                5.4.0              pyhd8ed1ab_0    conda-forge
cairo                     1.18.0               h3faef2a_0    conda-forge
certifi                   2024.7.4           pyhd8ed1ab_0    conda-forge
cffi                      1.17.0          py311ha8e6434_0    conda-forge
cfitsio                   4.3.1                hbdc6101_0    conda-forge
charset-normalizer        3.3.2              pyhd8ed1ab_0    conda-forge
click                     8.1.7           unix_pyh707e725_0    conda-forge
click-plugins             1.1.1                      py_0    conda-forge
cligj                     0.7.2              pyhd8ed1ab_1    conda-forge
cloudpickle               3.0.0              pyhd8ed1ab_0    conda-forge
comm                      0.2.2              pyhd8ed1ab_0    conda-forge
contourpy                 1.2.1           py311h9547e67_0    conda-forge
cuda-cccl_linux-64        12.2.140             ha770c72_0    conda-forge
cuda-crt-dev_linux-64     12.2.140             ha770c72_1    conda-forge
cuda-crt-tools            12.2.140             ha770c72_1    conda-forge
cuda-cudart               12.2.140             hd3aeb46_0    conda-forge
cuda-cudart-dev           12.2.140             hd3aeb46_0    conda-forge
cuda-cudart-dev_linux-64  12.2.140             h59595ed_0    conda-forge
cuda-cudart-static        12.2.140             hd3aeb46_0    conda-forge
cuda-cudart-static_linux-64 12.2.140             h59595ed_0    conda-forge
cuda-cudart_linux-64      12.2.140             h59595ed_0    conda-forge
cuda-nvcc-dev_linux-64    12.2.140             ha770c72_1    conda-forge
cuda-nvcc-impl            12.2.140             hd3aeb46_1    conda-forge
cuda-nvcc-tools           12.2.140             hd3aeb46_1    conda-forge
cuda-nvrtc                12.2.140             hd3aeb46_0    conda-forge
cuda-nvvm-dev_linux-64    12.2.140             ha770c72_1    conda-forge
cuda-nvvm-impl            12.2.140             h59595ed_1    conda-forge
cuda-nvvm-tools           12.2.140             h59595ed_1    conda-forge
cuda-profiler-api         12.2.140             ha770c72_0    conda-forge
cuda-python               12.6.0          py311h817de4b_0    conda-forge
cuda-version              12.2                 he2b69de_3    conda-forge
cudf                      24.10.00a160    cuda12_py311_240809_g1bbe440ee7_160    rapidsai-nightly
cuml                      24.10.00a33     cuda12_py311_240809_g0def703b4_33    rapidsai-nightly
cuproj                    24.10.00a27     cuda12_py311_240809_g9d7b7382_27    file:///tmp/python_channel
cupy                      13.2.0          py311he5a987b_1    conda-forge
cupy-core                 13.2.0          py311h3bdf873_1    conda-forge
curl                      8.9.1                h18eb788_0    conda-forge
cuspatial                 24.10.00a27     cuda12_py311_240809_g9d7b7382_27    file:///tmp/python_channel
cycler                    0.12.1             pyhd8ed1ab_0    conda-forge
cytoolz                   0.12.3          py311h459d7ec_0    conda-forge
dask                      2024.7.1           pyhd8ed1ab_0    conda-forge
dask-core                 2024.7.1           pyhd8ed1ab_0    conda-forge
dask-cuda                 24.10.00a12     py311_240809_g00c37dc_12    rapidsai-nightly
dask-cudf                 24.10.00a160    cuda12_py311_240809_g1bbe440ee7_160    rapidsai-nightly
dask-expr                 1.1.9              pyhd8ed1ab_0    conda-forge
debugpy                   1.8.5           py311hf86e51f_0    conda-forge
decorator                 5.1.1              pyhd8ed1ab_0    conda-forge
defusedxml                0.7.1              pyhd8ed1ab_0    conda-forge
distributed               2024.7.1           pyhd8ed1ab_0    conda-forge
distributed-ucxx          0.40.00a        py3.11_240809_g021ab84_17    rapidsai-nightly
dlpack                    0.8                  h59595ed_3    conda-forge
entrypoints               0.4                pyhd8ed1ab_0    conda-forge
exceptiongroup            1.2.2              pyhd8ed1ab_0    conda-forge
executing                 2.0.1              pyhd8ed1ab_0    conda-forge
expat                     2.6.2                h59595ed_0    conda-forge
fastrlock                 0.8.2           py311hb755f60_2    conda-forge
fiona                     1.9.5           py311hbac4ec9_0    conda-forge
fmt                       10.2.1               h00ab1b0_0    conda-forge
folium                    0.17.0             pyhd8ed1ab_0    conda-forge
font-ttf-dejavu-sans-mono 2.37                 hab24e00_0    conda-forge
font-ttf-inconsolata      3.000                h77eed37_0    conda-forge
font-ttf-source-code-pro  2.038                h77eed37_0    conda-forge
font-ttf-ubuntu           0.83                 h77eed37_2    conda-forge
fontconfig                2.14.2               h14ed4e7_0    conda-forge
fonts-conda-ecosystem     1                             0    conda-forge
fonts-conda-forge         1                             0    conda-forge
fonttools                 4.53.1          py311h61187de_0    conda-forge
fqdn                      1.5.1              pyhd8ed1ab_0    conda-forge
freetype                  2.12.1               h267a509_2    conda-forge
freexl                    2.0.0                h743c826_0    conda-forge
fsspec                    2024.6.1           pyhff2d567_0    conda-forge
gdal                      3.7.3           py311h39b4e0e_11    conda-forge
geopandas                 0.14.4             pyhd8ed1ab_0    conda-forge
geopandas-base            0.14.4             pyha770c72_0    conda-forge
geos                      3.12.1               h59595ed_0    conda-forge
geotiff                   1.7.1               hf074850_14    conda-forge
gettext                   0.22.5               h59595ed_2    conda-forge
gettext-tools             0.22.5               h59595ed_2    conda-forge
gflags                    2.2.2             he1b5a44_1004    conda-forge
giflib                    5.2.2                hd590300_0    conda-forge
glog                      0.7.1                hbabe93e_0    conda-forge
h11                       0.14.0             pyhd8ed1ab_0    conda-forge
h2                        4.1.0              pyhd8ed1ab_0    conda-forge
hdf4                      4.2.15               h2a13503_7    conda-forge
hdf5                      1.14.3          nompi_hdf9ad27_105    conda-forge
hpack                     4.0.0              pyh9f0ad1d_0    conda-forge
httpcore                  1.0.5              pyhd8ed1ab_0    conda-forge
httpx                     0.27.0             pyhd8ed1ab_0    conda-forge
hyperframe                6.0.1              pyhd8ed1ab_0    conda-forge
icu                       73.2                 h59595ed_0    conda-forge
idna                      3.7                pyhd8ed1ab_0    conda-forge
imagecodecs-lite          2019.12.3       py311h18e1886_8    conda-forge
imageio                   2.34.2             pyh12aca89_0    conda-forge
importlib-metadata        8.2.0              pyha770c72_0    conda-forge
importlib_metadata        8.2.0                hd8ed1ab_0    conda-forge
importlib_resources       6.4.0              pyhd8ed1ab_0    conda-forge
ipykernel                 6.29.5             pyh3099207_0    conda-forge
ipython                   8.26.0             pyh707e725_0    conda-forge
ipywidgets                8.1.3              pyhd8ed1ab_0    conda-forge
isoduration               20.11.0            pyhd8ed1ab_0    conda-forge
jedi                      0.19.1             pyhd8ed1ab_0    conda-forge
jinja2                    3.1.4              pyhd8ed1ab_0    conda-forge
joblib                    1.4.2              pyhd8ed1ab_0    conda-forge
json-c                    0.17                 h1220068_1    conda-forge
json5                     0.9.25             pyhd8ed1ab_0    conda-forge
jsonpointer               3.0.0           py311h38be061_0    conda-forge
jsonschema                4.23.0             pyhd8ed1ab_0    conda-forge
jsonschema-specifications 2023.12.1          pyhd8ed1ab_0    conda-forge
jsonschema-with-format-nongpl 4.23.0               hd8ed1ab_0    conda-forge
jupyter-lsp               2.2.5              pyhd8ed1ab_0    conda-forge
jupyter_client            8.6.2              pyhd8ed1ab_0    conda-forge
jupyter_core              5.7.2           py311h38be061_0    conda-forge
jupyter_events            0.10.0             pyhd8ed1ab_0    conda-forge
jupyter_server            2.14.2             pyhd8ed1ab_0    conda-forge
jupyter_server_terminals  0.5.3              pyhd8ed1ab_0    conda-forge
jupyterlab                4.2.4              pyhd8ed1ab_0    conda-forge
jupyterlab_pygments       0.3.0              pyhd8ed1ab_1    conda-forge
jupyterlab_server         2.27.3             pyhd8ed1ab_0    conda-forge
jupyterlab_widgets        3.0.11             pyhd8ed1ab_0    conda-forge
kealib                    1.5.3                hee9dde6_1    conda-forge
keyutils                  1.6.1                h166bdaf_0    conda-forge
kiwisolver                1.4.5           py311h9547e67_1    conda-forge
krb5                      1.21.3               h659f571_0    conda-forge
lazy_loader               0.4                pyhd8ed1ab_0    conda-forge
lcms2                     2.16                 hb7c19ff_0    conda-forge
ld_impl_linux-64          2.40                 hf3520f5_7    conda-forge
lerc                      4.0.0                h27087fc_0    conda-forge
libabseil                 20240116.2      cxx17_he02047a_1    conda-forge
libaec                    1.1.3                h59595ed_0    conda-forge
libarchive                3.7.4                hfca40fe_0    conda-forge
libarrow                  16.1.0          h1aed627_18_cpu    conda-forge
libarrow-acero            16.1.0          he02047a_18_cpu    conda-forge
libarrow-dataset          16.1.0          he02047a_18_cpu    conda-forge
libarrow-substrait        16.1.0          hc9a23c6_18_cpu    conda-forge
libasprintf               0.22.5               h661eb56_2    conda-forge
libasprintf-devel         0.22.5               h661eb56_2    conda-forge
libblas                   3.9.0           23_linux64_openblas    conda-forge
libbrotlicommon           1.1.0                hd590300_1    conda-forge
libbrotlidec              1.1.0                hd590300_1    conda-forge
libbrotlienc              1.1.0                hd590300_1    conda-forge
libcblas                  3.9.0           23_linux64_openblas    conda-forge
libcrc32c                 1.1.2                h9c3ff4c_0    conda-forge
libcublas                 12.2.5.6             hd3aeb46_0    conda-forge
libcublas-dev             12.2.5.6             hd3aeb46_0    conda-forge
libcudf                   24.10.00a160    cuda12_240809_g1bbe440ee7_160    rapidsai-nightly
libcufft                  11.0.8.103           hd3aeb46_0    conda-forge
libcufile                 1.7.2.10             hd3aeb46_0    conda-forge
libcufile-dev             1.7.2.10             hd3aeb46_0    conda-forge
libcuml                   24.10.00a33     cuda12_240809_g0def703b4_33    rapidsai-nightly
libcumlprims              24.10.00a       cuda12_240809_g0141c29_2    rapidsai-nightly
libcurand                 10.3.3.141           hd3aeb46_0    conda-forge
libcurand-dev             10.3.3.141           hd3aeb46_0    conda-forge
libcurl                   8.9.1                hdb1bdb2_0    conda-forge
libcusolver               11.5.2.141           hd3aeb46_0    conda-forge
libcusolver-dev           11.5.2.141           hd3aeb46_0    conda-forge
libcusparse               12.1.2.141           hd3aeb46_0    conda-forge
libcusparse-dev           12.1.2.141           hd3aeb46_0    conda-forge
libcuspatial              24.10.00a27     cuda12_240809_g9d7b7382_27    file:///tmp/cpp_channel
libdeflate                1.19                 hd590300_0    conda-forge
libedit                   3.1.20191231         he28a2e2_2    conda-forge
libev                     4.33                 hd590300_2    conda-forge
libevent                  2.1.12               hf998b51_1    conda-forge
libexpat                  2.6.2                h59595ed_0    conda-forge
libffi                    3.4.2                h7f98852_5    conda-forge
libgcc-ng                 14.1.0               h77fa898_0    conda-forge
libgdal                   3.7.3               h184a269_11    conda-forge
libgettextpo              0.22.5               h59595ed_2    conda-forge
libgettextpo-devel        0.22.5               h59595ed_2    conda-forge
libgfortran-ng            14.1.0               h69a702a_0    conda-forge
libgfortran5              14.1.0               hc5f4f2c_0    conda-forge
libglib                   2.78.4               h783c2da_0    conda-forge
libgomp                   14.1.0               h77fa898_0    conda-forge
libgoogle-cloud           2.26.0               h26d7fe4_0    conda-forge
libgoogle-cloud-storage   2.26.0               ha262f82_0    conda-forge
libgrpc                   1.62.2               h15f2491_0    conda-forge
libiconv                  1.17                 hd590300_2    conda-forge
libjpeg-turbo             3.0.0                hd590300_1    conda-forge
libkml                    1.3.0             hbbc8833_1020    conda-forge
libkvikio                 24.10.00a       cuda12_240809_gab84fdf_26    rapidsai-nightly
liblapack                 3.9.0           23_linux64_openblas    conda-forge
libllvm14                 14.0.6               hcd5def8_4    conda-forge
libnetcdf                 4.9.2           nompi_h135f659_114    conda-forge
libnghttp2                1.58.0               h47da74e_1    conda-forge
libnl                     3.10.0               h4bc722e_0    conda-forge
libnsl                    2.0.1                hd590300_0    conda-forge
libnvjitlink              12.2.140             hd3aeb46_0    conda-forge
libopenblas               0.3.27          pthreads_hac2b453_1    conda-forge
libparquet                16.1.0          h9e5060d_18_cpu    conda-forge
libpng                    1.6.43               h2797004_0    conda-forge
libpq                     16.4                 h482b261_0    conda-forge
libprotobuf               4.25.3               h08a7969_0    conda-forge
libraft                   24.10.00a23     cuda12_240809_g32f3703b_23    rapidsai-nightly
libraft-headers           24.10.00a23     cuda12_240809_g32f3703b_23    rapidsai-nightly
libraft-headers-only      24.10.00a23     cuda12_240809_g32f3703b_23    rapidsai-nightly
libre2-11                 2023.09.01           h5a48ba9_2    conda-forge
librmm                    24.10.00a22     cuda12_240809_g975c911a_22    rapidsai-nightly
librttopo                 1.1.0               h8917695_15    conda-forge
libsodium                 1.0.18               h36c2ea0_1    conda-forge
libspatialindex           2.0.0                he02047a_0    conda-forge
libspatialite             5.1.0                h72606ae_3    conda-forge
libsqlite                 3.46.0               hde9e2c9_0    conda-forge
libssh2                   1.11.0               h0841786_0    conda-forge
libstdcxx-ng              14.1.0               hc0a3c3a_0    conda-forge
libthrift                 0.19.0               hb90f79a_1    conda-forge
libtiff                   4.6.0                ha9c0a0a_2    conda-forge
libucxx                   0.40.00a        cuda12_240809_g021ab84_17    rapidsai-nightly
libutf8proc               2.8.0                h166bdaf_0    conda-forge
libuuid                   2.38.1               h0b41bf4_0    conda-forge
libwebp-base              1.4.0                hd590300_0    conda-forge
libxcb                    1.15                 h0b41bf4_0    conda-forge
libxcrypt                 4.4.36               hd590300_1    conda-forge
libxml2                   2.12.7               h4c95cb1_3    conda-forge
libzip                    1.10.1               h2629f0a_3    conda-forge
libzlib                   1.3.1                h4ab18f5_1    conda-forge
llvmlite                  0.43.0          py311hbde99c3_0    conda-forge
locket                    1.0.0              pyhd8ed1ab_0    conda-forge
lz4                       4.3.3           py311h38e4bf4_0    conda-forge
lz4-c                     1.9.4                hcb278e6_0    conda-forge
lzo                       2.10              hd590300_1001    conda-forge
mapclassify               2.7.0              pyhd8ed1ab_0    conda-forge
markdown-it-py            3.0.0              pyhd8ed1ab_0    conda-forge
markupsafe                2.1.5           py311h459d7ec_0    conda-forge
matplotlib-base           3.8.4           py311ha4ca890_2    conda-forge
matplotlib-inline         0.1.7              pyhd8ed1ab_0    conda-forge
mdurl                     0.1.2              pyhd8ed1ab_0    conda-forge
minizip                   4.0.7                h401b404_0    conda-forge
mistune                   3.0.2              pyhd8ed1ab_0    conda-forge
msgpack-python            1.0.8           py311h52f7536_0    conda-forge
munch                     4.0.0              pyhd8ed1ab_0    conda-forge
munkres                   1.1.4              pyh9f0ad1d_0    conda-forge
nbclient                  0.10.0             pyhd8ed1ab_0    conda-forge
nbconvert-core            7.16.4             pyhd8ed1ab_1    conda-forge
nbformat                  5.10.4             pyhd8ed1ab_0    conda-forge
nccl                      2.22.3.1             hbc370b7_1    conda-forge
ncurses                   6.5                  h59595ed_0    conda-forge
nest-asyncio              1.6.0              pyhd8ed1ab_0    conda-forge
networkx                  3.3                pyhd8ed1ab_1    conda-forge
notebook                  7.2.1              pyhd8ed1ab_0    conda-forge
notebook-shim             0.2.4              pyhd8ed1ab_0    conda-forge
nspr                      4.35                 h27087fc_0    conda-forge
nss                       3.103                h593d115_0    conda-forge
numba                     0.60.0          py311h4bc866e_0    conda-forge
numpy                     1.26.4          py311h64a7726_0    conda-forge
nvcomp                    3.0.6                h10b603f_0    conda-forge
nvtx                      0.2.10          py311h459d7ec_0    conda-forge
openjpeg                  2.5.2                h488ebb8_0    conda-forge
openssl                   3.3.1                h4bc722e_2    conda-forge
orc                       2.0.1                h17fec99_1    conda-forge
osmnx                     1.9.4              pyhd8ed1ab_0    conda-forge
overrides                 7.7.0              pyhd8ed1ab_0    conda-forge
packaging                 24.1               pyhd8ed1ab_0    conda-forge
pandas                    2.2.2           py311h14de704_1    conda-forge
pandocfilters             1.5.0              pyhd8ed1ab_0    conda-forge
parso                     0.8.4              pyhd8ed1ab_0    conda-forge
partd                     1.4.2              pyhd8ed1ab_0    conda-forge
pcre2                     10.42                hcad00b1_0    conda-forge
pexpect                   4.9.0              pyhd8ed1ab_0    conda-forge
pickleshare               0.7.5                   py_1003    conda-forge
pillow                    10.3.0          py311h18e6fac_0    conda-forge
pip                       24.2               pyhd8ed1ab_0    conda-forge
pixman                    0.43.2               h59595ed_0    conda-forge
pkgutil-resolve-name      1.3.10             pyhd8ed1ab_1    conda-forge
platformdirs              4.2.2              pyhd8ed1ab_0    conda-forge
poppler                   23.12.0              h590f24d_0    conda-forge
poppler-data              0.4.12               hd8ed1ab_0    conda-forge
postgresql                16.4                 ha8faf9a_0    conda-forge
proj                      9.3.0                h1d62c97_2    conda-forge
prometheus_client         0.20.0             pyhd8ed1ab_0    conda-forge
prompt-toolkit            3.0.47             pyha770c72_0    conda-forge
psutil                    6.0.0           py311h331c9d8_0    conda-forge
pthread-stubs             0.4               h36c2ea0_1001    conda-forge
ptyprocess                0.7.0              pyhd3deb0d_0    conda-forge
pure_eval                 0.2.3              pyhd8ed1ab_0    conda-forge
pyarrow                   16.1.0          py311hbd00459_5    conda-forge
pyarrow-core              16.1.0          py311h9460f28_5_cpu    conda-forge
pyarrow-hotfix            0.6                pyhd8ed1ab_0    conda-forge
pycparser                 2.22               pyhd8ed1ab_0    conda-forge
pydeck                    0.8.0              pyhd8ed1ab_0    conda-forge
pygments                  2.18.0             pyhd8ed1ab_0    conda-forge
pylibraft                 24.10.00a23     cuda12_py311_240809_g32f3703b_23    rapidsai-nightly
pynvjitlink               0.3.0           py311hd269673_0    rapidsai
pynvml                    11.4.1             pyhd8ed1ab_0    conda-forge
pyparsing                 3.1.2              pyhd8ed1ab_0    conda-forge
pyproj                    3.6.1           py311h1facc83_4    conda-forge
pysocks                   1.7.1              pyha2e5f31_6    conda-forge
python                    3.11.9          hb806964_0_cpython    conda-forge
python-dateutil           2.9.0              pyhd8ed1ab_0    conda-forge
python-fastjsonschema     2.20.0             pyhd8ed1ab_0    conda-forge
python-json-logger        2.0.7              pyhd8ed1ab_0    conda-forge
python-tzdata             2024.1             pyhd8ed1ab_0    conda-forge
python_abi                3.11                    4_cp311    conda-forge
pytz                      2024.1             pyhd8ed1ab_0    conda-forge
pywavelets                1.6.0           py311h18e1886_0    conda-forge
pyyaml                    6.0.2           py311h61187de_0    conda-forge
pyzmq                     26.1.0          py311h759c1eb_0    conda-forge
raft-dask                 24.10.00a23     cuda12_py311_240809_g32f3703b_23    rapidsai-nightly
rapids-dask-dependency    24.10.00a3                 py_0    rapidsai-nightly
rasterio                  1.3.9           py311h40fbdff_0    conda-forge
rdma-core                 53.0                 he02047a_0    conda-forge
re2                       2023.09.01           h7f4b329_2    conda-forge
readline                  8.2                  h8228510_1    conda-forge
referencing               0.35.1             pyhd8ed1ab_0    conda-forge
requests                  2.32.3             pyhd8ed1ab_0    conda-forge
rfc3339-validator         0.1.4              pyhd8ed1ab_0    conda-forge
rfc3986-validator         0.1.1              pyh9f0ad1d_0    conda-forge
rich                      13.7.1             pyhd8ed1ab_0    conda-forge
rmm                       24.10.00a22     cuda12_py311_240809_g975c911a_22    rapidsai-nightly
rpds-py                   0.20.0          py311hb3a8bbb_0    conda-forge
rtree                     1.3.0           py311h51bcefd_1    conda-forge
s2n                       1.4.19               h3400bea_0    conda-forge
scikit-image              0.20.0          py311h2872171_1    conda-forge
scikit-learn              1.5.1           py311hd632256_0    conda-forge
scipy                     1.13.1          py311h517d4fd_0    conda-forge
send2trash                1.8.3              pyh0d859eb_0    conda-forge
setuptools                72.1.0             pyhd8ed1ab_0    conda-forge
shapely                   2.0.4           py311h0bed3d6_1    conda-forge
six                       1.16.0             pyh6c4a22f_0    conda-forge
snappy                    1.2.1                ha2e4443_0    conda-forge
sniffio                   1.3.1              pyhd8ed1ab_0    conda-forge
snuggs                    1.4.7              pyhd8ed1ab_1    conda-forge
sortedcontainers          2.4.0              pyhd8ed1ab_0    conda-forge
soupsieve                 2.5                pyhd8ed1ab_1    conda-forge
spdlog                    1.12.0               hd2e6256_2    conda-forge
sqlite                    3.46.0               h6d4b2fc_0    conda-forge
stack_data                0.6.2              pyhd8ed1ab_0    conda-forge
tblib                     3.0.0              pyhd8ed1ab_0    conda-forge
terminado                 0.18.1             pyh0d859eb_0    conda-forge
threadpoolctl             3.5.0              pyhc1e730c_0    conda-forge
tifffile                  2020.6.3                   py_0    conda-forge
tiledb                    2.18.2               h99f50a1_1    conda-forge
tinycss2                  1.3.0              pyhd8ed1ab_0    conda-forge
tk                        8.6.13          noxft_h4845f30_101    conda-forge
tomli                     2.0.1              pyhd8ed1ab_0    conda-forge
toolz                     0.12.1             pyhd8ed1ab_0    conda-forge
tornado                   6.4.1           py311h331c9d8_0    conda-forge
traitlets                 5.14.3             pyhd8ed1ab_0    conda-forge
treelite                  4.3.0           py311he8f9275_0    conda-forge
types-python-dateutil     2.9.0.20240316     pyhd8ed1ab_0    conda-forge
typing-extensions         4.12.2               hd8ed1ab_0    conda-forge
typing_extensions         4.12.2             pyha770c72_0    conda-forge
typing_utils              0.1.0              pyhd8ed1ab_0    conda-forge
tzcode                    2024a                h3f72095_0    conda-forge
tzdata                    2024a                h0c530f3_0    conda-forge
ucx                       1.17.0               h0399452_2    conda-forge
ucx-py                    0.40.00a6       py311_240809_gd1fe2e7_6    rapidsai-nightly
ucxx                      0.40.00a        cuda12_py3.11_240809_g021ab84_17    rapidsai-nightly
uri-template              1.3.0              pyhd8ed1ab_0    conda-forge
uriparser                 0.9.8                hac33072_0    conda-forge
urllib3                   2.2.2              pyhd8ed1ab_1    conda-forge
wcwidth                   0.2.13             pyhd8ed1ab_0    conda-forge
webcolors                 24.6.0             pyhd8ed1ab_0    conda-forge
webencodings              0.5.1              pyhd8ed1ab_2    conda-forge
websocket-client          1.8.0              pyhd8ed1ab_0    conda-forge
wheel                     0.44.0             pyhd8ed1ab_0    conda-forge
widgetsnbextension        4.0.11             pyhd8ed1ab_0    conda-forge
xerces-c                  3.2.5                hac6953d_0    conda-forge
xorg-kbproto              1.0.7             h7f98852_1002    conda-forge
xorg-libice               1.1.1                hd590300_0    conda-forge
xorg-libsm                1.2.4                h7391055_0    conda-forge
xorg-libx11               1.8.9                h8ee46fc_0    conda-forge
xorg-libxau               1.0.11               hd590300_0    conda-forge
xorg-libxdmcp             1.1.3                h7f98852_0    conda-forge
xorg-libxext              1.3.4                h0b41bf4_2    conda-forge
xorg-libxrender           0.9.11               hd590300_0    conda-forge
xorg-renderproto          0.11.1            h7f98852_1002    conda-forge
xorg-xextproto            7.3.0             h0b41bf4_1003    conda-forge
xorg-xproto               7.0.31            h7f98852_1007    conda-forge
xyzservices               2024.6.0           pyhd8ed1ab_0    conda-forge
xz                        5.2.6                h166bdaf_0    conda-forge
yaml                      0.2.5                h7f98852_2    conda-forge
zeromq                    4.3.5                h75354e8_4    conda-forge
zict                      3.0.0              pyhd8ed1ab_0    conda-forge
zipp                      3.19.2             pyhd8ed1ab_0    conda-forge
zlib                      1.3.1                h4ab18f5_1    conda-forge
zstandard                 0.23.0          py311h5cd10c7_0    conda-forge
zstd                      1.5.6                ha6fb4c9_0    conda-forge
/__w/cuspatial/cuspatial/notebooks /__w/cuspatial/cuspatial
Fri Aug  9 16:11:53 2024       
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 550.54.15              Driver Version: 550.54.15      CUDA Version: 12.4     |
|-----------------------------------------+------------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id          Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
|                                         |                        |               MIG M. |
|=========================================+========================+======================|
|   0  Tesla V100-PCIE-32GB           Off |   00000000:05:00.0 Off |                    0 |
| N/A   27C    P0             23W /  250W |       3MiB /  32768MiB |      0%      Default |
|                                         |                        |                  N/A |
+-----------------------------------------+------------------------+----------------------+
                                                                                         
+-----------------------------------------------------------------------------------------+
| Processes:                                                                              |
|  GPU   GI   CI        PID   Type   Process name                              GPU Memory |
|        ID   ID                                                               Usage      |
|=========================================================================================|
|  No running processes found                                                             |
+-----------------------------------------------------------------------------------------+

Other/Misc.

I'm working on creating a minimal, reproducible example that's a bit more precise than CI logs. But wanted to get this opened as soon as possible.
@jameslamb jameslamb added the bug Something isn't working label Aug 12, 2024
@jameslamb jameslamb mentioned this issue Aug 12, 2024
Merged
3 tasks
@jameslamb
Copy link
Member Author

I ran this notebook locally on a machine with CUDA 12.2 and 8 V100s.

Was able to reproduce the error there, and can share some more details about that stop_by_zipcode object.

type(stop_by_zipcode)
# <class 'cuspatial.core.geodataframe.GeoDataFrame'>

type(stop_by_zipcode.index)
# <class 'cudf.core.index.RangeIndex'>

stop_by_zipcode.index
# RangeIndex(start=0, stop=121637, step=1)

stop_by_zipcode.dtypes
# x            float64
# y            float64
# ZCTA5CE10     object
# dtype: object

stop_by_zipcode.shape
# (121637, 3)

And here's a permalink to exactly where the error's occurring:

cuspatial/python/cuspatial/cuspatial/core/geodataframe.py

Lines 171 to 172 in 3780822

if not geo_columns.index.equals(data_columns.index):
raise ValueError("geo_columns.index must equal data_columns.index")

Looks like that was just added a few days ago, in #1429, as part of #1426. @mroeschke could you take a look?

@mroeschke mroeschke mentioned this issue Aug 13, 2024
Merged
3 tasks
@rapids-bot rapids-bot bot closed this as completed in 314dc7d Aug 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
cuSpatial
Status: Done
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Fix _recombine_columns when either geocolumn or non-geocolumn was empty mroeschke/cuspatial
1 participant
@jameslamb