CUDA 12 builds install sysroot_linux-64 2.28 in the build prefix

[njzjz]

Comment:

Today, I updated a repo (conda-forge/deepmd-kit-feedstock#72), and CUDA 12 builds failed, which were previously successful.

The log shows it tries to install sysroot_linux-64 2.28 in the build prefix, while the virtual __glibc version is still 2.17. The CPU, CUDA 11.2, and CUDA 11.8 builds are fine.

2024-03-17T01:50:58.6277888Z        virtual packages : __archspec=1=x86_64_v4
2024-03-17T01:50:58.6278231Z                           __conda=24.1.2=0
2024-03-17T01:50:58.6278517Z                           __cuda=12.0=0
2024-03-17T01:50:58.6278789Z                           __glibc=2.17=0
2024-03-17T01:50:58.6279071Z                           __linux=6.5.0=0
2024-03-17T01:50:58.6279335Z                           __unix=0=0

2024-03-17T01:53:35.7999990Z ## Package Plan ##
2024-03-17T01:53:35.8048547Z 
2024-03-17T01:53:35.8049404Z   environment location: /home/conda/feedstock_root/build_artifacts/deepmd-kit_1710640170374/_build_env
2024-03-17T01:53:35.8050002Z 
2024-03-17T01:53:35.8050147Z 
2024-03-17T01:53:35.8050419Z The following NEW packages will be INSTALLED:
2024-03-17T01:53:35.8050601Z 
2024-03-17T01:53:35.8050947Z     _libgcc_mutex:                        0.1-conda_forge         conda-forge
2024-03-17T01:53:35.8051515Z     _openmp_mutex:                        4.5-2_gnu               conda-forge
2024-03-17T01:53:35.8051936Z     _sysroot_linux-64_curr_repodata_hack: 3-h69a702a_14           conda-forge
2024-03-17T01:53:35.8052340Z     binutils_impl_linux-64:               2.40-hf600244_0         conda-forge
2024-03-17T01:53:35.8052746Z     binutils_linux-64:                    2.40-hdade7a5_3         conda-forge
2024-03-17T01:53:35.8053124Z     bzip2:                                1.0.8-hd590300_5        conda-forge
2024-03-17T01:53:35.8053514Z     c-ares:                               1.27.0-hd590300_0       conda-forge
2024-03-17T01:53:35.8053898Z     ca-certificates:                      2024.2.2-hbcca054_0     conda-forge
2024-03-17T01:53:35.8054298Z     cmake:                                3.28.3-hcfe8598_0       conda-forge
2024-03-17T01:53:35.8054692Z     cuda-cccl_linux-64:                   12.0.90-ha770c72_1      conda-forge
2024-03-17T01:53:35.8055075Z     cuda-cudart:                          12.0.107-hd3aeb46_8     conda-forge
2024-03-17T01:53:35.8055485Z     cuda-cudart-dev:                      12.0.107-hd3aeb46_8     conda-forge
2024-03-17T01:53:35.8055881Z     cuda-cudart-dev_linux-64:             12.0.107-h59595ed_8     conda-forge
2024-03-17T01:53:35.8056297Z     cuda-cudart-static:                   12.0.107-hd3aeb46_8     conda-forge
2024-03-17T01:53:35.8056762Z     cuda-cudart-static_linux-64:          12.0.107-h59595ed_8     conda-forge
2024-03-17T01:53:35.8057160Z     cuda-cudart_linux-64:                 12.0.107-h59595ed_8     conda-forge
2024-03-17T01:53:35.8057575Z     cuda-driver-dev_linux-64:             12.0.107-h59595ed_8     conda-forge
2024-03-17T01:53:35.8057971Z     cuda-nvcc-dev_linux-64:               12.0.76-ha770c72_1      conda-forge
2024-03-17T01:53:35.8058375Z     cuda-nvcc-impl:                       12.0.76-h59595ed_1      conda-forge
2024-03-17T01:53:35.8058759Z     cuda-nvcc-tools:                      12.0.76-h59595ed_1      conda-forge
2024-03-17T01:53:35.8059169Z     cuda-nvcc_linux-64:                   12.0.76-hba56722_12     conda-forge
2024-03-17T01:53:35.8059619Z     cuda-version:                         12.0-hffde075_3         conda-forge
2024-03-17T01:53:35.8060026Z     gcc_impl_linux-64:                    12.3.0-he2b93b0_5       conda-forge
2024-03-17T01:53:35.8060429Z     gcc_linux-64:                         12.3.0-h6477408_3       conda-forge
2024-03-17T01:53:35.8060805Z     gxx_impl_linux-64:                    12.3.0-he2b93b0_5       conda-forge
2024-03-17T01:53:35.8061203Z     gxx_linux-64:                         12.3.0-h4a1b8e8_3       conda-forge
2024-03-17T01:53:35.8061607Z     kernel-headers_linux-64:              4.18.0-he073ed8_1       conda-forge
2024-03-17T01:53:35.8061990Z     keyutils:                             1.6.1-h166bdaf_0        conda-forge
2024-03-17T01:53:35.8062378Z     krb5:                                 1.21.2-h659d440_0       conda-forge
2024-03-17T01:53:35.8062747Z     ld_impl_linux-64:                     2.40-h41732ed_0         conda-forge
2024-03-17T01:53:35.8063143Z     libcurl:                              8.6.0-hca28451_0        conda-forge
2024-03-17T01:53:35.8063518Z     libedit:                              3.1.20191231-he28a2e2_2 conda-forge
2024-03-17T01:53:35.8063910Z     libev:                                4.33-hd590300_2         conda-forge
2024-03-17T01:53:35.8064295Z     libexpat:                             2.6.2-h59595ed_0        conda-forge
2024-03-17T01:53:35.8064701Z     libgcc-devel_linux-64:                12.3.0-h8bca6fd_105     conda-forge
2024-03-17T01:53:35.8065101Z     libgcc-ng:                            13.2.0-h807b86a_5       conda-forge
2024-03-17T01:53:35.8065578Z     libgomp:                              13.2.0-h807b86a_5       conda-forge
2024-03-17T01:53:35.8065974Z     libnghttp2:                           1.58.0-h47da74e_1       conda-forge
2024-03-17T01:53:35.8066372Z     libsanitizer:                         12.3.0-h0f45ef3_5       conda-forge
2024-03-17T01:53:35.8066829Z     libssh2:                              1.11.0-h0841786_0       conda-forge
2024-03-17T01:53:35.8067234Z     libstdcxx-devel_linux-64:             12.3.0-h8bca6fd_105     conda-forge
2024-03-17T01:53:35.8067616Z     libstdcxx-ng:                         13.2.0-h7e041cc_5       conda-forge
2024-03-17T01:53:35.8068008Z     libuv:                                1.48.0-hd590300_0       conda-forge
2024-03-17T01:53:35.8068396Z     libzlib:                              1.2.13-hd590300_5       conda-forge
2024-03-17T01:53:35.8068756Z     make:                                 4.3-hd18ef5c_1          conda-forge
2024-03-17T01:53:35.8069133Z     ncurses:                              6.4-h59595ed_2          conda-forge
2024-03-17T01:53:35.8069503Z     ninja:                                1.11.1-h924138e_0       conda-forge
2024-03-17T01:53:35.8069892Z     openssl:                              3.2.1-hd590300_0        conda-forge
2024-03-17T01:53:35.8070257Z     rhash:                                1.4.4-hd590300_0        conda-forge
2024-03-17T01:53:35.8070654Z     sysroot_linux-64:                     2.28-he073ed8_1         conda-forge
2024-03-17T01:53:35.8071039Z     xz:                                   5.2.6-h166bdaf_0        conda-forge
2024-03-17T01:53:35.8071610Z     zstd:                                 1.5.5-hfc55251_0        conda-forge

tensorflow.python.framework.errors_impl.NotFoundError: /lib64/libm.so.6: version `GLIBC_2.27' not found (required by /home/conda/feedstock_root/build_artifacts/deepmd-kit_1710640261461/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_place/lib/python3.10/site-packages/deepmd/lib/libdeepmd_op.so)

I noticed c_stdlib_version was added to cuda120.yaml in #5607, but after I updated that, nothing new happened.

[h-vetinari]

I noticed c_stdlib_version was added to cuda120.yaml in #5607, but after I updated that, nothing new happened.

This will only take effect if you use {{ stdlib("c") }} in the recipe.

The issue you're seeing seems to be a consequence of (or at least closely related to) conda-forge/cuda-nvcc-feedstock#36 & conda-forge/conda-forge-repodata-patches-feedstock#681

[beckermr]

xref: conda-forge/linux-sysroot-feedstock#58

[h-vetinari]

@njzjz, this should have been fixed by now - could you give it another try perhaps?

[njzjz]

Yes, it works. Thanks!