Package Details: python-jaxlib-cuda 0.4.31-1

Git Clone URL: https://aur.archlinux.org/python-jaxlib-cuda.git (read-only, click to copy)
Package Base: python-jaxlib-cuda
Description: XLA library for JAX
Upstream URL: https://github.com/google/jax/
Keywords: deep-learning google jax maching-learning xla
Licenses: Apache
Groups: jax
Conflicts: python-jaxlib
Provides: python-jaxlib
Submitter: daskol
Maintainer: daskol
Last Packager: daskol
Votes: 8
Popularity: 0.70
First Submitted: 2023-02-12 23:18 (UTC)
Last Updated: 2024-08-13 00:26 (UTC)

Latest Comments

« First ‹ Previous 1 2 3 4 Next › Last »

truncs commented on 2024-09-26 18:40 (UTC) (edited on 2024-09-26 18:41 (UTC) by truncs)

Seems like jaxlib and jax versions are not in sync.

  3  aur/python-jax                       0.4.31-1        -> 0.4.33-1
  2  aur/python-orbax-checkpoint          0.5.20-1        -> 0.6.4-1
  1  aur/yay                              12.4.1-1        -> 12.4.2-1
==> Packages to exclude: (eg: "1 2 3", "1-3", "^4" or repo name)
 -> Excluding packages may cause partial upgrades and break systems
==> 
 -> could not find all required packages: python-jaxlib >=0.4.33

actionless commented on 2024-08-13 00:57 (UTC)

i've finally solved previously mentioned problem by adding this before the last line of build() func:

    sed -i \
        -e 's|/opt/cuda/targets/x86_64-linux/include/cudnn_adv.h|/usr/include/cudnn_adv.h|g' \
        -e 's|/opt/cuda/targets/x86_64-linux/include/cudnn_backend.h|/usr/include/cudnn_backend.h|g' \
        -e 's|/opt/cuda/targets/x86_64-linux/include/cudnn_cnn.h|/usr/include/cudnn_cnn.h|g' \
        -e 's|/opt/cuda/targets/x86_64-linux/include/cudnn_graph.h|/usr/include/cudnn_graph.h|g' \
        -e 's|/opt/cuda/targets/x86_64-linux/include/cudnn_ops.h|/usr/include/cudnn_ops.h|g' \
        -e 's|/opt/cuda/targets/x86_64-linux/include/cudnn_version.h|/usr/include/cudnn_version.h|g' \
        bazel-jax-jaxlib-v0.4.31/external/local_config_cuda/cuda/BUILD

actionless commented on 2024-08-11 04:02 (UTC)

i'm getting this error during the build:

ERROR: /home/lie/.cache/pikaur/build/python-jaxlib-cuda/src/bazel/905847f791db658de2b823a610f64a15/external/local_config_cuda/cuda/BUIL
D:4241:8: Executing genrule @local_config_cuda//cuda:cudnn-include failed: (Exit 1): bash failed: error executing command (from target
@local_config_cuda//cuda:cudnn-include)
  (cd /home/lie/.cache/pikaur/build/python-jaxlib-cuda/src/bazel/905847f791db658de2b823a610f64a15/execroot/__main__ && \
  exec env - \
    CUDA_TOOLKIT_PATH=/opt/cuda \
    GCC_HOST_COMPILER_PATH=/usr/bin/gcc-13 \
    JAXLIB_RELEASE=0.4.30 \
    NCCL_INSTALL_PATH=/usr \
    PATH=/home/lie/bin:/usr/sbin:/sbin:/usr/condabin:/usr/local/sbin:/usr/local/bin:/usr/bin:/opt/cuda/bin:/opt/cuda/nsight_compute:/op
t/cuda/nsight_systems/bin:/opt/intel/mediasdk/bin:/usr/lib/jvm/default/bin:/usr/bin/site_perl:/usr/bin/vendor_perl:/usr/bin/core_perl \
    TF_CUDA_COMPUTE_CAPABILITIES=sm_50,sm_60,sm_70,sm_80,compute_90 \
    TF_CUDA_PATHS=/opt/cuda,/usr/lib,/usr \
  /bin/bash -c 'source external/bazel_tools/tools/genrule/genrule-setup.sh; cp -f "/opt/cuda/targets/x86_64-linux/include/cudnn.h" "baz
el-out/k8-opt/bin/external/local_config_cuda/cuda/cudnn/include/cudnn.h" && cp -f "/opt/cuda/targets/x86_64-linux/include/cudnn_adv.h"
"bazel-out/k8-opt/bin/external/local_config_cuda/cuda/cudnn/include/cudnn_adv.h" && cp -f "/opt/cuda/targets/x86_64-linux/include/cudnn
_backend.h" "bazel-out/k8-opt/bin/external/local_config_cuda/cuda/cudnn/include/cudnn_backend.h" && cp -f "/opt/cuda/targets/x86_64-lin
ux/include/cudnn_cnn.h" "bazel-out/k8-opt/bin/external/local_config_cuda/cuda/cudnn/include/cudnn_cnn.h" && cp -f "/opt/cuda/targets/x8
6_64-linux/include/cudnn_graph.h" "bazel-out/k8-opt/bin/external/local_config_cuda/cuda/cudnn/include/cudnn_graph.h" && cp -f "/opt/cud
a/targets/x86_64-linux/include/cudnn_ops.h" "bazel-out/k8-opt/bin/external/local_config_cuda/cuda/cudnn/include/cudnn_ops.h" && cp -f "
/opt/cuda/targets/x86_64-linux/include/cudnn_version.h" "bazel-out/k8-opt/bin/external/local_config_cuda/cuda/cudnn/include/cudnn_versi
on.h" ')
# Configuration: 1f82cdfaad48bddc42a9a9db6afc8d7da3bd013e73745c6926c6e665ef1885b7
# Execution platform: @local_execution_config_platform//:platform
cp: cannot stat '/opt/cuda/targets/x86_64-linux/include/cudnn_adv.h': No such file or directory

for some reason it's looking for that lib inside cuda's install dir (/opt/cuda) instead of the correct path:

$ locate cudnn_adv.h
/usr/include/cudnn_adv.h

$ pacman -Qo /usr/include/cudnn_adv.h
/usr/include/cudnn_adv.h is owned by cudnn 9.2.1.18-1

intelfx commented on 2024-05-12 20:48 (UTC)

Does this really need to download an outdated bazel blob and install a doubly outdated gcc (that has since been dropped from the Arch repositories and needs to be built from source)?

daskol commented on 2024-04-04 00:01 (UTC)

@bakamotokatas Thank you for the hint. Downgrading to bazel v6 solves the issue. There is no a bazel6 package in AUR thus it is vendored directly.

bakamotokatas commented on 2024-03-27 10:55 (UTC) (edited on 2024-03-27 11:38 (UTC) by bakamotokatas)

Hello,

ERROR: Traceback (most recent call last):
    File "/var/tmp/pamac-build-bakamotokatas/python-jaxlib-cuda/src/bazel/ec1b63115889792c942ec63928e6e90a/external/build_bazel_rules_apple/apple/internal/rule_support.bzl", line 221, column 36, in <toplevel>
        deps_cfg = apple_common.multi_arch_split,
Error: 'apple_common' value has no field or method 'multi_arch_split'
ERROR: error loading package '@@com_github_grpc_grpc//': at /var/tmp/pamac-build-bakamotokatas/python-jaxlib-cuda/src/bazel/ec1b63115889792c942ec63928e6e90a/external/com_github_grpc_grpc/bazel/grpc_build_system.bzl:28:6: at /var/tmp/pamac-build-bakamotokatas/python-jaxlib-cuda/src/bazel/ec1b63115889792c942ec63928e6e90a/external/build_bazel_rules_apple/apple/ios.bzl:33:5: at /var/tmp/pamac-build-bakamotokatas/python-jaxlib-cuda/src/bazel/ec1b63115889792c942ec63928e6e90a/external/build_bazel_rules_apple/apple/internal/ios_rules.bzl:71:5: initialization of module 'apple/internal/rule_support.bzl' failed
ERROR: /var/tmp/pamac-build-bakamotokatas/python-jaxlib-cuda/src/bazel/ec1b63115889792c942ec63928e6e90a/external/tsl/tsl/BUILD:460:11: error loading package '@@com_github_grpc_grpc//': at /var/tmp/pamac-build-bakamotokatas/python-jaxlib-cuda/src/bazel/ec1b63115889792c942ec63928e6e90a/external/com_github_grpc_grpc/bazel/grpc_build_system.bzl:28:6: at /var/tmp/pamac-build-bakamotokatas/python-jaxlib-cuda/src/bazel/ec1b63115889792c942ec63928e6e90a/external/build_bazel_rules_apple/apple/ios.bzl:33:5: at /var/tmp/pamac-build-bakamotokatas/python-jaxlib-cuda/src/bazel/ec1b63115889792c942ec63928e6e90a/external/build_bazel_rules_apple/apple/internal/ios_rules.bzl:71:5: initialization of module 'apple/internal/rule_support.bzl' failed and referenced by '@@tsl//tsl:grpc++'
ERROR: Analysis of target '//jaxlib/tools:build_wheel' failed; build aborted: Analysis failed
INFO: Elapsed time: 64.652s, Critical Path: 0.06s
INFO: 1 process: 1 internal.
ERROR: Build did NOT complete successfully
FAILED: 
ERROR: Build failed. Not running target
==> ERROR: A failure occurred in build().
    Aborting...

I am getting this error

edit: apple_common.multi_arch_split seems to have been deleted with bazel 7.

h3ss commented on 2023-11-09 15:23 (UTC)

Thanks @daskol! Confirmed fixed :)

daskol commented on 2023-11-09 13:00 (UTC)

@h3ss Fixed. Sorry for delay.

h3ss commented on 2023-10-27 17:09 (UTC)

@daskol, when you get a chance, could you please apply the same fix to this package as you did to python-jaxlib? Specifically moving environment variable assignments into the build function. Thanks!