Package Details: python-jax 0.4.31-1

Git Clone URL: https://aur.archlinux.org/python-jax.git (read-only, click to copy)
Package Base: python-jax
Description: Composable transformations of Python+NumPy programs
Upstream URL: https://github.com/google/jax/
Keywords: autograd deep-learning jax jit machine-learning ml xla
Licenses: Apache
Groups: jax
Submitter: daskol
Maintainer: daskol (ei-grad)
Last Packager: daskol
Votes: 7
Popularity: 0.38
First Submitted: 2019-08-04 14:29 (UTC)
Last Updated: 2024-08-13 00:25 (UTC)

Latest Comments

« First ‹ Previous 1 2 3

carlosal1015 commented on 2022-09-18 19:19 (UTC)

I could suggest using jax from conda-forge with ana/mini/conda over virtual environment.

bred commented on 2022-09-18 18:29 (UTC) (edited on 2022-09-18 18:35 (UTC) by bred)

The compilation stops with this error:

[4,613 / 6,530] Compiling llvm/lib/AsmParser/LLLexer.cpp; 2s local ... (8 actions running)
ERROR: /home/user/.cache/bazel/_bazel_user/ff4af177b0f5799f1fd4fb1160d04d1d/external/llvm-project/mlir/BUILD.bazel:5410:11: Compiling mlir/lib/Conversion/LLVMCommon/LoweringOptions.cpp failed: undeclared inclusion(s) in rule '@llvm-project//mlir:LLVMCommonConversion':
this rule is missing dependency declarations for the following files included by 'mlir/lib/Conversion/LLVMCommon/LoweringOptions.cpp':
  '/usr/lib/gcc/x86_64-pc-linux-gnu/12.2.0/include/stddef.h'
  '/usr/lib/gcc/x86_64-pc-linux-gnu/12.2.0/include-fixed/limits.h'
  '/usr/lib/gcc/x86_64-pc-linux-gnu/12.2.0/include-fixed/syslimits.h'
  '/usr/lib/gcc/x86_64-pc-linux-gnu/12.2.0/include/stdint.h'
  '/usr/lib/gcc/x86_64-pc-linux-gnu/12.2.0/include/stdarg.h'
Target //build:build_wheel failed to build
INFO: Elapsed time: 21.801s, Critical Path: 5.94s
INFO: 12 processes: 12 internal.
FAILED: Build did NOT complete successfully
ERROR: Build failed. Not running target
FAILED: Build did NOT complete successfully
b''
Traceback (most recent call last):
  File "/home/user/.cache/yay/python-jaxlib/src/jax/build/build.py", line 555, in <module>
    main()
  File "/home/user/.cache/yay/python-jaxlib/src/jax/build/build.py", line 550, in main
    shell(command)
  File "/home/user/.cache/yay/python-jaxlib/src/jax/build/build.py", line 53, in shell
    output = subprocess.check_output(cmd)
  File "/usr/lib/python3.10/subprocess.py", line 420, in check_output
    return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
  File "/usr/lib/python3.10/subprocess.py", line 524, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['./bazel-5.1.1-linux-x86_64', 'run', '--verbose_failures=true', ':build_wheel', '--', '--output_path=/home/user/.cache/yay/python-jaxlib/src/jax/dist', '--cpu=x86_64']' returned non-zero exit status 1.

carlosal1015 commented on 2022-09-02 01:16 (UTC) (edited on 2022-09-02 01:17 (UTC) by carlosal1015)

I see that python-etils and python-typing_extensions are dependency according to this file.

carlosal1015 commented on 2022-09-01 01:13 (UTC) (edited on 2022-09-01 04:01 (UTC) by carlosal1015)

I have an error message when try to install python-zipp or python-typing_extensions.

I am not sure what could be a nice solution, maybe mark as conflict package.

error: failed to commit transaction (conflicting files)
python-zipp: /usr/lib/python3.10/site-packages/__pycache__/zipp.cpython-310.pyc exists in filesystem (owned by python-jax)
python-zipp: /usr/lib/python3.10/site-packages/zipp-3.8.1.dist-info/LICENSE exists in filesystem (owned by python-jax)
python-zipp: /usr/lib/python3.10/site-packages/zipp-3.8.1.dist-info/METADATA exists in filesystem (owned by python-jax)
python-zipp: /usr/lib/python3.10/site-packages/zipp-3.8.1.dist-info/RECORD exists in filesystem (owned by python-jax)
python-zipp: /usr/lib/python3.10/site-packages/zipp-3.8.1.dist-info/WHEEL exists in filesystem (owned by python-jax)
python-zipp: /usr/lib/python3.10/site-packages/zipp-3.8.1.dist-info/top_level.txt exists in filesystem (owned by python-jax)
python-zipp: /usr/lib/python3.10/site-packages/zipp.py exists in filesystem (owned by python-jax)
Errors occurred, no packages were upgraded.

python-typing_extensions: /usr/lib/python3.10/site-packages/__pycache__/typing_extensions.cpython-310.pyc exists in filesystem (owned by python-jax)
python-typing_extensions: /usr/lib/python3.10/site-packages/typing_extensions-4.3.0.dist-info/LICENSE exists in filesystem (owned by python-jax)
python-typing_extensions: /usr/lib/python3.10/site-packages/typing_extensions-4.3.0.dist-info/METADATA exists in filesystem (owned by python-jax)
python-typing_extensions: /usr/lib/python3.10/site-packages/typing_extensions-4.3.0.dist-info/RECORD exists in filesystem (owned by python-jax)
python-typing_extensions: /usr/lib/python3.10/site-packages/typing_extensions-4.3.0.dist-info/WHEEL exists in filesystem (owned by python-jax)
python-typing_extensions: /usr/lib/python3.10/site-packages/typing_extensions.py exists in filesystem (owned by python-jax)
Errors occurred, no packages were upgraded.

steventrouble commented on 2021-03-09 00:53 (UTC) (edited on 2021-03-09 00:55 (UTC) by steventrouble)

Researchers: If you're having trouble getting CUDA to work, just make your own PKGBUILD that uses pip rather than trying to debug this or build from source. Trust me, it'll be faster and safer.

To get it to work, you can download this PKGBUILD and modify the "pip install" line to run the pip install line from the jax github page:

package() {
    pip install \
        --ignore-requires-python \
        --root=$pkgdir \
        "jax" \
        "jaxlib==0.1.61+cuda112" \
        -f https://storage.googleapis.com/jax-releases/jax_releases.html
}

In general, this works for almost any pip library that isn't available in the AUR or the arch repos.

Happy jaxing!

daskol commented on 2021-02-01 15:04 (UTC)

The packages are designed to be two separate entities.

Well, the issue is binary compatibility between tensorflow and jax since jaxlib heavily use code located in tensorflow source tree. Now I have figured out that these distributions are independent enough or there are at lease guarantees of independence (but there are still some risks) so we can build jaxlib from sources.

PyPi tells you so (two distinct setup.py files), the developers treat them as such and jaxlib can in theory be used independently from jax.

I don't think that jaxlib is intended to use. I guess that the reason is that jaxlib is a private thin bridge between XLA client at tensorflow source tree and jax. This bridge also contains XLA extensions like PRNG. Nevertheless, jaxlib and jax like seemingly should be different packages since they have different release cycles and say some critical hotfixes could come to jax but not jaxlib. So, I'll add python-jaxlib AUR package in near future.

edh commented on 2021-01-12 13:46 (UTC) (edited on 2021-01-12 13:46 (UTC) by edh)

The packages are designed to be two separate entities. PyPi tells you so (two distinct setup.py files), the developers treat them as such and jaxlib can in theory be used independently from jax. On a very basic level, jaxlib simply wraps XLA code while jax is a very fancy numpy wrapper.

If you want, I can take over maintainership of the package if you no longer actively use it.

P.S. the package is still hopelessly outdated. Why did you unflag it?

daskol commented on 2021-01-12 12:19 (UTC) (edited on 2021-01-12 12:19 (UTC) by daskol)

Furthermore, it would be awesome if you would build the package from source the way it is described in the installation section at ...

Sure. I have made the package the long time ago when build from sources were much more tricky.

Can you please split the package into jaxlib and jax.

Why?

edh commented on 2021-01-05 14:21 (UTC)

Can you please split the package into jaxlib and jax. Furthermore, it would be awesome if you would build the package from source the way it is described in the installation section at https://jax.readthedocs.io/en/latest/developer.html#building-from-source .

« First ‹ Previous 1 2 3