Package Details: python-bitsandbytes-cuda121 0.41.0-1

Git Clone URL: https://aur.archlinux.org/python-bitsandbytes.git (read-only, click to copy)
Package Base: python-bitsandbytes
Description: Lightweight wrapper around CUDA custom functions, in particular 8-bit optimizers, matrix multiplication (LLM.int8()), and quantization functions.
Upstream URL: https://github.com/TimDettmers/bitsandbytes
Licenses: MIT
Conflicts: python-bitsandbytes
Provides: python-bitsandbytes
Submitter: Premik
Maintainer: Premik
Last Packager: Premik
Votes: 0
Popularity: 0.000000
First Submitted: 2023-06-21 20:26 (UTC)
Last Updated: 2023-10-17 06:49 (UTC)

Latest Comments

Premik commented on 2023-12-23 22:37 (UTC)

@daskol I've tried but then I couldn't push the change remote: error: invalid pkgbase: python-bitsandbytes-cuda121, expected python-bitsandbytes Seems it is not possible to change it without removing the repo.

My original idea was to (possibly) have multiple packages based on which cuda version is "hacked" in.

I was probably too quick in removing the hack before anyway.

Latest released of the upstream doesn't include libs for cuda >12.3. So this package is current broken: https://github.com/TimDettmers/bitsandbytes/issues/910

daskol commented on 2023-12-16 05:08 (UTC)

@Premik Please remove pkgbase since you do not use that feature in fact and just hold the name.

Premik commented on 2023-10-17 06:51 (UTC)

I've removed the cpu/cuda hack. It seems it is no longer needed in the newer version.

Premik commented on 2023-06-21 20:29 (UTC)

There is currently a .so lib hack to workaround the The installed version of bitsandbytes was compiled without GPU support aka str2optimizer8bit_blockwise name error.

More details: - https://github.com/TimDettmers/bitsandbytes/issues/112 - https://github.com/oobabooga/text-generation-webui/issues/400#issuecomment-1474876859

There are several warnings when used but seems to be working nevertheless..