Package Details: python-vllm-bin 0.10.2-1

Git Clone URL: https://aur.archlinux.org/python-vllm-bin.git (read-only, click to copy)
Package Base: python-vllm-bin
Description: high-throughput and memory-efficient inference and serving engine for LLMs
Upstream URL: https://github.com/vllm-project/vllm
Licenses: Apache-2.0
Conflicts: python-vllm
Provides: python-vllm
Submitter: envolution
Maintainer: envolution
Last Packager: envolution
Votes: 2
Popularity: 0.65
First Submitted: 2024-11-30 16:59 (UTC)
Last Updated: 2025-09-15 07:52 (UTC)

Latest Comments

aspirogrammer commented on 2025-08-27 15:30 (UTC)

These packages were needed in my case: python-cbor2 python-setproctitle python-pytorch-cuda (CPU-based pytorch wasn't sufficient).

envolution commented on 2025-08-20 06:18 (UTC)

@bash000000 thanks, I thought they had forgotten to release it. Since the 3.13 commit came out after the 0.10.1 release I've tried to patch the .whl but admittedly I don't have time to test the functionality - if there are any other issues please feel free to let me know

bash000000 commented on 2025-08-20 05:09 (UTC)

Now, vllm can work correctly in version 3.13. Although it is incompatible with the METADATA requirements, the cu128 version of vllm does not have the cu128 flag https://github.com/vllm-project/vllm/releases/download/v0.10.1/vllm-0.10.1-cp38-abi3-manylinux1_x86_64.whl is the cu128 version

envolution commented on 2025-08-04 01:34 (UTC)

currently not initializing due to python 3.13 incompatibilities - I suggest running in a virualenv with python 3.9-3.12 until this is resolved

showgood163 commented on 2025-07-29 16:41 (UTC)

Hi, python-tiktonek is a typo for python-tiktoken, see https://github.com/openai/tiktoken for details.

envolution commented on 2025-06-04 07:34 (UTC)

@NonerKao thanks!

NonerKao commented on 2025-06-04 05:42 (UTC)

it seems python-cloudpickle is required as well

Sherlock-Holo commented on 2025-02-17 07:05 (UTC)

it seems python-msgspec is not a optional dependency

run vllm -h will says

ModuleNotFoundError: No module named 'msgspec'

terusus commented on 2025-01-29 13:19 (UTC)

Dependencies not properly defined in the package file.