Package Details: python-vllm 0.9.1-1

Git Clone URL: https://aur.archlinux.org/python-vllm.git (read-only, click to copy)
Package Base: python-vllm
Description: high-throughput and memory-efficient inference and serving engine for LLMs
Upstream URL: https://github.com/vllm-project/vllm
Licenses: Apache-2.0
Submitter: envolution
Maintainer: envolution
Last Packager: envolution
Votes: 1
Popularity: 0.89
First Submitted: 2024-12-01 16:07 (UTC)
Last Updated: 2025-06-11 00:57 (UTC)

Dependencies (51)

Required by (0)

Sources (1)

Latest Comments

jimreynold2nd commented on 2025-06-04 20:17 (UTC)

For CPU, this is missing certain dependencies (all of which can be found either in the official repo or AUR):

python-prometheus-fastapi-instrumentator python-python-multipart python-partial-json-parser python-watchfiles python-gguf python-triton python-cloudpickle

Would be great if those can be added to the dependency list.

envolution commented on 2025-03-28 16:30 (UTC)

@amstan thanks for the report, there were a handful of dependencies not caught by namcap. FYI this package targets CPU, it's possible it detects and links for rocm correctly, but ideally a separate package like python-vllm-rocm (similarly to python-vllm-cuda i used to maintain) should be created due to lack of flexibility in the pacman subsystems (we can't elegantly detect and modify dependencies based on GPU architectures/packages installed on the host system).

If this new pkgrel works on rocm, please add a comment for others to become aware.

amstan commented on 2025-03-28 06:07 (UTC)

Compiles to the end, but then:

% python -c "import vllm"
Traceback (most recent call last):
  File "<string>", line 1, in <module>
    import vllm
  File "/usr/lib/python3.13/site-packages/vllm/__init__.py", line 11, in <module>
    from vllm.engine.arg_utils import AsyncEngineArgs, EngineArgs
  File "/usr/lib/python3.13/site-packages/vllm/engine/arg_utils.py", line 15, in <module>
    from vllm.config import (CacheConfig, CompilationConfig, ConfigFormat,
    ...<5 lines>...
                             TokenizerPoolConfig, VllmConfig)
  File "/usr/lib/python3.13/site-packages/vllm/config.py", line 24, in <module>
    from transformers import PretrainedConfig
ModuleNotFoundError: No module named 'transformers'

amstan commented on 2025-03-28 05:42 (UTC) (edited on 2025-03-28 06:02 (UTC) by amstan)

If you get some weird compilation error(/lib/cmake/hip/hip-targets.cmake not found) and you want to do rocm, make sure you don't have hip-runtime-nvidia installed.

amstan commented on 2025-03-28 05:37 (UTC)

Seems to be missing python-setuptools-scm.

envolution commented on 2024-12-01 16:08 (UTC)

Sadly this won't build without detecting cuda and tools - this is the CPU only build