Sadly this won't build without detecting cuda and tools - this is the CPU only build
Search Criteria
Package Details: python-vllm 0.10.1.1-1
Package Actions
| Git Clone URL: | https://aur.archlinux.org/python-vllm.git (read-only, click to copy) |
|---|---|
| Package Base: | python-vllm |
| Description: | high-throughput and memory-efficient inference and serving engine for LLMs |
| Upstream URL: | https://github.com/vllm-project/vllm |
| Licenses: | Apache-2.0 |
| Submitter: | envolution |
| Maintainer: | envolution |
| Last Packager: | envolution |
| Votes: | 2 |
| Popularity: | 1.06 |
| First Submitted: | 2024-12-01 16:07 (UTC) |
| Last Updated: | 2025-08-21 01:22 (UTC) |
Dependencies (56)
- numactl (numactl-gitAUR)
- python-aiohttp (python-aiohttp-gitAUR)
- python-blake3AUR
- python-boto3
- python-cachetools
- python-cloudpickle
- python-diskcacheAUR
- python-fastapi
- python-ggufAUR
- python-huggingface-hub (python-huggingface-hub-gitAUR)
- python-importlib-metadata
- python-msgspecAUR
- python-openai
- python-opencv (python-opencv-cuda)
- python-partial-json-parserAUR (python-partial-json-parser-gitAUR)
- python-prometheus-fastapi-instrumentatorAUR
- python-psutil
- python-py-cpuinfo
- python-pybase64AUR
- python-pydantic
- python-pytorch (python-pytorch-cxx11abiAUR, python-pytorch-cxx11abi-optAUR, python-pytorch-cxx11abi-cudaAUR, python-pytorch-cxx11abi-opt-cudaAUR, python-pytorch-cxx11abi-rocmAUR, python-pytorch-cxx11abi-opt-rocmAUR, python-pytorch-cuda, python-pytorch-opt, python-pytorch-opt-cuda, python-pytorch-opt-rocm, python-pytorch-rocm)
- python-pyzmq
- python-soundfile
- python-sphinx (python-sphinx-gitAUR)
- python-starlette
- python-sympy (python-sympy-gitAUR)
- python-torchvision (python-torchvision-gitAUR, python-torchvision-rocm-binAUR, python-torchvision-rocmAUR, python-torchvision-rocmAUR, python-torchvision-cuda)
- python-tqdm
- python-transformersAUR
- python-triton
- python-uvloop
- python-watchfiles
- uvicorn
- cmake (cmake3AUR, cmake-gitAUR) (make)
- gcc14 (make)
- git (git-gitAUR, git-glAUR) (make)
- python-build (make)
- python-installer (make)
- python-setuptools (make)
- python-setuptools-scm (make)
- python-compressed-tensorsAUR (optional) – required to load compressed tensor files
- python-datasets (optional) – tools to benchmark scripts
- python-depyf (optional) – required for debugging and profiling with complilation config
- python-einopsAUR (optional) – required for QWen2-VL models
- python-lark (python-lark-gitAUR, python-lark-parser) (optional) – parsing toolkit
- python-lm-format-enforcer (optional) – required for JSON/REGEX llm output
- python-mistral-commonAUR (optional) – mistral tools for opencv
- python-msgspecAUR (optional) – JSON/MessagePack library with validation
- python-openai (optional) – required for openai protocols
- python-outlinesAUR (optional) – guided text generation
- python-pillow (python-pillow-simd-gitAUR) (optional) – required for image processing
- python-prometheus_client (optional) – Prometheus instrumentation library for Python applications
- python-tiktoken (python-tiktoken-gitAUR) (optional) – required for DBRX tokenizer
- python-torchaudioAUR (python-torchaudio-gitAUR, python-torchaudio-rocmAUR, python-torchaudio-rocmAUR) (optional) – required for image processor of minicpm-o-2.6
- python-typing_extensions (optional) – typing hints
- python-xgrammar (optional) – flexible structured generation
Pinned Comments
envolution commented on 2025-08-04 01:31 (UTC)
@nipsky looks like some new incompatibility with python 3.13 - I was able to reproduce. Unfortunately the only feasible method at the moment is to run in a virtualenv using python 3.9-3.12. Upstream is working on 3.13 support but it's not quite there yet.
To be honest, we'll probably be on 3.14 by the time they support 3.13. I'll try have a look to see if I can patch it to initialize, but this week is kind of busy for me so it wouldn't be quick.