Search Criteria
Package Details: python-ktransformers 0.2.4post1-1
Package Actions
| Git Clone URL: | https://aur.archlinux.org/python-ktransformers.git (read-only, click to copy) |
|---|---|
| Package Base: | python-ktransformers |
| Description: | A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations |
| Upstream URL: | https://github.com/kvcache-ai/ktransformers |
| Licenses: | Apache-2.0 |
| Submitter: | hottea |
| Maintainer: | None |
| Last Packager: | hottea |
| Votes: | 0 |
| Popularity: | 0.000000 |
| First Submitted: | 2025-02-24 08:41 (UTC) |
| Last Updated: | 2025-04-22 07:51 (UTC) |
Dependencies (20)
- python-accelerateAUR
- python-blessed
- python-colorlog
- python-fastapi
- python-fire (python-fire-gitAUR)
- python-flash-attentionAUR
- python-langchainAUR
- python-protobuf (python-protobuf-gitAUR, python-protobuf-21AUR)
- python-pytorch-opt-cuda
- python-sentencepieceAUR (python-sentencepiece-gitAUR)
- python-transformersAUR
- uvicorn
- cmake (cmake3AUR, cmake-gitAUR) (make)
- git (git-gitAUR, git-glAUR) (make)
- ninja (ninja-kitwareAUR, ninja-fuchsia-gitAUR, ninja-gitAUR, ninja-jobserverAUR, ninja-memAUR, ninja-noemacs-gitAUR) (make)
- python-build (make)
- python-cpufeatureAUR (make)
- python-installer (make)
- python-setuptools (make)
- python-wheel (make)
Latest Comments
13905069 commented on 2025-05-01 23:55 (UTC) (edited on 2025-05-01 23:55 (UTC) by 13905069)
USE_BALANCE_SERVE=1 should add to the env.
Without it, run ktransformers will return the same output as https://github.com/kvcache-ai/ktransformers/issues/1199