Search Criteria
Package Details: python-lm-eval 0.4.12-1
Package Actions
| Git Clone URL: | https://aur.archlinux.org/python-lm-eval.git (read-only, click to copy) |
|---|---|
| Package Base: | python-lm-eval |
| Description: | A framework for few-shot evaluation of language models (EleutherAI lm-evaluation-harness) |
| Upstream URL: | https://github.com/EleutherAI/lm-evaluation-harness |
| Licenses: | MIT |
| Submitter: | Smoolak |
| Maintainer: | Smoolak |
| Last Packager: | Smoolak |
| Votes: | 0 |
| Popularity: | 0.000000 |
| First Submitted: | 2026-06-02 11:53 (UTC) |
| Last Updated: | 2026-06-02 11:53 (UTC) |
Dependencies (39)
- python
- python-datasets
- python-dill
- python-evaluateAUR
- python-jinja
- python-more-itertools
- python-numpy (python-numpy-gitAUR, python-numpy-mkl-binAUR, python-numpy1AUR, python-numpy-mkl-tbbAUR, python-numpy-mklAUR)
- python-pytablewriterAUR
- python-rouge-scoreAUR
- python-sacrebleuAUR
- python-scikit-learn (python-scikit-learn-gitAUR)
- python-sqlitedict
- python-tqdm
- python-typing_extensions
- python-word2numberAUR
- python-build (make)
- python-installer (make)
- python-setuptools (make)
- python-wheel (make)
- litellmAUR (optional) – for the LiteLLM model backend
- python-accelerateAUR (optional) – for HuggingFace model support
- python-aiohttp (optional) – for API model backends
- python-immutabledict (optional) – for the ifeval task
- python-jsonlines (optional) – for the archiver extra
- python-langdetect (optional) – for the ifeval task
- python-nltk (optional) – for the ifeval/ruler tasks
- python-pandas (optional) – for Weights & Biases / zeno logging
- python-peftAUR (optional) – for HuggingFace model support
- python-pytorch (python-pytorch-cuda12.9AUR, python-pytorch-opt-cuda12.9AUR, python-pytorch-cuda, python-pytorch-opt, python-pytorch-opt-cuda, python-pytorch-opt-rocm, python-pytorch-opt-xpu, python-pytorch-rocm, python-pytorch-xpu) (optional) – for HuggingFace model support
- python-requests (optional) – for API model backends
- python-scipy (python-scipy-gitAUR, python-scipy-mkl-binAUR, python-scipy-mkl-tbbAUR, python-scipy-mklAUR) (optional) – for the ruler task
- python-sentencepieceAUR (python-sentencepiece-gitAUR, python-sentencepiece-binAUR) (optional) – for SentencePiece tokenizers
- python-sympy (python-sympy-gitAUR) (optional) – for the math task
- python-tenacity (optional) – for API model backends
- python-tiktoken (python-tiktoken-gitAUR) (optional) – for API model backends
- python-transformersAUR (python-transformers-gitAUR) (optional) – for HuggingFace model support
- python-vllmAUR (python-vllm-binAUR, python-vllm-cudaAUR, python-vllm-rocmAUR) (optional) – for vLLM model backend
- python-wandbAUR (python-wandb-gitAUR, python-wandbAUR) (optional) – for Weights & Biases logging
- python-zstandard (optional) – for the archiver extra