Package Details: python-tensorrt 10.3.0.26-1

Git Clone URL: https://aur.archlinux.org/tensorrt.git (read-only, click to copy)
Package Base: tensorrt
Description: A platform for high-performance deep learning inference on NVIDIA hardware (python bindings and tools)
Upstream URL: https://developer.nvidia.com/tensorrt/
Keywords: ai artificial intelligence nvidia
Licenses: Apache-2.0, LicenseRef-custom
Provides: python-onnx-graphsurgeon, python-polygraphy, python-tensorflow-quantization
Submitter: dbermond
Maintainer: dbermond
Last Packager: dbermond
Votes: 19
Popularity: 1.89
First Submitted: 2018-07-29 16:17 (UTC)
Last Updated: 2024-08-10 14:22 (UTC)

Dependencies (18)

Sources (13)

Latest Comments

1 2 3 4 5 6 .. 9 Next › Last »

milianw commented on 2024-08-06 16:28 (UTC)

@dbermond: the forum post is not mine. I got the same/similar error when I tried to edit the PKGBUILD manually to try to build the newer tensorrt against cuda 12.5.

monarc99 commented on 2024-08-06 14:55 (UTC) (edited on 2024-08-06 15:05 (UTC) by monarc99)

You have a commented out part in the PKGBUILD in which you compile the python bindings.

# python bindings (fails to build with python 3.11) #local _pyver ...

Since my GPU (1060) is no longer supported by tensorrt 10, I had to get the 9 version to work and compile the python bindings for python 3.12 myself.

All I had to do was set another ENV variable and adjust the install command.

in build()...{ ... local -x TENSORRT_MODULE="tensorrt" ... }

the generated whl is located somewhere else, therefore adapt the install command

in package_python-tensorrt() { ...

python -m installer --destdir="$pkgdir" "TensorRT/python/build/bindings_wheel/dist/"*.whl

... }

I cannot say whether everything is correct. But everything compiles and the models also run (rife+upscale via trt).

In case someone might need it.

dbermond commented on 2024-07-27 01:17 (UTC)

@milianw I could compile your 'binsim.cu' source file using cuda 12.5.1 by running the exact same nvcc command that you posted in the mentioned nvidia thread. No errors, no warnings, and the 'binsimCUDA' executable builds fine. I cannot answer why you are getting these errors, and further discussing this here will be out of the scope of this AUR web page.

milianw commented on 2024-07-25 19:33 (UTC)

@dbermond: if gcc is not an issue, then why did I see the compile errors from the linked forum thread? I have gcc13 installed, but only 

$ ls /usr/include/c++/
14.1.1  v1

So gcc13 will still end up using libstc++ headers from gcc14 which are incompatible. How is this supposed to work?

dbermond commented on 2024-07-25 13:24 (UTC)

@milianw Sure, I will be happy to update the package if you provide the fix for this issue that I reported upstream in the same day 10.2 was released. And there is also this another one which I reported, but I could fix it myself. Please notice that if you can fix the first issue, other ones may arise later in the compilation, or even in the python modules, so make sure to check everything. Regarding the gcc usage in cuda, each cuda version uses a specific gcc version. cuda 12.5 uses gcc13 (and not gcc14), so the gcc version is not a problem for us, since the cuda package is already using the correct one.

milianw commented on 2024-07-25 10:12 (UTC)

meh, just updating the versions won't be sufficient since cuda (even 12.5 apparently) is not compatible with gcc 14 system includes: https://forums.developer.nvidia.com/t/cuda-12-4-nvcc-and-gcc-14-1-incompatibility/293295

milianw commented on 2024-07-25 08:57 (UTC)

there's now tensorrt 10.2.0.19 with cuda 12.5 support, this package could be updated accordingly

FuzzyAtish commented on 2024-05-24 19:41 (UTC)

Thank you for great and speedy answer. I should've probably searched for the issue a bit, apologies for being lazy

dbermond commented on 2024-05-24 19:28 (UTC)

@FuzzyAtish TLDR: it fails to build against cuda 12.5, downgrade cuda to 12.4.1 and it will work. The long story: there are two issues regarding this. Firstly, tensorrt 10.0.1 apparently does not support cuda 12.5, as you can see in the upstream documentation. Secondly, cuda 12.5 is not supported by the current version of the nvidia drivers that are available in the official repositories (cuda 12.5 was pushed without a driver that supports it), and you can read more details about this in the Arch Linux cuda package issues page at this link.

1 2 3 4 5 6 .. 9 Next › Last »