Package Details: python-horovod 0.28.1-4

Git Clone URL: https://aur.archlinux.org/python-horovod.git (read-only, click to copy)
Package Base: python-horovod
Description: Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet
Upstream URL: https://github.com/horovod/horovod
Licenses: Apache-2.0
Submitter: hottea
Maintainer: hottea (lilac)
Last Packager: lilac
Votes: 0
Popularity: 0.000000
First Submitted: 2020-03-26 17:35 (UTC)
Last Updated: 2024-04-28 14:30 (UTC)

Sources (4)

Latest Comments

1 2 Next › Last »

alhirzel commented on 2024-01-17 16:38 (UTC) (edited on 2024-01-17 16:47 (UTC) by alhirzel)

I am seeing the following issue:

/home/alhirzel/.cache/yay/python-horovod/src/horovod-0.28.1/horovod/common/wire/message_generated.h: In member function ‘bool horovod::common::wire::Request::Verify(flatbuffers::Verifier&) const’:
/home/alhirzel/.cache/yay/python-horovod/src/horovod-0.28.1/horovod/common/wire/message_generated.h:282:32: error: no matching function for call to ‘horovod::common::wire::Request::VerifyField<int32_t>(flatbuffers
::Verifier&, horovod::common::wire::Request::FlatBuffersVTableOffset) const’
  282 |            VerifyField<int32_t>(verifier, VT_REQUEST_RANK) &&
      |            ~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~

And the upstream thread here implies the fix (taken from a few comments and tested today):

# Fixes Issue: Compatibility with TensorFlow 2.10+ / Generate flatbuffers-headers during build #3956 <https://github.com/horovod/horovod/issues/3956>
flatc -c -o horovod/common/wire horovod/common/wire/message.fbs
flatc --include-prefix "../common/wire" -c -I . -o horovod/tensorflow horovod/tensorflow/custom_call_config.fbs

Is this something that is worth incorporating into the PKGBUILD? When adding the above into build() (in addition to running updpkgsums), the package builds successfully.

rekman commented on 2024-01-03 05:42 (UTC)

@hottea yes I know, I wouldn't have been able to build with the 2-commit patch otherwise...

hottea commented on 2024-01-03 01:59 (UTC)

@rekman You need to run updpkgsums to update the checksum. This pr has only one commit when I update the PKGBUILD. I'll update the PKGBUILD again when the pr is merged. Before that, user should run updpkgsums to pass the validity check.

rekman commented on 2024-01-02 17:07 (UTC)

@hottea I was building from the 0.28.1-2 PKGBUILD including that patch. An additional commit 55e4500 was just added to PR #3998. With that commit, the package builds fine. However, the patch including that patch of course does not pass the validity check as its hash is different from that in the PKGBUILD.

hottea commented on 2024-01-02 15:30 (UTC)

@rekman yes, you need to apply this patch, just like this.

rekman commented on 2024-01-02 11:55 (UTC) (edited on 2024-01-02 11:57 (UTC) by rekman)

Can fail to build with PyTorch 2.1 due to an upstream issue.

Henry-ZHR commented on 2023-12-29 05:12 (UTC)

Patch is needed to build successfully with PyTorch>=2.1 https://github.com/horovod/horovod/pull/3998

Henry-ZHR commented on 2023-12-29 05:05 (UTC)

Please don't set environment variables in prepare(). Makepkg allows splitting prepare() and build(), thus setting them in prepare() doesn't make sense.

olko commented on 2021-03-10 12:09 (UTC)

I want to build the applications from original repos!

You told me that you are able to build python-horovod but I get an error because simply building with yay. That's odd.

hottea commented on 2021-03-10 11:29 (UTC) (edited on 2021-03-10 11:31 (UTC) by hottea)

@olko I'm sure how yay build this pkg. However, I always build pkg in a clean chroot. Other pkgs/deps/compiler/environment settings might lead to failure buiding pkgs. What not simply add this repo, and pacman -S python-horovod? As for the new ROCm issue, report to upstream, not here.

1 2 Next › Last »