Arch Linux User Repository

For future commenters:

TLDR:

https://aur.archlinux.org/pkgbase/ceph | From source build (slow)

https://aur.archlinux.org/pkgbase/ceph-bin | Pre-built binaries (fast)

Unlike the original community version, this repo builds ceph from source. Ceph is a large, complicated project so this takes several hours on a good build server.

To get a similar experience to how community/ceph worked (pre-built binaries) use ceph-bin instead.

So the release of v18.2.0 is imminent.

There are a lot of changes to the packaging process in this release.

1. Ceph is broken up into ~35 packages covering the various functionality within -- see (0) for more
2. We only make install once now, which brings a ~60% decrease in packaging time, shaving something like 8 minutes off the whole build (at least for me)
3. We no longer add a runtime depends() on java-runtime in the common case. If you were using the cephfs JNI bindings you'll need to explicitly install java-cephfs.
4. There is a virtual package, ceph-cli for the ceph CLI utility, which is guaranteed to pull in the required package(s) for the CLI.
5. The ceph mgr dashboard is broken in this release, due to forces beyond my control as a packager. See (1) for more.
6. There is going to be a divergence between the from source and bin packages in AUR going forward. The bin packages will remain the same as they are currently, covering ceph-libs, ceph and ceph-mgr. This is to prevent the various ceph bin packages from polluting the AUR with almost 3 dozen xxx-bin packages
7. To alleviate this somewhat, I'll be opening up my private package repo for ceph so you can get prebuilt ceph binaries from there, if you want/need the flexibility of the new packaging changes.
8. The RBD writeback cache for both PMEM and SSD variants has been enabled with this release, see (2) for more.
9. I've tested both from v17.2.6 upgrades and from scratch v18.2.0 deployments on Archlinux, everything seems to be in order, and the upstream hasn't found any overly critical bugs, so it seems this x.2.0 is fairly stable by Ceph standards

All in all, this has been about ~2 months worth of work, over about a 7 month time span.

I'm sure there will be bugs, and missing depends, particularly in the python sphere, despite my best efforts; so I'd appreciate any reports on any you find, when you upgrade. Thanks.

(0): https://github.com/bazaah/aur-ceph/issues/15

(1): https://github.com/bazaah/aur-ceph/issues/20

(2): https://docs.ceph.com/en/reef/rbd/rbd-persistent-write-log-cache/

@md2prof

patch is a part of the base-devel (0) group, which is assumed to be installed for any packaging activities.

(0): https://archlinux.org/packages/core/any/base-devel/

Thank you for taking care of this package! In building on a fresh arch VM I discovered that patch is a dependency to add to your list.

v17.2.6-3 has been released. See https://github.com/bazaah/aur-ceph/releases/tag/v17.2.6-3 for more.

I have opened https://github.com/bazaah/aur-ceph/issues/17 to track my progress, on the pkgrel=3 rebuild.

Arch updated fmt to 10.0.0-1 on 2023-07-20. Now compilation fails with

[  7%] Building CXX object src/common/CMakeFiles/common-common-objs.dir/Journald.cc.o
cd /home/aur/build/ceph/src/ceph-17.2.6/build/src/common && /usr/bin/c++ -DBOOST_ASIO_DISABLE_THREAD_KEYWORD_EXTENSION -DCEPH_INSTALL_DATADIR=\"/usr/share/ceph\" -DCEPH_INSTALL_FULL_PKGLIBDIR=\"/usr/lib/ceph\" -DCMAKE_INSTALL_LIBDIR=\"/usr/lib\" -DHAVE_CONFIG_H -D_FILE_OFFSET_BITS=64 -D_FORTIFY_SOURCE=2 -D_GNU_SOURCE -D_REENTRANT -D_THREAD_SAFE -D__CEPH__ -D__STDC_FORMAT_MACROS -D__linux__ -I/home/aur/build/ceph/src/ceph-17.2.6/build/src/include -I/home/aur/build/ceph/src/ceph-17.2.6/src -isystem /home/aur/build/ceph/src/ceph-17.2.6/build/include -isystem /home/aur/build/ceph/src/ceph-17.2.6/src/xxHash -isystem /home/aur/build/ceph/src/ceph-17.2.6/src/rapidjson/include -march=x86-64 -mtune=generic -O2 -pipe  -fexceptions         -Wp,-D_FORTIFY_SOURCE=2 -Wformat -Werror=format-security         -fstack-clash-protection -fcf-protection -Wp,-D_GLIBCXX_ASSERTIONS  -DFMT_DEPRECATED_OSTREAM -O2 -g -DNDEBUG -std=c++17 -fPIC   -U_FORTIFY_SOURCE -fno-builtin-malloc -fno-builtin-calloc -fno-builtin-realloc -fno-builtin-free -Wall -fno-strict-aliasing -fsigned-char -Wtype-limits -Wignored-qualifiers -Wpointer-arith -Werror=format-security -Winit-self -Wno-unknown-pragmas -Wnon-virtual-dtor -Wno-ignored-qualifiers -ftemplate-depth-1024 -Wpessimizing-move -Wredundant-move -Wstrict-null-sentinel -Woverloaded-virtual -fno-new-ttp-matching -fstack-protector-strong -fdiagnostics-color=auto -MD -MT src/common/CMakeFiles/common-common-objs.dir/Journald.cc.o -MF CMakeFiles/common-common-objs.dir/Journald.cc.o.d -o CMakeFiles/common-common-objs.dir/Journald.cc.o -c /home/aur/build/ceph/src/ceph-17.2.6/src/common/Journald.cc
In file included from /usr/include/fmt/format.h:49,
                 from /home/aur/build/ceph/src/ceph-17.2.6/src/common/Journald.cc:17:
/usr/include/fmt/core.h: In instantiation of ‘constexpr fmt::v10::detail::value<Context> fmt::v10::detail::make_value(T&&) [with Context = fmt::v10::basic_format_context<fmt::v10::appender, char>; T = const entity_name_t&]’:
/usr/include/fmt/core.h:1711:29:   required from ‘constexpr fmt::v10::detail::value<Context> fmt::v10::detail::make_arg(T&&) [with bool IS_PACKED = true; Context = fmt::v10::basic_format_context<fmt::v10::appender, char>; type <anonymous> = fmt::v10::detail::type::custom_type; T = const entity_name_t&; typename std::enable_if<IS_PACKED, int>::type <anonymous> = 0]’
/usr/include/fmt/core.h:1827:77:   required from ‘constexpr fmt::v10::format_arg_store<Context, Args>::format_arg_store(T&& ...) [with T = {int&, long unsigned int&, const std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >&, const entity_name_t&, const long unsigned int&, const std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >&}; Context = fmt::v10::basic_format_context<fmt::v10::appender, char>; Args = {int, long unsigned int, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, entity_name_t, long unsigned int, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >}]’
/usr/include/fmt/core.h:1844:31:   required from ‘constexpr fmt::v10::format_arg_store<Context, typename std::remove_cv<typename std::remove_reference<T>::type>::type ...> fmt::v10::make_format_args(T&& ...) [with Context = basic_format_context<appender, char>; T = {int&, long unsigned int&, const std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >&, const entity_name_t&, const long unsigned int&, const std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >&}]’
/usr/include/fmt/core.h:2845:52:   required from ‘OutputIt fmt::v10::format_to(OutputIt, format_string<T ...>, T&& ...) [with OutputIt = std::back_insert_iterator<basic_memory_buffer<char> >; T = {int, long unsigned int, const std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >&, const entity_name_t&, const long unsigned int&, const std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >&}; typename std::enable_if<detail::is_output_iterator<OutputIt, char>::value, int>::type <anonymous> = 0; format_string<T ...> = basic_format_string<char, int, long unsigned int, const std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >&, const entity_name_t&, const long unsigned int&, const std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >&>]’
/home/aur/build/ceph/src/ceph-17.2.6/src/common/Journald.cc:142:19:   required from here
/usr/include/fmt/core.h:1691:7: error: static assertion failed: Cannot format an argument. To make type T formattable provide a formatter<T> specialization: https://fmt.dev/latest/api.html#udt
 1691 |       formattable,
      |       ^~~~~~~~~~~
/usr/include/fmt/core.h:1691:7: note: ‘formattable’ evaluates to false
make[2]: *** [src/common/CMakeFiles/common-common-objs.dir/build.make:1284: src/common/CMakeFiles/common-common-objs.dir/Journald.cc.o] Error 1
make[2]: Leaving directory '/home/aur/build/ceph/src/ceph-17.2.6/build'
make[1]: *** [CMakeFiles/Makefile2:4328: src/common/CMakeFiles/common-common-objs.dir/all] Error 2
make[1]: Leaving directory '/home/aur/build/ceph/src/ceph-17.2.6/build'
make: *** [Makefile:149: all] Error 2
make: Leaving directory '/home/aur/build/ceph/src/ceph-17.2.6/build'
==> ERROR: A failure occurred in build().
    Aborting...

@AsGreyWolf

Could you provide more detail? Preferably a minimal reproducible case, but I'll take the logs. Open issues here: https://github.com/bazaah/aur-ceph/issues?q=is%3Aissue+is%3Aopen+sort%3Aupdated-desc

Admittedly, I don't think I've ever used a ceph fuse client, but I do use the a minimal dashboard, and haven't encountered issues myself.

I've got non working dashboard (PyO3 modules may only be initialized once per interpreter process) and coredumping (some kind of assert) fuse client with this update.

I was unable to reproduce this in a clean chroot, 17.2.6-2 still builds successfully

@mostlyharmless

I'll take a look after $dayJob