Package Details: ceph-bin 18.2.0-1

Git Clone URL: https://aur.archlinux.org/ceph-bin.git (read-only, click to copy)
Package Base: ceph-bin
Description: Distributed, fault-tolerant storage platform delivering object, block, and file system
Upstream URL: https://ceph.com/
Licenses: GPL
Conflicts: ceph
Replaces: ceph-mgr-bin
Submitter: pbazaah
Maintainer: pbazaah
Last Packager: pbazaah
Votes: 6
Popularity: 0.80
First Submitted: 2022-08-14 16:06 (UTC)
Last Updated: 2023-09-10 13:51 (UTC)

Required by (1)

Sources (28)

Latest Comments

1 2 3 4 5 6 .. 8 Next › Last »

pbazaah commented on 2023-09-10 14:19 (UTC)

@snack

Thanks for the kind words :)

snack commented on 2023-09-10 14:17 (UTC)

@pbazaah Thank you man, you are doing a fantastic work managing this beast. Really appreciated.

pbazaah commented on 2023-09-10 14:06 (UTC) (edited on 2023-09-10 14:06 (UTC) by pbazaah)

v18.2.0 has been released.

There are several notable changes:

1 - Removal of provides=() clauses for the from source variants of each package

The from source packages have been split into multiple smaller packages, rather than the monolithic ceph, ceph-libs variants.

However, I transparently remerge these packages here, so as to avoid polluting the AUR namespace with a bunch of ceph-*-bin package names.

Bottom line, you can no longer mix and match from source and binary variants of ceph from this release (which was never a good idea to begin with)

2 - Deprecation of ceph-mgr-bin

This package's functionality has been moved into ceph-bin itself.

However, to avoid breaking people's systems there is a shim package as a part of this release for ceph-mgr-bin, it does nothing except allow pacman to "upgrade" the package to v18.

You'll get a nag message whenever you rebuild this pkgbase reminding you to remove it.

I'll remove the nag message in a month or so, and the package in 3 (Dec 2023).

Unfortunately, replaces=() doesn't work for AUR packages :(

3 - I'll be opening a 3rd party repo for prebuilt ceph binaries in the near future, which you can use if you want the granularity of packages provided in the from source variant.

See https://github.com/bazaah/aur-ceph/releases/tag/v18.2.0-1 for release notes on the package, and https://ceph.io/en/news/blog/2023/v18-2-0-reef-released/ for the same on the upstream.

pbazaah commented on 2023-09-06 08:33 (UTC)

yes, sorry -- I actually have a rebuild already done, but work has been crazy. I'll see if I can do the release process over lunch

snack commented on 2023-09-06 06:16 (UTC)

I think a rebuild is needed:

$ sudo mount /wizard/ceph
/usr/bin/mount.ceph: error while loading shared libraries: libboost_thread.so.1.81.0: cannot open shared object file: No such file or directory

pbazaah commented on 2023-08-20 10:02 (UTC)

Tracked in https://github.com/bazaah/aur-ceph/issues/16

UweSauter commented on 2023-08-20 09:24 (UTC)

Yet another thing I just noticed which should be relatively simple to fix. During a fresh installation on another host:

:: Processing package changes...
(1/2) installing ceph-libs-bin                                                                                                 [#############################################################################] 100%
(2/2) installing ceph-bin                                                                                                      [#############################################################################] 100%
warning: directory permissions differ on /etc/sudoers.d/
filesystem: 750  package: 755

UweSauter commented on 2023-08-05 09:43 (UTC)

I installed python-cryptography-41.0.2-1 and restarted ceph-mgr.target on my single host deployment. The error messages persist:

Aug 05 11:34:38 ceph-s systemd[1]: Stopping Ceph cluster manager daemon...
Aug 05 11:34:38 ceph-s systemd[1]: ceph-mgr@ceph-s.service: Deactivated successfully.
Aug 05 11:34:38 ceph-s systemd[1]: Stopped Ceph cluster manager daemon.
Aug 05 11:34:38 ceph-s systemd[1]: ceph-mgr@ceph-s.service: Consumed 16.739s CPU time.
Aug 05 11:34:38 ceph-s systemd[1]: Started Ceph cluster manager daemon.
Aug 05 11:34:38 ceph-s ceph-mgr[2516]: 2023-08-05T11:34:38.685+0200 7fbbc062efc0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member
Aug 05 11:34:38 ceph-s ceph-mgr[2516]: 2023-08-05T11:34:38.755+0200 7fbbc062efc0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member
Aug 05 11:34:39 ceph-s ceph-mgr[2516]: 2023-08-05T11:34:39.262+0200 7fbbc062efc0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member
Aug 05 11:34:39 ceph-s ceph-mgr[2516]: 2023-08-05T11:34:39.469+0200 7fbbc062efc0 -1 mgr[py] Module not found: 'dashboard'
Aug 05 11:34:39 ceph-s ceph-mgr[2516]: 2023-08-05T11:34:39.469+0200 7fbbc062efc0 -1 mgr[py] Traceback (most recent call last):
Aug 05 11:34:39 ceph-s ceph-mgr[2516]:   File "/usr/share/ceph/mgr/dashboard/__init__.py", line 60, in <module>
Aug 05 11:34:39 ceph-s ceph-mgr[2516]:     from .module import Module, StandbyModule  # noqa: F401
Aug 05 11:34:39 ceph-s ceph-mgr[2516]:     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Aug 05 11:34:39 ceph-s ceph-mgr[2516]:   File "/usr/share/ceph/mgr/dashboard/module.py", line 30, in <module>
Aug 05 11:34:39 ceph-s ceph-mgr[2516]:     from .controllers import Router, json_error_page
Aug 05 11:34:39 ceph-s ceph-mgr[2516]:   File "/usr/share/ceph/mgr/dashboard/controllers/__init__.py", line 1, in <module>
Aug 05 11:34:39 ceph-s ceph-mgr[2516]:     from ._api_router import APIRouter
Aug 05 11:34:39 ceph-s ceph-mgr[2516]:   File "/usr/share/ceph/mgr/dashboard/controllers/_api_router.py", line 1, in <module>
Aug 05 11:34:39 ceph-s ceph-mgr[2516]:     from ._router import Router
Aug 05 11:34:39 ceph-s ceph-mgr[2516]:   File "/usr/share/ceph/mgr/dashboard/controllers/_router.py", line 7, in <module>
Aug 05 11:34:39 ceph-s ceph-mgr[2516]:     from ._base_controller import BaseController
Aug 05 11:34:39 ceph-s ceph-mgr[2516]:   File "/usr/share/ceph/mgr/dashboard/controllers/_base_controller.py", line 11, in <module>
Aug 05 11:34:39 ceph-s ceph-mgr[2516]:     from ..services.auth import AuthManager, JwtManager
Aug 05 11:34:39 ceph-s ceph-mgr[2516]:   File "/usr/share/ceph/mgr/dashboard/services/auth.py", line 12, in <module>
Aug 05 11:34:39 ceph-s ceph-mgr[2516]:     import jwt
Aug 05 11:34:39 ceph-s ceph-mgr[2516]:   File "/lib/python3.11/site-packages/jwt/__init__.py", line 1, in <module>
Aug 05 11:34:39 ceph-s ceph-mgr[2516]:     from .api_jwk import PyJWK, PyJWKSet
Aug 05 11:34:39 ceph-s ceph-mgr[2516]:   File "/lib/python3.11/site-packages/jwt/api_jwk.py", line 7, in <module>
Aug 05 11:34:39 ceph-s ceph-mgr[2516]:     from .algorithms import get_default_algorithms, has_crypto, requires_cryptography
Aug 05 11:34:39 ceph-s ceph-mgr[2516]:   File "/lib/python3.11/site-packages/jwt/algorithms.py", line 12, in <module>
Aug 05 11:34:39 ceph-s ceph-mgr[2516]:     from .utils import (
Aug 05 11:34:39 ceph-s ceph-mgr[2516]:   File "/lib/python3.11/site-packages/jwt/utils.py", line 7, in <module>
Aug 05 11:34:39 ceph-s ceph-mgr[2516]:     from cryptography.hazmat.primitives.asymmetric.ec import EllipticCurve
Aug 05 11:34:39 ceph-s ceph-mgr[2516]:   File "/lib/python3.11/site-packages/cryptography/hazmat/primitives/asymmetric/ec.py", line 11, in <module>
Aug 05 11:34:39 ceph-s ceph-mgr[2516]:     from cryptography.hazmat._oid import ObjectIdentifier
Aug 05 11:34:39 ceph-s ceph-mgr[2516]:   File "/lib/python3.11/site-packages/cryptography/hazmat/_oid.py", line 9, in <module>
Aug 05 11:34:39 ceph-s ceph-mgr[2516]:     from cryptography.hazmat.bindings._rust import (
Aug 05 11:34:39 ceph-s ceph-mgr[2516]: ImportError: PyO3 modules may only be initialized once per interpreter process
Aug 05 11:34:39 ceph-s ceph-mgr[2516]: 2023-08-05T11:34:39.469+0200 7fbbc062efc0 -1 mgr[py] Class not found in module 'dashboard'
Aug 05 11:34:39 ceph-s ceph-mgr[2516]: 2023-08-05T11:34:39.469+0200 7fbbc062efc0 -1 mgr[py] Error loading module 'dashboard': (2) No such file or directory
Aug 05 11:34:39 ceph-s ceph-mgr[2516]: 2023-08-05T11:34:39.535+0200 7fbbc062efc0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member
Aug 05 11:34:39 ceph-s ceph-mgr[2516]: 2023-08-05T11:34:39.599+0200 7fbbc062efc0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member
Aug 05 11:34:39 ceph-s ceph-mgr[2516]: 2023-08-05T11:34:39.719+0200 7fbbc062efc0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member
Aug 05 11:34:40 ceph-s ceph-mgr[2516]: 2023-08-05T11:34:40.216+0200 7fbbc062efc0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member
Aug 05 11:34:40 ceph-s ceph-mgr[2516]: 2023-08-05T11:34:40.339+0200 7fbbc062efc0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member
Aug 05 11:34:40 ceph-s ceph-mgr[2516]: 2023-08-05T11:34:40.419+0200 7fbbc062efc0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member
Aug 05 11:34:40 ceph-s ceph-mgr[2516]: 2023-08-05T11:34:40.476+0200 7fbbc062efc0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member
Aug 05 11:34:40 ceph-s ceph-mgr[2516]: 2023-08-05T11:34:40.562+0200 7fbbc062efc0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member
Aug 05 11:34:40 ceph-s ceph-mgr[2516]: 2023-08-05T11:34:40.626+0200 7fbbc062efc0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member
Aug 05 11:34:40 ceph-s ceph-mgr[2516]: 2023-08-05T11:34:40.846+0200 7fbbc062efc0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member
Aug 05 11:34:40 ceph-s ceph-mgr[2516]: 2023-08-05T11:34:40.936+0200 7fbbc062efc0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member
Aug 05 11:34:41 ceph-s ceph-mgr[2516]: 2023-08-05T11:34:41.096+0200 7fbbc062efc0 -1 mgr[py] Module not found: 'restful'
Aug 05 11:34:41 ceph-s ceph-mgr[2516]: 2023-08-05T11:34:41.096+0200 7fbbc062efc0 -1 mgr[py] Traceback (most recent call last):
Aug 05 11:34:41 ceph-s ceph-mgr[2516]:   File "/usr/share/ceph/mgr/restful/__init__.py", line 1, in <module>
Aug 05 11:34:41 ceph-s ceph-mgr[2516]:     from .module import Module
Aug 05 11:34:41 ceph-s ceph-mgr[2516]:   File "/usr/share/ceph/mgr/restful/module.py", line 21, in <module>
Aug 05 11:34:41 ceph-s ceph-mgr[2516]:     from OpenSSL import crypto
Aug 05 11:34:41 ceph-s ceph-mgr[2516]:   File "/lib/python3.11/site-packages/OpenSSL/__init__.py", line 8, in <module>
Aug 05 11:34:41 ceph-s ceph-mgr[2516]:     from OpenSSL import SSL, crypto
Aug 05 11:34:41 ceph-s ceph-mgr[2516]:   File "/lib/python3.11/site-packages/OpenSSL/SSL.py", line 9, in <module>
Aug 05 11:34:41 ceph-s ceph-mgr[2516]:     from OpenSSL._util import (
Aug 05 11:34:41 ceph-s ceph-mgr[2516]:   File "/lib/python3.11/site-packages/OpenSSL/_util.py", line 6, in <module>
Aug 05 11:34:41 ceph-s ceph-mgr[2516]:     from cryptography.hazmat.bindings.openssl.binding import Binding
Aug 05 11:34:41 ceph-s ceph-mgr[2516]:   File "/lib/python3.11/site-packages/cryptography/hazmat/bindings/openssl/binding.py", line 15, in <module>
Aug 05 11:34:41 ceph-s ceph-mgr[2516]:     from cryptography.exceptions import InternalError
Aug 05 11:34:41 ceph-s ceph-mgr[2516]:   File "/lib/python3.11/site-packages/cryptography/exceptions.py", line 9, in <module>
Aug 05 11:34:41 ceph-s ceph-mgr[2516]:     from cryptography.hazmat.bindings._rust import exceptions as rust_exceptions
Aug 05 11:34:41 ceph-s ceph-mgr[2516]: ImportError: PyO3 modules may only be initialized once per interpreter process
Aug 05 11:34:41 ceph-s ceph-mgr[2516]: 2023-08-05T11:34:41.096+0200 7fbbc062efc0 -1 mgr[py] Class not found in module 'restful'
Aug 05 11:34:41 ceph-s ceph-mgr[2516]: 2023-08-05T11:34:41.096+0200 7fbbc062efc0 -1 mgr[py] Error loading module 'restful': (2) No such file or directory
Aug 05 11:34:41 ceph-s ceph-mgr[2516]: 2023-08-05T11:34:41.306+0200 7fbbc062efc0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member
Aug 05 11:34:41 ceph-s ceph-mgr[2516]: 2023-08-05T11:34:41.369+0200 7fbbc062efc0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member
Aug 05 11:34:41 ceph-s ceph-mgr[2516]: 2023-08-05T11:34:41.436+0200 7fbbc062efc0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member
Aug 05 11:34:41 ceph-s ceph-mgr[2516]: 2023-08-05T11:34:41.582+0200 7fbbc062efc0 -1 mgr[py] Module status has missing NOTIFY_TYPES member
Aug 05 11:34:41 ceph-s ceph-mgr[2516]: 2023-08-05T11:34:41.646+0200 7fbbc062efc0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member
Aug 05 11:34:41 ceph-s ceph-mgr[2516]: 2023-08-05T11:34:41.779+0200 7fbbc062efc0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member
Aug 05 11:34:41 ceph-s ceph-mgr[2516]: 2023-08-05T11:34:41.902+0200 7fbbc062efc0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member
Aug 05 11:34:42 ceph-s ceph-mgr[2516]: 2023-08-05T11:34:42.122+0200 7fbbc062efc0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member
Aug 05 11:34:42 ceph-s ceph-mgr[2516]: 2023-08-05T11:34:42.186+0200 7fbbc062efc0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member
Aug 05 11:34:42 ceph-s ceph-mgr[2516]: 2023-08-05T11:34:42.186+0200 7fbbc062efc0 -1 log_channel(cluster) log [ERR] : Failed to load ceph-mgr modules: dashboard, restful

Could it be that mgr is running a single Python interpreter and that importing cryptography from multiple places is the issue? (ImportError: PyO3 modules may only be initialized once per interpreter process)

pbazaah commented on 2023-08-04 22:24 (UTC)

I'll take a look at the ceph-volume stuff tomorrow.

On the python stuff:

  1. I'll dig into if jsonpatch is only required if using rook, and add it to the mgr optdepends
  2. You're the second person that has had dashboard issues, which is strange because I don't (and use the dashboard).

That error comes from https://github.com/pyca/cryptography/issues/5771, which as a side note, was the start of really fun month at a previous job :D

Fixing it should be nothing more than adding https://archlinux.org/packages/extra/x86_64/python-cryptography/ to mgr deps.

I'm wondering if I somehow transitively include the above on my ceph nodes.

UweSauter commented on 2023-08-01 18:06 (UTC) (edited on 2023-08-01 18:06 (UTC) by UweSauter)

Also, ceph-volume requires lvs and other tools from the lvm2 package. Could you please add this as dependency to ceph-bin?