Arch Linux User Repository

Can't start installing since one of the git repos tries to check out a non existing branch;

-> Creating working copy of django-taggit git repo...
fatal: bad object refs/remotes/origin/pre-commit-ci-update-config

Can't install due to failing tests.

Anybody else getting a similar error, I just do not know what to make of it! Is a problem with: /home/USER/.cache/yay/archivebox/src/ArchiveBox/tests/test_extractors.py not being able to create the file "singlefile.html"?

============================================================= FAILURES ============================================================== _________ test_singlefile_works ___________

tmp_path = PosixPath('/tmp/pytest-of-w/pytest-3/test_singlefile_works0') process = CompletedProcess(args=['archivebox', 'init'], returncode=0, stdout=b'[+] Initializing a new ArchiveBox v0.7.3 collecti...r/bin/env: 'deno': No such file or directory\n/usr/bin/env: \xe2\x80\x98deno\xe2\x80\x99: No such file or directory\n") disable_extractors_dict = {'CASROOT': '/usr', 'CFLAGS': '-march=x86-64 -mtune=generic -O2 -pipe -fno-plt -fexceptions -Wp,-D_FORTIFY_SOU...-frame-pointer -mno-omit-leaf-frame-pointer -flto=auto', 'CHOST': 'x86_64-pc-linux-gnu', 'COLORTERM': 'truecolor', ...}

def test_singlefile_works(tmp_path, process, disable_extractors_dict):
    disable_extractors_dict.update({"USE_SINGLEFILE": "true"})
    add_process = subprocess.run(['archivebox', 'add', 'http://127.0.0.1:8080/static/example.com.html'],
                                  capture_output=True, env=disable_extractors_dict)
    archived_item_path = list(tmp_path.glob('archive/**/*'))[0]
    output_file = archived_item_path / "singlefile.html"

  assert output_file.exists()

E AssertionError: assert False E + where False = exists() E + where exists = PosixPath('/tmp/pytest-of-w/pytest-3/test_singlefile_works0/archive/1735680827.22333/singlefile.html').exists

/home/USER/.cache/yay/archivebox/src/ArchiveBox/tests/test_extractors.py:63: AssertionError ========================================================= warnings summary ========================================================== ../../../../../../../usr/lib/python3.12/site-packages/bottle.py:38 /usr/lib/python3.12/site-packages/bottle.py:38: DeprecationWarning: 'cgi' is deprecated and slated for removal in Python 3.13 import base64, cgi, email.utils, functools, hmac, itertools, mimetypes,\

venv-test/lib/python3.12/site-packages/django/utils/encoding.py:266 /home/USER/.cache/yay/archivebox/src/ArchiveBox/venv-test/lib/python3.12/site-packages/django/utils/encoding.py:266: DeprecationWarning: 'locale.getdefaultlocale' is deprecated and slated for removal in Python 3.15. Use setlocale(), getencoding() and getlocale() instead. encoding = locale.getdefaultlocale()[1] or 'ascii'

archivebox/config.py:514 /home/USER/.cache/yay/archivebox/src/ArchiveBox/archivebox/config.py:514: DeprecationWarning: version is deprecated and will be removed in Python 3.14 'SQLITE_VERSION': {'default': lambda c: sqlite3.version},

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html ====================================================== short test summary info ====================================================== FAILED tests/test_extractors.py::test_singlefile_works - AssertionError: assert False ======================================= 1 failed, 61 passed, 3 warnings in 433.76s (0:07:13) ======================================== ==> ERROR: A failure occurred in check(). Aborting... -> error making: archivebox-exit status 4 -> Failed to install the following packages. Manual intervention is required: archivebox - exit status 4

Two issues here one of which are with the PKGBUILD

python-pdm-backend and python-django are missing from deps

Tests starts up a server on 8080 which was already in use by qBittorrent on my system...

Even after all that, tests are still failing in mass on something else.

After installing the suggested pdm-backend, the build seems to complete. But the tests fail. 2 of them anyway. * ArchiveBox/tests/test_extractors.py * ArchiveBox/tests/test_init.py

with: E ModuleNotFoundError: No module named 'django'

You need to install python-pdm-backend

sudo pacman -S python-pdm-backend

Getting an error on build:

Traceback (most recent call last):
  File "/usr/lib/python3.12/site-packages/pyproject_hooks/_impl.py", line 402, in _call_hook
    raise BackendUnavailable(
pyproject_hooks._impl.BackendUnavailable: Cannot import 'pdm.backend'

ERROR Backend 'pdm.backend' is not available.
==> ERROR: A failure occurred in build().

Thank you, now (using the workaround below) it works 😊

mercury-parser is now removed, apparently postlight-parser replaces it. Also, an issue with verifying signatures:

Building archivebox... ==> Making package: archivebox 0.7.2-2 (Mon 19 Feb 2024 20:36:55 EET) ==> Checking runtime dependencies... ==> Checking buildtime dependencies... ==> Retrieving sources... -> Updating ArchiveBox git repo... -> Updating base32-crockford git repo... -> Updating django-taggit git repo... -> Updating pocket git repo... -> Updating python-atomicwrites git repo... -> Found django-3.1.14 -> Found django-extensions-3.1.5 ==> Validating source files with sha256sums... ArchiveBox ... Skipped base32-crockford ... Skipped django-taggit ... Skipped pocket ... Skipped python-atomicwrites ... Skipped django-3.1.14 ... Skipped django-extensions-3.1.5 ... Skipped ==> Verifying source file signatures with gpg... ArchiveBox git repo ... %s is unable to verify the signature. git ==> ERROR: One or more PGP signatures could not be verified! Failed to build archivebox

Since archivebox now installs some dependencies (primarily an older django version) in /opt, users will need to update their PYTHONPATH variable to avoid ModuleNotFoundError: No module named 'archivebox' errors.

A quick workaround is to export the variable as such:

export PYTHONPATH=/opt/archivebox/lib/python3.11/site-packages/
archivebox init

According to python's documentation (and some StackOverflow answers), it might also be possible to put a .pth file referring to the /opt directory in python's default site-packages directory. This doesn't seem particularity harmful, but might cause breakages if a a newer of Django is also installed and intended to be used.

@carsme maybe the PKGBUILD could print a warning with recommendations/suggestions of this sort? Two other solutions include:

1. Making bin/archivebox a wrapper script that calls the actual archivebox program with PYTHONPATH=/opt/archivebox/lib/python3.11/site-packages/ prepended. Downside is that this will unexpectly fail to work when archivebox is imported as a library from python. In fact, making a wrapper more or less hides the problem from the user.

2. Installing a .pth file, as outlined above. Downside is that this might cause breakages with system packages (e.g. Django 3.2+), which AUR packages should avoid at all costs.

3. Write a python-django-3.1 package. This actually seems preferable, but more work.

Thanks to carsme for stepping up as a maintainer, btw!