[GH-ISSUE #1589] Support: dev branch not runnable during v0.8.x refactoring work #2460

Closed
opened 2026-03-01 17:59:12 +03:00 by kerem · 7 comments
Owner

Originally created by @nguyenmp on GitHub (Nov 10, 2024).
Original GitHub issue: https://github.com/ArchiveBox/ArchiveBox/issues/1589

Originally assigned to: @pirate on GitHub.

Provide a screenshot and describe the bug

When I run docker build . against a clean clone of ArchiveBox, it fails with:

9.424 ERROR: file:///Users/squash/Local/Code/archiveboxes/archivebox7/archivebox/pkgs/abx (from -r requirements.txt (line 3)) does not appear to be a Python project: neither 'setup.py' nor 'pyproject.toml' found.

I think abx was installed from source (maybe pip install -e ./abx) but that path doesn't work on my machine. Maybe you're mounting it or something weird?

30cd48c30d is the root cause I think.

Steps to reproduce

1. `git clone https://github.com/ArchiveBox/ArchiveBox ArchiveBoxClean`
2. `cd ArchiveBoxClean`
3. `docker build .`

Logs or errors

> [stage-0 20/27] RUN --mount=type=cache,target=/var/cache/apt,sharing=locked,id=apt-arm64 --mount=type=cache,target=/root/.cache/pip,sharing=locked,id=pip-arm64     echo "[+] Installing PIP ArchiveBox dependencies from requirements.txt for linux/arm64..."     && apt-get update -qq     && apt-get install -qq -y -t bookworm-backports         build-essential gcc         libssl-dev libldap2-dev libsasl2-dev         python3-ldap python3-msgpack python3-mutagen python3-regex python3-pycryptodome procps         pipx     && pip install -r requirements.txt     && apt-get purge -y         build-essential gcc     && apt-get autoremove -y     && rm -rf /var/lib/apt/lists/*:
0.076 [+] Installing PIP ArchiveBox dependencies from requirements.txt for linux/arm64...
(Reading database ... 24430 files and directories currently installed.)
2.519 Preparing to unpack .../00-libssl3_3.0.15-1~deb12u1_arm64.deb ...
2.524 Unpacking libssl3:arm64 (3.0.15-1~deb12u1) over (3.0.14-1~deb12u2) ...
2.619 Preparing to unpack .../01-python3.11_3.11.2-6+deb12u4_arm64.deb ...
2.641 Unpacking python3.11 (3.11.2-6+deb12u4) over (3.11.2-6+deb12u3) ...
2.664 Preparing to unpack .../02-libpython3.11-stdlib_3.11.2-6+deb12u4_arm64.deb ...
2.683 Unpacking libpython3.11-stdlib:arm64 (3.11.2-6+deb12u4) over (3.11.2-6+deb12u3) ...
2.941 Preparing to unpack .../03-python3.11-minimal_3.11.2-6+deb12u4_arm64.deb ...
2.947 Unpacking python3.11-minimal (3.11.2-6+deb12u4) over (3.11.2-6+deb12u3) ...
3.068 Preparing to unpack .../04-libpython3.11-minimal_3.11.2-6+deb12u4_arm64.deb ...
3.094 Unpacking libpython3.11-minimal:arm64 (3.11.2-6+deb12u4) over (3.11.2-6+deb12u3) ...
3.296 Selecting previously unselected package libproc2-0:arm64.
3.297 Preparing to unpack .../05-libproc2-0_2%3a4.0.2-3_arm64.deb ...
3.298 Unpacking libproc2-0:arm64 (2:4.0.2-3) ...
3.315 Selecting previously unselected package procps.
3.316 Preparing to unpack .../06-procps_2%3a4.0.2-3_arm64.deb ...
3.321 Unpacking procps (2:4.0.2-3) ...
3.369 Selecting previously unselected package bzip2.
3.370 Preparing to unpack .../07-bzip2_1.0.8-5+b1_arm64.deb ...
3.371 Unpacking bzip2 (1.0.8-5+b1) ...
3.384 Selecting previously unselected package xz-utils.
3.386 Preparing to unpack .../08-xz-utils_5.4.1-0.2_arm64.deb ...
3.387 Unpacking xz-utils (5.4.1-0.2) ...
3.423 Selecting previously unselected package binutils-common:arm64.
3.424 Preparing to unpack .../09-binutils-common_2.40-2_arm64.deb ...
3.425 Unpacking binutils-common:arm64 (2.40-2) ...
3.573 Selecting previously unselected package libbinutils:arm64.
3.575 Preparing to unpack .../10-libbinutils_2.40-2_arm64.deb ...
3.576 Unpacking libbinutils:arm64 (2.40-2) ...
3.622 Selecting previously unselected package libctf-nobfd0:arm64.
3.623 Preparing to unpack .../11-libctf-nobfd0_2.40-2_arm64.deb ...
3.624 Unpacking libctf-nobfd0:arm64 (2.40-2) ...
3.642 Selecting previously unselected package libctf0:arm64.
3.643 Preparing to unpack .../12-libctf0_2.40-2_arm64.deb ...
3.645 Unpacking libctf0:arm64 (2.40-2) ...
3.661 Selecting previously unselected package libgprofng0:arm64.
3.662 Preparing to unpack .../13-libgprofng0_2.40-2_arm64.deb ...
3.663 Unpacking libgprofng0:arm64 (2.40-2) ...
3.712 Selecting previously unselected package libjansson4:arm64.
3.714 Preparing to unpack .../14-libjansson4_2.14-2_arm64.deb ...
3.715 Unpacking libjansson4:arm64 (2.14-2) ...
3.728 Selecting previously unselected package binutils-aarch64-linux-gnu.
3.730 Preparing to unpack .../15-binutils-aarch64-linux-gnu_2.40-2_arm64.deb ...
3.731 Unpacking binutils-aarch64-linux-gnu (2.40-2) ...
3.908 Selecting previously unselected package binutils.
3.909 Preparing to unpack .../16-binutils_2.40-2_arm64.deb ...
3.911 Unpacking binutils (2.40-2) ...
3.928 Selecting previously unselected package libisl23:arm64.
3.929 Preparing to unpack .../17-libisl23_0.25-1.1_arm64.deb ...
3.930 Unpacking libisl23:arm64 (0.25-1.1) ...
3.976 Selecting previously unselected package libmpfr6:arm64.
3.977 Preparing to unpack .../18-libmpfr6_4.2.0-1_arm64.deb ...
3.978 Unpacking libmpfr6:arm64 (4.2.0-1) ...
4.005 Selecting previously unselected package libmpc3:arm64.
4.007 Preparing to unpack .../19-libmpc3_1.3.1-1_arm64.deb ...
4.008 Unpacking libmpc3:arm64 (1.3.1-1) ...
4.020 Selecting previously unselected package cpp-12.
4.021 Preparing to unpack .../20-cpp-12_12.2.0-14_arm64.deb ...
4.022 Unpacking cpp-12 (12.2.0-14) ...
4.412 Selecting previously unselected package cpp.
4.413 Preparing to unpack .../21-cpp_4%3a12.2.0-3_arm64.deb ...
4.415 Unpacking cpp (4:12.2.0-3) ...
4.426 Selecting previously unselected package libcc1-0:arm64.
4.427 Preparing to unpack .../22-libcc1-0_12.2.0-14_arm64.deb ...
4.428 Unpacking libcc1-0:arm64 (12.2.0-14) ...
4.441 Selecting previously unselected package libitm1:arm64.
4.442 Preparing to unpack .../23-libitm1_12.2.0-14_arm64.deb ...
4.444 Unpacking libitm1:arm64 (12.2.0-14) ...
4.456 Selecting previously unselected package libasan8:arm64.
4.458 Preparing to unpack .../24-libasan8_12.2.0-14_arm64.deb ...
4.459 Unpacking libasan8:arm64 (12.2.0-14) ...
4.583 Selecting previously unselected package liblsan0:arm64.
4.584 Preparing to unpack .../25-liblsan0_12.2.0-14_arm64.deb ...
4.585 Unpacking liblsan0:arm64 (12.2.0-14) ...
4.645 Selecting previously unselected package libtsan2:arm64.
4.647 Preparing to unpack .../26-libtsan2_12.2.0-14_arm64.deb ...
4.648 Unpacking libtsan2:arm64 (12.2.0-14) ...
4.776 Selecting previously unselected package libubsan1:arm64.
4.778 Preparing to unpack .../27-libubsan1_12.2.0-14_arm64.deb ...
4.779 Unpacking libubsan1:arm64 (12.2.0-14) ...
4.836 Selecting previously unselected package libhwasan0:arm64.
4.837 Preparing to unpack .../28-libhwasan0_12.2.0-14_arm64.deb ...
4.839 Unpacking libhwasan0:arm64 (12.2.0-14) ...
4.901 Selecting previously unselected package libgcc-12-dev:arm64.
4.903 Preparing to unpack .../29-libgcc-12-dev_12.2.0-14_arm64.deb ...
4.904 Unpacking libgcc-12-dev:arm64 (12.2.0-14) ...
4.980 Selecting previously unselected package gcc-12.
4.982 Preparing to unpack .../30-gcc-12_12.2.0-14_arm64.deb ...
4.983 Unpacking gcc-12 (12.2.0-14) ...
5.446 Selecting previously unselected package gcc.
5.448 Preparing to unpack .../31-gcc_4%3a12.2.0-3_arm64.deb ...
5.449 Unpacking gcc (4:12.2.0-3) ...
5.461 Selecting previously unselected package libstdc++-12-dev:arm64.
5.462 Preparing to unpack .../32-libstdc++-12-dev_12.2.0-14_arm64.deb ...
5.463 Unpacking libstdc++-12-dev:arm64 (12.2.0-14) ...
5.596 Selecting previously unselected package g++-12.
5.598 Preparing to unpack .../33-g++-12_12.2.0-14_arm64.deb ...
5.599 Unpacking g++-12 (12.2.0-14) ...
6.000 Selecting previously unselected package g++.
6.001 Preparing to unpack .../34-g++_4%3a12.2.0-3_arm64.deb ...
6.002 Unpacking g++ (4:12.2.0-3) ...
6.012 Selecting previously unselected package make.
6.013 Preparing to unpack .../35-make_4.3-4.1_arm64.deb ...
6.015 Unpacking make (4.3-4.1) ...
6.045 Selecting previously unselected package libdpkg-perl.
6.047 Preparing to unpack .../36-libdpkg-perl_1.21.22_all.deb ...
6.048 Unpacking libdpkg-perl (1.21.22) ...
6.084 Selecting previously unselected package patch.
6.085 Preparing to unpack .../37-patch_2.7.6-7_arm64.deb ...
6.086 Unpacking patch (2.7.6-7) ...
6.102 Selecting previously unselected package dpkg-dev.
6.103 Preparing to unpack .../38-dpkg-dev_1.21.22_all.deb ...
6.104 Unpacking dpkg-dev (1.21.22) ...
6.171 Selecting previously unselected package build-essential.
6.173 Preparing to unpack .../39-build-essential_12.9_arm64.deb ...
6.174 Unpacking build-essential (12.9) ...
6.183 Selecting previously unselected package libldap-dev:arm64.
6.184 Preparing to unpack .../40-libldap-dev_2.5.13+dfsg-5_arm64.deb ...
6.186 Unpacking libldap-dev:arm64 (2.5.13+dfsg-5) ...
6.213 Selecting previously unselected package libldap2-dev.
6.215 Preparing to unpack .../41-libldap2-dev_2.5.13+dfsg-5_all.deb ...
6.216 Unpacking libldap2-dev (2.5.13+dfsg-5) ...
6.226 Selecting previously unselected package libsasl2-dev.
6.228 Preparing to unpack .../42-libsasl2-dev_2.1.28+dfsg-10_arm64.deb ...
6.229 Unpacking libsasl2-dev (2.1.28+dfsg-10) ...
6.252 Selecting previously unselected package libssl-dev:arm64.
6.253 Preparing to unpack .../43-libssl-dev_3.0.15-1~deb12u1_arm64.deb ...
6.254 Unpacking libssl-dev:arm64 (3.0.15-1~deb12u1) ...
6.381 Preparing to unpack .../44-openssl_3.0.15-1~deb12u1_arm64.deb ...
6.384 Unpacking openssl (3.0.15-1~deb12u1) over (3.0.14-1~deb12u2) ...
6.457 Selecting previously unselected package python3-pip-whl.
6.459 Preparing to unpack .../45-python3-pip-whl_23.0.1+dfsg-1_all.deb ...
6.460 Unpacking python3-pip-whl (23.0.1+dfsg-1) ...
6.531 Selecting previously unselected package python3-setuptools-whl.
6.532 Preparing to unpack .../46-python3-setuptools-whl_66.1.1-1_all.deb ...
6.534 Unpacking python3-setuptools-whl (66.1.1-1) ...
6.578 Selecting previously unselected package python3-lib2to3.
6.580 Preparing to unpack .../47-python3-lib2to3_3.11.2-3_all.deb ...
6.581 Unpacking python3-lib2to3 (3.11.2-3) ...
6.597 Selecting previously unselected package python3-distutils.
6.598 Preparing to unpack .../48-python3-distutils_3.11.2-3_all.deb ...
6.599 Unpacking python3-distutils (3.11.2-3) ...
6.616 Selecting previously unselected package python3.11-venv.
6.618 Preparing to unpack .../49-python3.11-venv_3.11.2-6+deb12u4_arm64.deb ...
6.619 Unpacking python3.11-venv (3.11.2-6+deb12u4) ...
6.628 Selecting previously unselected package python3-venv.
6.629 Preparing to unpack .../50-python3-venv_3.11.2-1+b1_arm64.deb ...
6.630 Unpacking python3-venv (3.11.2-1+b1) ...
6.640 Selecting previously unselected package python3-argcomplete.
6.642 Preparing to unpack .../51-python3-argcomplete_2.0.0-1_all.deb ...
6.643 Unpacking python3-argcomplete (2.0.0-1) ...
6.655 Selecting previously unselected package python3-packaging.
6.656 Preparing to unpack .../52-python3-packaging_23.0-1_all.deb ...
6.657 Unpacking python3-packaging (23.0-1) ...
6.669 Selecting previously unselected package python3-colorama.
6.671 Preparing to unpack .../53-python3-colorama_0.4.6-2_all.deb ...
6.672 Unpacking python3-colorama (0.4.6-2) ...
6.684 Selecting previously unselected package python3-click.
6.685 Preparing to unpack .../54-python3-click_8.1.3-2_all.deb ...
6.687 Unpacking python3-click (8.1.3-2) ...
6.701 Selecting previously unselected package python3-userpath.
6.703 Preparing to unpack .../55-python3-userpath_1.8.0-1_all.deb ...
6.704 Unpacking python3-userpath (1.8.0-1) ...
6.715 Selecting previously unselected package pipx.
6.716 Preparing to unpack .../56-pipx_1.1.0-1_all.deb ...
6.717 Unpacking pipx (1.1.0-1) ...
6.750 Selecting previously unselected package python3-pyasn1.
6.751 Preparing to unpack .../57-python3-pyasn1_0.4.8-3_all.deb ...
6.752 Unpacking python3-pyasn1 (0.4.8-3) ...
6.766 Selecting previously unselected package python3-pyasn1-modules.
6.768 Preparing to unpack .../58-python3-pyasn1-modules_0.2.8-1_all.deb ...
6.769 Unpacking python3-pyasn1-modules (0.2.8-1) ...
6.786 Selecting previously unselected package python3-ldap.
6.788 Preparing to unpack .../59-python3-ldap_3.4.3-2+b2_arm64.deb ...
6.789 Unpacking python3-ldap (3.4.3-2+b2) ...
6.805 Selecting previously unselected package python3-msgpack.
6.807 Preparing to unpack .../60-python3-msgpack_1.0.3-2+b1_arm64.deb ...
6.808 Unpacking python3-msgpack (1.0.3-2+b1) ...
6.822 Selecting previously unselected package python3-mutagen.
6.824 Preparing to unpack .../61-python3-mutagen_1.46.0-1_all.deb ...
6.825 Unpacking python3-mutagen (1.46.0-1) ...
6.842 Selecting previously unselected package python3-pycryptodome.
6.843 Preparing to unpack .../62-python3-pycryptodome_3.11.0+dfsg1-4_arm64.deb ...
6.844 Unpacking python3-pycryptodome (3.11.0+dfsg1-4) ...
6.916 Selecting previously unselected package python3-regex.
6.917 Preparing to unpack .../63-python3-regex_0.1.20221031-1+b1_arm64.deb ...
6.920 Unpacking python3-regex (0.1.20221031-1+b1) ...
6.951 Setting up python3-setuptools-whl (66.1.1-1) ...
6.955 Setting up python3-colorama (0.4.6-2) ...
7.095 Setting up python3-pip-whl (23.0.1+dfsg-1) ...
7.098 Setting up python3-pycryptodome (3.11.0+dfsg1-4) ...
7.289 Setting up python3-mutagen (1.46.0-1) ...
7.398 Setting up binutils-common:arm64 (2.40-2) ...
7.402 Setting up libssl3:arm64 (3.0.15-1~deb12u1) ...
7.405 Setting up libctf-nobfd0:arm64 (2.40-2) ...
7.408 Setting up python3-click (8.1.3-2) ...
7.493 Setting up bzip2 (1.0.8-5+b1) ...
7.498 Setting up libjansson4:arm64 (2.14-2) ...
7.501 Setting up libsasl2-dev (2.1.28+dfsg-10) ...
7.505 Setting up python3-packaging (23.0-1) ...
7.575 Setting up make (4.3-4.1) ...
7.578 Setting up libmpfr6:arm64 (4.2.0-1) ...
7.582 Setting up libldap-dev:arm64 (2.5.13+dfsg-5) ...
7.585 Setting up xz-utils (5.4.1-0.2) ...
7.589 update-alternatives: using /usr/bin/xz to provide /usr/bin/lzma (lzma) in auto mode
7.589 update-alternatives: warning: skip creation of /usr/share/man/man1/lzma.1.gz because associated file /usr/share/man/man1/xz.1.gz (of link group lzma) doesn't exist
7.589 update-alternatives: warning: skip creation of /usr/share/man/man1/unlzma.1.gz because associated file /usr/share/man/man1/unxz.1.gz (of link group lzma) doesn't exist
7.590 update-alternatives: warning: skip creation of /usr/share/man/man1/lzcat.1.gz because associated file /usr/share/man/man1/xzcat.1.gz (of link group lzma) doesn't exist
7.590 update-alternatives: warning: skip creation of /usr/share/man/man1/lzmore.1.gz because associated file /usr/share/man/man1/xzmore.1.gz (of link group lzma) doesn't exist
7.590 update-alternatives: warning: skip creation of /usr/share/man/man1/lzless.1.gz because associated file /usr/share/man/man1/xzless.1.gz (of link group lzma) doesn't exist
7.590 update-alternatives: warning: skip creation of /usr/share/man/man1/lzdiff.1.gz because associated file /usr/share/man/man1/xzdiff.1.gz (of link group lzma) doesn't exist
7.590 update-alternatives: warning: skip creation of /usr/share/man/man1/lzcmp.1.gz because associated file /usr/share/man/man1/xzcmp.1.gz (of link group lzma) doesn't exist
7.590 update-alternatives: warning: skip creation of /usr/share/man/man1/lzgrep.1.gz because associated file /usr/share/man/man1/xzgrep.1.gz (of link group lzma) doesn't exist
7.590 update-alternatives: warning: skip creation of /usr/share/man/man1/lzegrep.1.gz because associated file /usr/share/man/man1/xzegrep.1.gz (of link group lzma) doesn't exist
7.590 update-alternatives: warning: skip creation of /usr/share/man/man1/lzfgrep.1.gz because associated file /usr/share/man/man1/xzfgrep.1.gz (of link group lzma) doesn't exist
7.592 Setting up libproc2-0:arm64 (2:4.0.2-3) ...
7.595 Setting up libssl-dev:arm64 (3.0.15-1~deb12u1) ...
7.598 Setting up libmpc3:arm64 (1.3.1-1) ...
7.601 Setting up patch (2.7.6-7) ...
7.604 Setting up python3-regex (0.1.20221031-1+b1) ...
7.704 Setting up libdpkg-perl (1.21.22) ...
7.707 Setting up libubsan1:arm64 (12.2.0-14) ...
7.710 Setting up libhwasan0:arm64 (12.2.0-14) ...
7.713 Setting up libasan8:arm64 (12.2.0-14) ...
7.717 Setting up procps (2:4.0.2-3) ...
7.730 Setting up python3-pyasn1 (0.4.8-3) ...
7.813 Setting up python3-msgpack (1.0.3-2+b1) ...
7.875 Setting up libpython3.11-minimal:arm64 (3.11.2-6+deb12u4) ...
7.880 Setting up libtsan2:arm64 (12.2.0-14) ...
7.883 Setting up libbinutils:arm64 (2.40-2) ...
7.886 Setting up libisl23:arm64 (0.25-1.1) ...
7.889 Setting up python3-argcomplete (2.0.0-1) ...
7.950 Setting up openssl (3.0.15-1~deb12u1) ...
7.954 Setting up python3-lib2to3 (3.11.2-3) ...
8.005 Setting up libcc1-0:arm64 (12.2.0-14) ...
8.008 Setting up liblsan0:arm64 (12.2.0-14) ...
8.011 Setting up libitm1:arm64 (12.2.0-14) ...
8.014 Setting up python3-userpath (1.8.0-1) ...
8.072 Setting up libctf0:arm64 (2.40-2) ...
8.076 Setting up python3-distutils (3.11.2-3) ...
8.136 Setting up python3.11-minimal (3.11.2-6+deb12u4) ...
8.434 Setting up cpp-12 (12.2.0-14) ...
8.437 Setting up libpython3.11-stdlib:arm64 (3.11.2-6+deb12u4) ...
8.441 Setting up libldap2-dev (2.5.13+dfsg-5) ...
8.444 Setting up libgprofng0:arm64 (2.40-2) ...
8.447 Setting up python3-pyasn1-modules (0.2.8-1) ...
8.555 Setting up libgcc-12-dev:arm64 (12.2.0-14) ...
8.559 Setting up cpp (4:12.2.0-3) ...
8.563 Setting up python3-ldap (3.4.3-2+b2) ...
8.641 Setting up python3.11 (3.11.2-6+deb12u4) ...
9.022 Setting up libstdc++-12-dev:arm64 (12.2.0-14) ...
9.028 Setting up binutils-aarch64-linux-gnu (2.40-2) ...
9.031 Setting up binutils (2.40-2) ...
9.034 Setting up dpkg-dev (1.21.22) ...
9.038 Setting up python3.11-venv (3.11.2-6+deb12u4) ...
9.064 Setting up gcc-12 (12.2.0-14) ...
9.068 Setting up g++-12 (12.2.0-14) ...
9.070 Setting up gcc (4:12.2.0-3) ...
9.077 Setting up python3-venv (3.11.2-1+b1) ...
9.080 Setting up g++ (4:12.2.0-3) ...
9.083 update-alternatives: using /usr/bin/g++ to provide /usr/bin/c++ (c++) in auto mode
9.085 Setting up build-essential (12.9) ...
9.087 Setting up pipx (1.1.0-1) ...
9.156 Processing triggers for libc-bin (2.36-9+deb12u8) ...
9.424 Obtaining file:///Users/squash/Local/Code/archiveboxes/archivebox7/archivebox/pkgs/abx (from -r requirements.txt (line 3))
9.424 ERROR: file:///Users/squash/Local/Code/archiveboxes/archivebox7/archivebox/pkgs/abx (from -r requirements.txt (line 3)) does not appear to be a Python project: neither 'setup.py' nor 'pyproject.toml' found.
------
Dockerfile:271
--------------------
 270 |     COPY --chown=root:root --chmod=755 "./pyproject.toml" "requirements.txt" "$CODE_DIR"/
 271 | >>> RUN --mount=type=cache,target=/var/cache/apt,sharing=locked,id=apt-$TARGETARCH$TARGETVARIANT --mount=type=cache,target=/root/.cache/pip,sharing=locked,id=pip-$TARGETARCH$TARGETVARIANT \
 272 | >>>     echo "[+] Installing PIP ArchiveBox dependencies from requirements.txt for ${TARGETPLATFORM}..." \
 273 | >>>     && apt-get update -qq \
 274 | >>>     && apt-get install -qq -y -t bookworm-backports \
 275 | >>>         build-essential gcc \
 276 | >>>         libssl-dev libldap2-dev libsasl2-dev \
 277 | >>>         python3-ldap python3-msgpack python3-mutagen python3-regex python3-pycryptodome procps \
 278 | >>>         pipx \
 279 | >>>     # && ln -s "$GLOBAL_VENV" "$APP_VENV" \
 280 | >>>     # && pdm use --venv in-project \
 281 | >>>     # && pdm run python -m ensurepip \
 282 | >>>     # && pdm sync --fail-fast --no-editable --group :all --no-self \
 283 | >>>     # && pdm export -o requirements.txt --without-hashes \
 284 | >>>     # && source $GLOBAL_VENV/bin/activate \
 285 | >>>     && pip install -r requirements.txt \
 286 | >>>     && apt-get purge -y \
 287 | >>>         build-essential gcc \
 288 | >>>     && apt-get autoremove -y \
 289 | >>>     && rm -rf /var/lib/apt/lists/*
 290 |     
--------------------
ERROR: failed to solve: process "/bin/bash -o pipefail -o errexit -o errtrace -o nounset -c echo \"[+] Installing PIP ArchiveBox dependencies from requirements.txt for ${TARGETPLATFORM}...\"     && apt-get update -qq     && apt-get install -qq -y -t bookworm-backports         build-essential gcc         libssl-dev libldap2-dev libsasl2-dev         python3-ldap python3-msgpack python3-mutagen python3-regex python3-pycryptodome procps         pipx     && pip install -r requirements.txt     && apt-get purge -y         build-essential gcc     && apt-get autoremove -y     && rm -rf /var/lib/apt/lists/*" did not complete successfully: exit code: 1

View build details: docker-desktop://dashboard/build/desktop-linux/desktop-linux/lexvezdpgjyd4ebwla9u1k50e

ArchiveBox Version

commit a9a3b153b11e8070d23f6aed5eb7169c60eb3a5e (HEAD -> dev, origin/dev, origin/HEAD)
Date:   Mon Nov 4 07:08:31 2024 -0800

    more StateMachine, Actor, and Orchestrator improvements

How did you install the version of ArchiveBox you are using?

Docker (or other container system like podman/LXC/Kubernetes or TrueNAS/Cloudron/YunoHost/etc.)

What operating system are you running on?

macOS (including Docker on macOS)

What type of drive are you using to store your ArchiveBox data?

  • data/ is on a local SSD or NVMe drive
  • data/ is on a spinning hard drive or external USB drive
  • data/ is on a network mount (e.g. NFS/SMB/CIFS/etc.)
  • data/ is on a FUSE mount (e.g. SSHFS/RClone/S3/B2/OneDrive, etc.)

Docker Compose Configuration

I'm using the Dockerfile in the repo.

ArchiveBox Configuration

n/a
Originally created by @nguyenmp on GitHub (Nov 10, 2024). Original GitHub issue: https://github.com/ArchiveBox/ArchiveBox/issues/1589 Originally assigned to: @pirate on GitHub. ### Provide a screenshot and describe the bug When I run `docker build .` against a clean clone of ArchiveBox, it fails with: ``` 9.424 ERROR: file:///Users/squash/Local/Code/archiveboxes/archivebox7/archivebox/pkgs/abx (from -r requirements.txt (line 3)) does not appear to be a Python project: neither 'setup.py' nor 'pyproject.toml' found. ``` I think abx was installed from source (maybe pip install -e ./abx) but that path doesn't work on my machine. Maybe you're mounting it or something weird? 30cd48c30dbed4783c08840cfbce3bed23c248b0 is the root cause I think. ### Steps to reproduce ```markdown 1. `git clone https://github.com/ArchiveBox/ArchiveBox ArchiveBoxClean` 2. `cd ArchiveBoxClean` 3. `docker build .` ``` ### Logs or errors ```shell > [stage-0 20/27] RUN --mount=type=cache,target=/var/cache/apt,sharing=locked,id=apt-arm64 --mount=type=cache,target=/root/.cache/pip,sharing=locked,id=pip-arm64 echo "[+] Installing PIP ArchiveBox dependencies from requirements.txt for linux/arm64..." && apt-get update -qq && apt-get install -qq -y -t bookworm-backports build-essential gcc libssl-dev libldap2-dev libsasl2-dev python3-ldap python3-msgpack python3-mutagen python3-regex python3-pycryptodome procps pipx && pip install -r requirements.txt && apt-get purge -y build-essential gcc && apt-get autoremove -y && rm -rf /var/lib/apt/lists/*: 0.076 [+] Installing PIP ArchiveBox dependencies from requirements.txt for linux/arm64... (Reading database ... 24430 files and directories currently installed.) 2.519 Preparing to unpack .../00-libssl3_3.0.15-1~deb12u1_arm64.deb ... 2.524 Unpacking libssl3:arm64 (3.0.15-1~deb12u1) over (3.0.14-1~deb12u2) ... 2.619 Preparing to unpack .../01-python3.11_3.11.2-6+deb12u4_arm64.deb ... 2.641 Unpacking python3.11 (3.11.2-6+deb12u4) over (3.11.2-6+deb12u3) ... 2.664 Preparing to unpack .../02-libpython3.11-stdlib_3.11.2-6+deb12u4_arm64.deb ... 2.683 Unpacking libpython3.11-stdlib:arm64 (3.11.2-6+deb12u4) over (3.11.2-6+deb12u3) ... 2.941 Preparing to unpack .../03-python3.11-minimal_3.11.2-6+deb12u4_arm64.deb ... 2.947 Unpacking python3.11-minimal (3.11.2-6+deb12u4) over (3.11.2-6+deb12u3) ... 3.068 Preparing to unpack .../04-libpython3.11-minimal_3.11.2-6+deb12u4_arm64.deb ... 3.094 Unpacking libpython3.11-minimal:arm64 (3.11.2-6+deb12u4) over (3.11.2-6+deb12u3) ... 3.296 Selecting previously unselected package libproc2-0:arm64. 3.297 Preparing to unpack .../05-libproc2-0_2%3a4.0.2-3_arm64.deb ... 3.298 Unpacking libproc2-0:arm64 (2:4.0.2-3) ... 3.315 Selecting previously unselected package procps. 3.316 Preparing to unpack .../06-procps_2%3a4.0.2-3_arm64.deb ... 3.321 Unpacking procps (2:4.0.2-3) ... 3.369 Selecting previously unselected package bzip2. 3.370 Preparing to unpack .../07-bzip2_1.0.8-5+b1_arm64.deb ... 3.371 Unpacking bzip2 (1.0.8-5+b1) ... 3.384 Selecting previously unselected package xz-utils. 3.386 Preparing to unpack .../08-xz-utils_5.4.1-0.2_arm64.deb ... 3.387 Unpacking xz-utils (5.4.1-0.2) ... 3.423 Selecting previously unselected package binutils-common:arm64. 3.424 Preparing to unpack .../09-binutils-common_2.40-2_arm64.deb ... 3.425 Unpacking binutils-common:arm64 (2.40-2) ... 3.573 Selecting previously unselected package libbinutils:arm64. 3.575 Preparing to unpack .../10-libbinutils_2.40-2_arm64.deb ... 3.576 Unpacking libbinutils:arm64 (2.40-2) ... 3.622 Selecting previously unselected package libctf-nobfd0:arm64. 3.623 Preparing to unpack .../11-libctf-nobfd0_2.40-2_arm64.deb ... 3.624 Unpacking libctf-nobfd0:arm64 (2.40-2) ... 3.642 Selecting previously unselected package libctf0:arm64. 3.643 Preparing to unpack .../12-libctf0_2.40-2_arm64.deb ... 3.645 Unpacking libctf0:arm64 (2.40-2) ... 3.661 Selecting previously unselected package libgprofng0:arm64. 3.662 Preparing to unpack .../13-libgprofng0_2.40-2_arm64.deb ... 3.663 Unpacking libgprofng0:arm64 (2.40-2) ... 3.712 Selecting previously unselected package libjansson4:arm64. 3.714 Preparing to unpack .../14-libjansson4_2.14-2_arm64.deb ... 3.715 Unpacking libjansson4:arm64 (2.14-2) ... 3.728 Selecting previously unselected package binutils-aarch64-linux-gnu. 3.730 Preparing to unpack .../15-binutils-aarch64-linux-gnu_2.40-2_arm64.deb ... 3.731 Unpacking binutils-aarch64-linux-gnu (2.40-2) ... 3.908 Selecting previously unselected package binutils. 3.909 Preparing to unpack .../16-binutils_2.40-2_arm64.deb ... 3.911 Unpacking binutils (2.40-2) ... 3.928 Selecting previously unselected package libisl23:arm64. 3.929 Preparing to unpack .../17-libisl23_0.25-1.1_arm64.deb ... 3.930 Unpacking libisl23:arm64 (0.25-1.1) ... 3.976 Selecting previously unselected package libmpfr6:arm64. 3.977 Preparing to unpack .../18-libmpfr6_4.2.0-1_arm64.deb ... 3.978 Unpacking libmpfr6:arm64 (4.2.0-1) ... 4.005 Selecting previously unselected package libmpc3:arm64. 4.007 Preparing to unpack .../19-libmpc3_1.3.1-1_arm64.deb ... 4.008 Unpacking libmpc3:arm64 (1.3.1-1) ... 4.020 Selecting previously unselected package cpp-12. 4.021 Preparing to unpack .../20-cpp-12_12.2.0-14_arm64.deb ... 4.022 Unpacking cpp-12 (12.2.0-14) ... 4.412 Selecting previously unselected package cpp. 4.413 Preparing to unpack .../21-cpp_4%3a12.2.0-3_arm64.deb ... 4.415 Unpacking cpp (4:12.2.0-3) ... 4.426 Selecting previously unselected package libcc1-0:arm64. 4.427 Preparing to unpack .../22-libcc1-0_12.2.0-14_arm64.deb ... 4.428 Unpacking libcc1-0:arm64 (12.2.0-14) ... 4.441 Selecting previously unselected package libitm1:arm64. 4.442 Preparing to unpack .../23-libitm1_12.2.0-14_arm64.deb ... 4.444 Unpacking libitm1:arm64 (12.2.0-14) ... 4.456 Selecting previously unselected package libasan8:arm64. 4.458 Preparing to unpack .../24-libasan8_12.2.0-14_arm64.deb ... 4.459 Unpacking libasan8:arm64 (12.2.0-14) ... 4.583 Selecting previously unselected package liblsan0:arm64. 4.584 Preparing to unpack .../25-liblsan0_12.2.0-14_arm64.deb ... 4.585 Unpacking liblsan0:arm64 (12.2.0-14) ... 4.645 Selecting previously unselected package libtsan2:arm64. 4.647 Preparing to unpack .../26-libtsan2_12.2.0-14_arm64.deb ... 4.648 Unpacking libtsan2:arm64 (12.2.0-14) ... 4.776 Selecting previously unselected package libubsan1:arm64. 4.778 Preparing to unpack .../27-libubsan1_12.2.0-14_arm64.deb ... 4.779 Unpacking libubsan1:arm64 (12.2.0-14) ... 4.836 Selecting previously unselected package libhwasan0:arm64. 4.837 Preparing to unpack .../28-libhwasan0_12.2.0-14_arm64.deb ... 4.839 Unpacking libhwasan0:arm64 (12.2.0-14) ... 4.901 Selecting previously unselected package libgcc-12-dev:arm64. 4.903 Preparing to unpack .../29-libgcc-12-dev_12.2.0-14_arm64.deb ... 4.904 Unpacking libgcc-12-dev:arm64 (12.2.0-14) ... 4.980 Selecting previously unselected package gcc-12. 4.982 Preparing to unpack .../30-gcc-12_12.2.0-14_arm64.deb ... 4.983 Unpacking gcc-12 (12.2.0-14) ... 5.446 Selecting previously unselected package gcc. 5.448 Preparing to unpack .../31-gcc_4%3a12.2.0-3_arm64.deb ... 5.449 Unpacking gcc (4:12.2.0-3) ... 5.461 Selecting previously unselected package libstdc++-12-dev:arm64. 5.462 Preparing to unpack .../32-libstdc++-12-dev_12.2.0-14_arm64.deb ... 5.463 Unpacking libstdc++-12-dev:arm64 (12.2.0-14) ... 5.596 Selecting previously unselected package g++-12. 5.598 Preparing to unpack .../33-g++-12_12.2.0-14_arm64.deb ... 5.599 Unpacking g++-12 (12.2.0-14) ... 6.000 Selecting previously unselected package g++. 6.001 Preparing to unpack .../34-g++_4%3a12.2.0-3_arm64.deb ... 6.002 Unpacking g++ (4:12.2.0-3) ... 6.012 Selecting previously unselected package make. 6.013 Preparing to unpack .../35-make_4.3-4.1_arm64.deb ... 6.015 Unpacking make (4.3-4.1) ... 6.045 Selecting previously unselected package libdpkg-perl. 6.047 Preparing to unpack .../36-libdpkg-perl_1.21.22_all.deb ... 6.048 Unpacking libdpkg-perl (1.21.22) ... 6.084 Selecting previously unselected package patch. 6.085 Preparing to unpack .../37-patch_2.7.6-7_arm64.deb ... 6.086 Unpacking patch (2.7.6-7) ... 6.102 Selecting previously unselected package dpkg-dev. 6.103 Preparing to unpack .../38-dpkg-dev_1.21.22_all.deb ... 6.104 Unpacking dpkg-dev (1.21.22) ... 6.171 Selecting previously unselected package build-essential. 6.173 Preparing to unpack .../39-build-essential_12.9_arm64.deb ... 6.174 Unpacking build-essential (12.9) ... 6.183 Selecting previously unselected package libldap-dev:arm64. 6.184 Preparing to unpack .../40-libldap-dev_2.5.13+dfsg-5_arm64.deb ... 6.186 Unpacking libldap-dev:arm64 (2.5.13+dfsg-5) ... 6.213 Selecting previously unselected package libldap2-dev. 6.215 Preparing to unpack .../41-libldap2-dev_2.5.13+dfsg-5_all.deb ... 6.216 Unpacking libldap2-dev (2.5.13+dfsg-5) ... 6.226 Selecting previously unselected package libsasl2-dev. 6.228 Preparing to unpack .../42-libsasl2-dev_2.1.28+dfsg-10_arm64.deb ... 6.229 Unpacking libsasl2-dev (2.1.28+dfsg-10) ... 6.252 Selecting previously unselected package libssl-dev:arm64. 6.253 Preparing to unpack .../43-libssl-dev_3.0.15-1~deb12u1_arm64.deb ... 6.254 Unpacking libssl-dev:arm64 (3.0.15-1~deb12u1) ... 6.381 Preparing to unpack .../44-openssl_3.0.15-1~deb12u1_arm64.deb ... 6.384 Unpacking openssl (3.0.15-1~deb12u1) over (3.0.14-1~deb12u2) ... 6.457 Selecting previously unselected package python3-pip-whl. 6.459 Preparing to unpack .../45-python3-pip-whl_23.0.1+dfsg-1_all.deb ... 6.460 Unpacking python3-pip-whl (23.0.1+dfsg-1) ... 6.531 Selecting previously unselected package python3-setuptools-whl. 6.532 Preparing to unpack .../46-python3-setuptools-whl_66.1.1-1_all.deb ... 6.534 Unpacking python3-setuptools-whl (66.1.1-1) ... 6.578 Selecting previously unselected package python3-lib2to3. 6.580 Preparing to unpack .../47-python3-lib2to3_3.11.2-3_all.deb ... 6.581 Unpacking python3-lib2to3 (3.11.2-3) ... 6.597 Selecting previously unselected package python3-distutils. 6.598 Preparing to unpack .../48-python3-distutils_3.11.2-3_all.deb ... 6.599 Unpacking python3-distutils (3.11.2-3) ... 6.616 Selecting previously unselected package python3.11-venv. 6.618 Preparing to unpack .../49-python3.11-venv_3.11.2-6+deb12u4_arm64.deb ... 6.619 Unpacking python3.11-venv (3.11.2-6+deb12u4) ... 6.628 Selecting previously unselected package python3-venv. 6.629 Preparing to unpack .../50-python3-venv_3.11.2-1+b1_arm64.deb ... 6.630 Unpacking python3-venv (3.11.2-1+b1) ... 6.640 Selecting previously unselected package python3-argcomplete. 6.642 Preparing to unpack .../51-python3-argcomplete_2.0.0-1_all.deb ... 6.643 Unpacking python3-argcomplete (2.0.0-1) ... 6.655 Selecting previously unselected package python3-packaging. 6.656 Preparing to unpack .../52-python3-packaging_23.0-1_all.deb ... 6.657 Unpacking python3-packaging (23.0-1) ... 6.669 Selecting previously unselected package python3-colorama. 6.671 Preparing to unpack .../53-python3-colorama_0.4.6-2_all.deb ... 6.672 Unpacking python3-colorama (0.4.6-2) ... 6.684 Selecting previously unselected package python3-click. 6.685 Preparing to unpack .../54-python3-click_8.1.3-2_all.deb ... 6.687 Unpacking python3-click (8.1.3-2) ... 6.701 Selecting previously unselected package python3-userpath. 6.703 Preparing to unpack .../55-python3-userpath_1.8.0-1_all.deb ... 6.704 Unpacking python3-userpath (1.8.0-1) ... 6.715 Selecting previously unselected package pipx. 6.716 Preparing to unpack .../56-pipx_1.1.0-1_all.deb ... 6.717 Unpacking pipx (1.1.0-1) ... 6.750 Selecting previously unselected package python3-pyasn1. 6.751 Preparing to unpack .../57-python3-pyasn1_0.4.8-3_all.deb ... 6.752 Unpacking python3-pyasn1 (0.4.8-3) ... 6.766 Selecting previously unselected package python3-pyasn1-modules. 6.768 Preparing to unpack .../58-python3-pyasn1-modules_0.2.8-1_all.deb ... 6.769 Unpacking python3-pyasn1-modules (0.2.8-1) ... 6.786 Selecting previously unselected package python3-ldap. 6.788 Preparing to unpack .../59-python3-ldap_3.4.3-2+b2_arm64.deb ... 6.789 Unpacking python3-ldap (3.4.3-2+b2) ... 6.805 Selecting previously unselected package python3-msgpack. 6.807 Preparing to unpack .../60-python3-msgpack_1.0.3-2+b1_arm64.deb ... 6.808 Unpacking python3-msgpack (1.0.3-2+b1) ... 6.822 Selecting previously unselected package python3-mutagen. 6.824 Preparing to unpack .../61-python3-mutagen_1.46.0-1_all.deb ... 6.825 Unpacking python3-mutagen (1.46.0-1) ... 6.842 Selecting previously unselected package python3-pycryptodome. 6.843 Preparing to unpack .../62-python3-pycryptodome_3.11.0+dfsg1-4_arm64.deb ... 6.844 Unpacking python3-pycryptodome (3.11.0+dfsg1-4) ... 6.916 Selecting previously unselected package python3-regex. 6.917 Preparing to unpack .../63-python3-regex_0.1.20221031-1+b1_arm64.deb ... 6.920 Unpacking python3-regex (0.1.20221031-1+b1) ... 6.951 Setting up python3-setuptools-whl (66.1.1-1) ... 6.955 Setting up python3-colorama (0.4.6-2) ... 7.095 Setting up python3-pip-whl (23.0.1+dfsg-1) ... 7.098 Setting up python3-pycryptodome (3.11.0+dfsg1-4) ... 7.289 Setting up python3-mutagen (1.46.0-1) ... 7.398 Setting up binutils-common:arm64 (2.40-2) ... 7.402 Setting up libssl3:arm64 (3.0.15-1~deb12u1) ... 7.405 Setting up libctf-nobfd0:arm64 (2.40-2) ... 7.408 Setting up python3-click (8.1.3-2) ... 7.493 Setting up bzip2 (1.0.8-5+b1) ... 7.498 Setting up libjansson4:arm64 (2.14-2) ... 7.501 Setting up libsasl2-dev (2.1.28+dfsg-10) ... 7.505 Setting up python3-packaging (23.0-1) ... 7.575 Setting up make (4.3-4.1) ... 7.578 Setting up libmpfr6:arm64 (4.2.0-1) ... 7.582 Setting up libldap-dev:arm64 (2.5.13+dfsg-5) ... 7.585 Setting up xz-utils (5.4.1-0.2) ... 7.589 update-alternatives: using /usr/bin/xz to provide /usr/bin/lzma (lzma) in auto mode 7.589 update-alternatives: warning: skip creation of /usr/share/man/man1/lzma.1.gz because associated file /usr/share/man/man1/xz.1.gz (of link group lzma) doesn't exist 7.589 update-alternatives: warning: skip creation of /usr/share/man/man1/unlzma.1.gz because associated file /usr/share/man/man1/unxz.1.gz (of link group lzma) doesn't exist 7.590 update-alternatives: warning: skip creation of /usr/share/man/man1/lzcat.1.gz because associated file /usr/share/man/man1/xzcat.1.gz (of link group lzma) doesn't exist 7.590 update-alternatives: warning: skip creation of /usr/share/man/man1/lzmore.1.gz because associated file /usr/share/man/man1/xzmore.1.gz (of link group lzma) doesn't exist 7.590 update-alternatives: warning: skip creation of /usr/share/man/man1/lzless.1.gz because associated file /usr/share/man/man1/xzless.1.gz (of link group lzma) doesn't exist 7.590 update-alternatives: warning: skip creation of /usr/share/man/man1/lzdiff.1.gz because associated file /usr/share/man/man1/xzdiff.1.gz (of link group lzma) doesn't exist 7.590 update-alternatives: warning: skip creation of /usr/share/man/man1/lzcmp.1.gz because associated file /usr/share/man/man1/xzcmp.1.gz (of link group lzma) doesn't exist 7.590 update-alternatives: warning: skip creation of /usr/share/man/man1/lzgrep.1.gz because associated file /usr/share/man/man1/xzgrep.1.gz (of link group lzma) doesn't exist 7.590 update-alternatives: warning: skip creation of /usr/share/man/man1/lzegrep.1.gz because associated file /usr/share/man/man1/xzegrep.1.gz (of link group lzma) doesn't exist 7.590 update-alternatives: warning: skip creation of /usr/share/man/man1/lzfgrep.1.gz because associated file /usr/share/man/man1/xzfgrep.1.gz (of link group lzma) doesn't exist 7.592 Setting up libproc2-0:arm64 (2:4.0.2-3) ... 7.595 Setting up libssl-dev:arm64 (3.0.15-1~deb12u1) ... 7.598 Setting up libmpc3:arm64 (1.3.1-1) ... 7.601 Setting up patch (2.7.6-7) ... 7.604 Setting up python3-regex (0.1.20221031-1+b1) ... 7.704 Setting up libdpkg-perl (1.21.22) ... 7.707 Setting up libubsan1:arm64 (12.2.0-14) ... 7.710 Setting up libhwasan0:arm64 (12.2.0-14) ... 7.713 Setting up libasan8:arm64 (12.2.0-14) ... 7.717 Setting up procps (2:4.0.2-3) ... 7.730 Setting up python3-pyasn1 (0.4.8-3) ... 7.813 Setting up python3-msgpack (1.0.3-2+b1) ... 7.875 Setting up libpython3.11-minimal:arm64 (3.11.2-6+deb12u4) ... 7.880 Setting up libtsan2:arm64 (12.2.0-14) ... 7.883 Setting up libbinutils:arm64 (2.40-2) ... 7.886 Setting up libisl23:arm64 (0.25-1.1) ... 7.889 Setting up python3-argcomplete (2.0.0-1) ... 7.950 Setting up openssl (3.0.15-1~deb12u1) ... 7.954 Setting up python3-lib2to3 (3.11.2-3) ... 8.005 Setting up libcc1-0:arm64 (12.2.0-14) ... 8.008 Setting up liblsan0:arm64 (12.2.0-14) ... 8.011 Setting up libitm1:arm64 (12.2.0-14) ... 8.014 Setting up python3-userpath (1.8.0-1) ... 8.072 Setting up libctf0:arm64 (2.40-2) ... 8.076 Setting up python3-distutils (3.11.2-3) ... 8.136 Setting up python3.11-minimal (3.11.2-6+deb12u4) ... 8.434 Setting up cpp-12 (12.2.0-14) ... 8.437 Setting up libpython3.11-stdlib:arm64 (3.11.2-6+deb12u4) ... 8.441 Setting up libldap2-dev (2.5.13+dfsg-5) ... 8.444 Setting up libgprofng0:arm64 (2.40-2) ... 8.447 Setting up python3-pyasn1-modules (0.2.8-1) ... 8.555 Setting up libgcc-12-dev:arm64 (12.2.0-14) ... 8.559 Setting up cpp (4:12.2.0-3) ... 8.563 Setting up python3-ldap (3.4.3-2+b2) ... 8.641 Setting up python3.11 (3.11.2-6+deb12u4) ... 9.022 Setting up libstdc++-12-dev:arm64 (12.2.0-14) ... 9.028 Setting up binutils-aarch64-linux-gnu (2.40-2) ... 9.031 Setting up binutils (2.40-2) ... 9.034 Setting up dpkg-dev (1.21.22) ... 9.038 Setting up python3.11-venv (3.11.2-6+deb12u4) ... 9.064 Setting up gcc-12 (12.2.0-14) ... 9.068 Setting up g++-12 (12.2.0-14) ... 9.070 Setting up gcc (4:12.2.0-3) ... 9.077 Setting up python3-venv (3.11.2-1+b1) ... 9.080 Setting up g++ (4:12.2.0-3) ... 9.083 update-alternatives: using /usr/bin/g++ to provide /usr/bin/c++ (c++) in auto mode 9.085 Setting up build-essential (12.9) ... 9.087 Setting up pipx (1.1.0-1) ... 9.156 Processing triggers for libc-bin (2.36-9+deb12u8) ... 9.424 Obtaining file:///Users/squash/Local/Code/archiveboxes/archivebox7/archivebox/pkgs/abx (from -r requirements.txt (line 3)) 9.424 ERROR: file:///Users/squash/Local/Code/archiveboxes/archivebox7/archivebox/pkgs/abx (from -r requirements.txt (line 3)) does not appear to be a Python project: neither 'setup.py' nor 'pyproject.toml' found. ------ Dockerfile:271 -------------------- 270 | COPY --chown=root:root --chmod=755 "./pyproject.toml" "requirements.txt" "$CODE_DIR"/ 271 | >>> RUN --mount=type=cache,target=/var/cache/apt,sharing=locked,id=apt-$TARGETARCH$TARGETVARIANT --mount=type=cache,target=/root/.cache/pip,sharing=locked,id=pip-$TARGETARCH$TARGETVARIANT \ 272 | >>> echo "[+] Installing PIP ArchiveBox dependencies from requirements.txt for ${TARGETPLATFORM}..." \ 273 | >>> && apt-get update -qq \ 274 | >>> && apt-get install -qq -y -t bookworm-backports \ 275 | >>> build-essential gcc \ 276 | >>> libssl-dev libldap2-dev libsasl2-dev \ 277 | >>> python3-ldap python3-msgpack python3-mutagen python3-regex python3-pycryptodome procps \ 278 | >>> pipx \ 279 | >>> # && ln -s "$GLOBAL_VENV" "$APP_VENV" \ 280 | >>> # && pdm use --venv in-project \ 281 | >>> # && pdm run python -m ensurepip \ 282 | >>> # && pdm sync --fail-fast --no-editable --group :all --no-self \ 283 | >>> # && pdm export -o requirements.txt --without-hashes \ 284 | >>> # && source $GLOBAL_VENV/bin/activate \ 285 | >>> && pip install -r requirements.txt \ 286 | >>> && apt-get purge -y \ 287 | >>> build-essential gcc \ 288 | >>> && apt-get autoremove -y \ 289 | >>> && rm -rf /var/lib/apt/lists/* 290 | -------------------- ERROR: failed to solve: process "/bin/bash -o pipefail -o errexit -o errtrace -o nounset -c echo \"[+] Installing PIP ArchiveBox dependencies from requirements.txt for ${TARGETPLATFORM}...\" && apt-get update -qq && apt-get install -qq -y -t bookworm-backports build-essential gcc libssl-dev libldap2-dev libsasl2-dev python3-ldap python3-msgpack python3-mutagen python3-regex python3-pycryptodome procps pipx && pip install -r requirements.txt && apt-get purge -y build-essential gcc && apt-get autoremove -y && rm -rf /var/lib/apt/lists/*" did not complete successfully: exit code: 1 View build details: docker-desktop://dashboard/build/desktop-linux/desktop-linux/lexvezdpgjyd4ebwla9u1k50e ``` ### ArchiveBox Version ```shell commit a9a3b153b11e8070d23f6aed5eb7169c60eb3a5e (HEAD -> dev, origin/dev, origin/HEAD) Date: Mon Nov 4 07:08:31 2024 -0800 more StateMachine, Actor, and Orchestrator improvements ``` ### How did you install the version of ArchiveBox you are using? Docker (or other container system like podman/LXC/Kubernetes or TrueNAS/Cloudron/YunoHost/etc.) ### What operating system are you running on? macOS (including Docker on macOS) ### What type of drive are you using to store your ArchiveBox data? - [x] `data/` is on a local SSD or NVMe drive - [ ] `data/` is on a spinning hard drive or external USB drive - [ ] `data/` is on a network mount (e.g. NFS/SMB/CIFS/etc.) - [ ] `data/` is on a FUSE mount (e.g. SSHFS/RClone/S3/B2/OneDrive, etc.) ### Docker Compose Configuration ```shell I'm using the Dockerfile in the repo. ``` ### ArchiveBox Configuration ```shell n/a ```
kerem closed this issue 2026-03-01 17:59:12 +03:00
Author
Owner

@pirate commented on GitHub (Nov 12, 2024):

Yeah sorry I haven't pushed all my WIP code to dev yet, it's under heavy active development right now and I'm changing thousands of lines a day as I hone in on a final design for the new plugin architecture https://docs.monadical.com/s/1BvXxNKwT + https://github.com/ArchiveBox/abx-spec-behaviors.

If you're trying to run dev to contribute stuff then hang tight and check back in a bit, otherwise if you're trying dev because you just want to try the new BETA features then I recommend using the latest tagged release instead or v0.8.5rc50 https://github.com/ArchiveBox/ArchiveBox/releases

<!-- gh-comment-id:2469377392 --> @pirate commented on GitHub (Nov 12, 2024): Yeah sorry I haven't pushed all my WIP code to `dev` yet, it's under heavy active development right now and I'm changing thousands of lines a day as I hone in on a final design for the new plugin architecture https://docs.monadical.com/s/1BvXxNKwT + https://github.com/ArchiveBox/abx-spec-behaviors. If you're trying to run `dev` to contribute stuff then hang tight and check back in a bit, otherwise if you're trying `dev` because you just want to try the new BETA features then I recommend using the latest tagged release instead or `v0.8.5rc50` https://github.com/ArchiveBox/ArchiveBox/releases
Author
Owner

@nguyenmp commented on GitHub (Nov 12, 2024):

That makes sense, I'll just pull in whenever there's a release then.

I have a forked version of ArchiveBox with some minor patches to work around some yt-dlp issues I encountered. Specifically, I run it through a socks5 proxy and use oauth.

<!-- gh-comment-id:2471089169 --> @nguyenmp commented on GitHub (Nov 12, 2024): That makes sense, I'll just pull in whenever there's a release then. I have a forked version of ArchiveBox with some minor patches to work around some `yt-dlp` issues I encountered. Specifically, I run it through a socks5 proxy and use oauth.
Author
Owner

@elixx commented on GitHub (Dec 17, 2024):

I'm seeing similar issues to this with the current dev branch, and it looks like requirements.txt has a merge conflict committed, and a bunch of references to a local file:///Volumes/NVME/Users/squash/Local/Code/archiveboxes/ArchiveBox7/archivebox/pkgs/... path.

I have an issue after a server migration where I was running a release at one point, and switched to dev, and then back where I need to manually build an image and adjust some things or get dev running again.

<!-- gh-comment-id:2548509287 --> @elixx commented on GitHub (Dec 17, 2024): I'm seeing similar issues to this with the current `dev` branch, and it looks like requirements.txt has a merge conflict committed, and a bunch of references to a local `file:///Volumes/NVME/Users/squash/Local/Code/archiveboxes/ArchiveBox7/archivebox/pkgs/...` path. I have an issue after a server migration where I was running a release at one point, and switched to dev, and then back where I need to manually build an image and adjust some things or get dev running again.
Author
Owner

@pirate commented on GitHub (Dec 17, 2024):

Do not run dev, it is not in a runnable state and you are 100% going to lose data because I change models all the time without committing migrations on dev. it's in the middle of major refactoring work.

stick to the tagged releases like 0.8.5rc51 where there are migrations and its designed to be used by people besides me.

Also: https://github.com/ArchiveBox/ArchiveBox/issues/1620#issuecomment-2544593080

<!-- gh-comment-id:2549767039 --> @pirate commented on GitHub (Dec 17, 2024): Do not run dev, it is not in a runnable state and you are 100% going to lose data because I change models all the time without committing migrations on dev. it's in the middle of major refactoring work. stick to the tagged releases like 0.8.5rc51 where there are migrations and its designed to be used by people besides me. Also: https://github.com/ArchiveBox/ArchiveBox/issues/1620#issuecomment-2544593080
Author
Owner

@elixx commented on GitHub (Dec 18, 2024):

This doesn't help to resolve my issue at all.
I'd like to point out that the default branch on the main repo page is dev, and there are a bunch of references in the docs that point to building it.

<!-- gh-comment-id:2550155710 --> @elixx commented on GitHub (Dec 18, 2024): This doesn't help to resolve my issue at all. I'd like to point out that the default branch on the main repo page is `dev`, and there are a bunch of references in the docs that point to building it.
Author
Owner

@pirate commented on GitHub (Dec 18, 2024):

the default branch on the main repo page is dev, and there are a bunch of references in the docs that point to building it.

  • Default branch = branch that PR's are based on by default (dev is correct, I don't ever want PRs directly to main). However, I'm doing a bunch of (once-every-5-years) core refactoring work right now and so dev is not in a runnable state suitable for public contributions. If you want to contribute / do development work please open an issue first and describe what you want to work on so it can be prioritized and triaged first. Once v0.9.0 is out, then I'll be ready to accept drive-by public contributions without prior coordination again, and dev will be auto-tested with the new CI pipeline to make that process easy.

  • Releases = code that is ready for users to run, there are tagged BETA pre-releases available if you want to test the cutting-edge, or use the stable v0.7.3 if you want something more battle-tested. Attempting to run any untagged code will lead to data loss when you try to upgrade it later as there are no migrations for untagged branches.


This doesn't help to resolve my issue at all.

I don't want people contributing big changes to dev right now. Contributions in the next month that don't fit into the process I described above are negative utility for me right now because they cause a bunch of extra busywork work to try and shoehorn changes into dev mid-refactor. Open an issue, describe the changes you want, but don't write any code based on dev until after v0.9.0 drops. If you cant wait, pay for ArchiveBox consulting and get early access, professional support, and custom new features built at your request.

See here more more info too: https://github.com/ArchiveBox/ArchiveBox/issues/1526

<!-- gh-comment-id:2550244852 --> @pirate commented on GitHub (Dec 18, 2024): > the default branch on the main repo page is dev, and there are a bunch of references in the docs that point to building it. - Default branch = branch that PR's are based on by default (`dev` is correct, I don't ever want PRs directly to `main`). However, I'm doing a bunch of (once-every-5-years) core refactoring work right now and so `dev` is not in a runnable state suitable for public contributions. If you want to contribute / do development work please open an issue first and describe what you want to work on so it can be prioritized and triaged first. Once v0.9.0 is out, then I'll be ready to accept drive-by public contributions without prior coordination again, and `dev` will be auto-tested with the new CI pipeline to make that process easy. - Releases = code that is ready for users to run, there are tagged BETA pre-releases available if you want to test the cutting-edge, or use the stable v0.7.3 if you want something more battle-tested. Attempting to run any untagged code *will* lead to data loss when you try to upgrade it later as **there are no migrations for untagged branches**. --- > This doesn't help to resolve my issue at all. I don't want people contributing big changes to dev right now. Contributions in the next month that don't fit into the process I described above are negative utility for me right now because they cause a bunch of extra busywork work to try and shoehorn changes into dev mid-refactor. Open an issue, describe the changes you want, but don't write any code based on `dev` until after v0.9.0 drops. If you cant wait, [pay](https://docs.monadical.com/s/archivebox-consulting-services) for ArchiveBox consulting and get early access, professional support, and custom new features built at your request. See here more more info too: https://github.com/ArchiveBox/ArchiveBox/issues/1526
Author
Owner

@pirate commented on GitHub (Dec 18, 2024):

FYI I removed requirements.txt entirely. uv is now used for the Docker build. c54b9446

<!-- gh-comment-id:2550352892 --> @pirate commented on GitHub (Dec 18, 2024): FYI I removed `requirements.txt` entirely. `uv` is now used for the Docker build. c54b9446
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/ArchiveBox#2460
No description provided.