buildbot/docker/buildworker, branch v19

buildworker: start: fix leaking BUILDWORKER_TLS env variable

2024-09-28T17:17:50Z

I've noticed leakage of BUILDWORKER_TLS environment variable in build logs, so lets fix it in a generic way via new `cleanup_buildworker_env_variables()` by using Bash's parameter expansion and unset all environment variables starting with BUILDWORKER_ prefix. Signed-off-by: Petr Štetiar

docker: buildworker: add missing file package

2024-09-27T07:39:12Z

In Debian 11 (Bullseye), the `file` package was installed indirectly because the `man-db` package recommended it. The `man-db` package is often installed as a dependency of other packages, such as `build-essential` and tools like `gcc` and `make`. By default, `apt-get` installs recommended packages, so `file` was installed automatically. Starting from Debian 12 (Bookworm), the `man-db` package no longer recommends the `file` package. This change was made to reduce the size of minimal container images and installations where `file` is not essential. So lets install this package explicitly. Signed-off-by: Petr Štetiar

buildworker: start: fix worker startup failure after update

2024-09-26T21:21:09Z

Workers are currently refusing to work: Unhandled Error Traceback (most recent call last): File "/opt/venv/lib/python3.11/site-packages/twisted/application/app.py", line 673, in run runApp(config) File "/opt/venv/lib/python3.11/site-packages/twisted/scripts/twistd.py", line 29, in runApp runner.run() File "/opt/venv/lib/python3.11/site-packages/twisted/application/app.py", line 370, in run self.application = self.createOrGetApplication() File "/opt/venv/lib/python3.11/site-packages/twisted/application/app.py", line 437, in createOrGetApplication application = getApplication(self.config, passphrase) --- --- File "/opt/venv/lib/python3.11/site-packages/twisted/application/app.py", line 446, in getApplication application = service.loadApplication(filename, style, passphrase) File "/opt/venv/lib/python3.11/site-packages/twisted/application/service.py", line 404, in loadApplication application = sob.loadValueFromFile(filename, "application") File "/opt/venv/lib/python3.11/site-packages/twisted/persisted/sob.py", line 174, in loadValueFromFile codeObj = compile(data, filename, "exec") builtins.SyntaxError: keyword argument repeated: connection_string (buildbot.tac, line 49) as the buildbot.tac template changed in commit 4ba1dcb66155 ("worker: Add option --connection-string for create-worker") and in version v3.10.0. So lets use this new `--connection-string` feature and get rid of the sed-fu. Fixes: efbddc90d8e6 ("Bump buildbot to v3.11.1 release") Signed-off-by: Petr Štetiar

buildworker: Drop installation of Python 2

2024-09-26T11:19:17Z

Old releases of OpenWrt would require it but that's something of the past - time is running. Signed-off-by: Paul Spooren

buildworker,buildmaster: Use venv for Pip

2024-09-26T11:19:16Z

Debian 12 complains if using Pip without a virtualenv since it could break the system. Signed-off-by: Paul Spooren

buildworker,buildmaster: bump Debian to version 12

2024-09-26T08:05:21Z

Debian 11 LTS support ends in June 2026, so it's probably around the time when support for the OpenWrt 24.10 release might end. Therefore, let's switch to Debian 12, which should have LTS support until June 2028 and is the latest and greatest. Signed-off-by: Petr Štetiar

docker,worker: install zstd

2023-11-14T17:10:22Z

Faster compression with partly better rates. Should be used eventually for ImageBuilders etc. Signed-off-by: Paul Spooren

docker,worker: install pyelftools

2023-07-28T06:51:08Z

UBoot version of at least 2023.07.02 that use binman also have a dependency of pyelftools on the build host. Signed-off-by: Ben Whitten Signed-off-by: Petr Štetiar [whitespace fix]

docker,worker: install g++-multilib

2023-05-17T09:27:07Z

From [openwrt/docker@5484951][1] (GitHub PR [#89][2]): Node fails to cross-compile from a 64-bit build machine to 32-bit host with the following error: ``` In file included from /usr/include/c++/8/memory:62, from ../deps/v8/src/libplatform/default-foreground-task-runner.h:8, from ../deps/v8/src/libplatform/default-foreground-task-runner.cc:5: /usr/include/c++/8/bits/stl_algobase.h:59:10: fatal error: bits/c++config.h: No such file or directory #include ^~~~~~~~~~~~~~~~~~ compilation terminated. ``` On Debian, `g++-multilib` can be installed to fix this. [1]: https://gitlab.com/openwrt/docker/-/commit/54849510d7802028b94757051cca6d004a9ca1d1 [2]: https://github.com/openwrt/docker/pull/89 Fixes: https://github.com/openwrt/packages/issues/18476 Fixes: https://forum.openwrt.org/t/why-arent-the-node-and-node-npm-packages-available-on-arm-cortex-a9-vfpv3-d16-in-22-03-2/142722 Signed-off-by: Alois Klink

buildworker,buildmaster: bump Debian to version 11

2023-05-15T15:36:01Z

Debian 10 LTS support ends on 6/2024, so it makes no sense to use it as a base for 23.05 release, so lets switch to Debian 11 which should've LTS support till 6/2026. Signed-off-by: Petr Štetiar