Fix dts-check command and use Pip for some Python packages instead of APT

[ColorfulRhino]

Description

Please see the commit messages for details on each change.

Fixes: https://paste.armbian.com/ezuliwofij.bash

This will also make sure that build hosts don't use inconsistent versions for python3-setuptools and python3-pyelftools. These are vastly different if you compare these packages on e.g. Ubuntu Jammy and Ubuntu Noble.
Pip packages will automatically be updated via Dependabot.

In addition, this change will improve compatibility with other build host OSs since Pip is independant.

In total, these Python packages are not needed anymore on the build host/do not need to be installed:

python3-automat python3-bcrypt python3-click python3-colorama python3-constantly python3-hamcrest python3-hyperlink python3-incremental python3-pyasn1 python3-pyasn1-modules python3-pycurl python3-service-identity python3-twisted python3-wheel python3-zope.interface python3-setuptools python3-pyelftools

--> Much smaller APT package footprint ✅

How Has This Been Tested?

• ./compile.sh dts-check BOARD=nanopi-r6c BRANCH=edge BUILD_DESKTOP=no BUILD_MINIMAL=yes EXPERT=yes KERNEL_CONFIGURE=no RELEASE=trixie while using no-cache-dir with pip, build host Ubuntu Noble

Checklist:

• My code follows the style guidelines of this project
• I have performed a self-review of my own code
• I have commented my code, particularly in hard-to-understand areas
• My changes generate no new warnings
• Any dependent changes have been merged and published in downstream modules

[igorpecovnik]

Builds also on Jammy, looks fine.

[ColorfulRhino]

Builds also on Jammy, looks fine.

Thanks for testing 👍

[rpardini]

@ColorfulRhino breakage here, I think. u-boot's requiring elftools are not finding it. https://paste.next.armbian.com/busaleqife

[rpardini]

Yeah. Partially reverting this fixes it; I think some ENVs will need to be set for the u-boot-called Python to find the requirements.txt-installed dependencies.

Subject: [PATCH] (partially) Revert "python: Move `python3-setuptools` and `python3-pyelftools` to requirements.txt"
diff --git a/lib/functions/host/prepare-host.sh b/lib/functions/host/prepare-host.sh
--- a/lib/functions/host/prepare-host.sh	(revision 8214d9d9d227591d0a15f8d24932e3db8400bfab)
+++ b/lib/functions/host/prepare-host.sh	(revision d55f2ed9fb955ad4fac4fc721ca75e7b42e2075d)
@@ -290,8 +290,7 @@
 	host_deps_add_extra_python # See python-tools.sh::host_deps_add_extra_python()
 
 	### Python3 -- required for Armbian's Python tooling, and also for more recent u-boot builds. Needs 3.9+; ffi-dev is needed for some Python packages when the wheel is not prebuilt
-	### 'python3-setuptools' and 'python3-pyelftools' moved to requirements.txt to make sure build hosts use the same/latest versions of these tools.
-	host_dependencies+=("python3-dev" "python3-pip" "libffi-dev")
+	host_dependencies+=("python3-dev" "python3-setuptools" "python3-pip" "python3-pyelftools" "libffi-dev")
 
 	# Needed for some u-boot's, lest "tools/mkeficapsule.c:21:10: fatal error: gnutls/gnutls.h"
 	host_dependencies+=("libgnutls28-dev")

@ColorfulRhino

[rpardini]

Send this partial revert -- it brings back the hostdeps, while keeping the requirements.txt -- so that @ColorfulRhino can calmly fix it. #6818

[ColorfulRhino]

Send this partial revert -- it brings back the hostdeps, while keeping the requirements.txt -- so that @ColorfulRhino can calmly fix it. #6818

Yes, calmly is a good idea 😌

[ColorfulRhino]

@rpardini I think wherever U-Boot is built just needs the same treatment as make, including the Python packages in the PATH,. since Armbian build script does not use the systems usual Python path to install pip packages.

See here what changed for make: https://github.com/armbian/build/pull/6739/files#diff-4347825abd7145eafaff34b8c24e1f33bf3938cb89ecda7347294ca1b0a99ac7

[rpardini]

Yeah, might be PYTHONPATH solves it.

[ColorfulRhino]

Yeah, might be PYTHONPATH solves it.

Yes, it's very likely. Do you know exactly where this could be inserted? I need to find the place

Maybe somewhere here?

build/lib/functions/compilation/uboot.sh

Line 354 in 8ca4068

gcc_version_main="$(eval env PATH="${toolchain}:${toolchain2}:${PATH}" "${UBOOT_COMPILER}gcc" -dumpfullversion -dumpversion)"

[ColorfulRhino]

Maybe https://github.com/armbian/build/blob/main/lib/functions/compilation/uboot.sh needs a little makeover like kernel-make.sh to set the ENVs once, because in the u-boot file the envs are all over the place so it's difficult to know where to insert the PATH and/or PYTHONPATH 😅