Scripts clean used for busybox casuses rebuilt toolchain

RomMon · June 9, 2017 at 9:23 PM

Using the clean script for busybox seem to cause a rebuild of the build environment(, and fails with compilation of e2fsprogs).

(same for using the clean script for e2fsprogs)

Initial state:

Initially I successfully compiled an 'stock' 8.0.2 image (see [Fixed] Compile error LE 8.0.1, xz: (stdin): File format not recognized), following the wiki page: index.php?title=Compile

Re-compile busybox

To re-compile busybox (e.g. without any config changes made yet) I expected the following would be the required steps:

PROJECT=RPi2 ARCH=arm scripts/clean busybox

PROJECT=RPi2 ARCH=arm make image

I hoped the script more to behave like:

cd ~/LibreELEC.tv/build.LibreELEC-RPi2.arm-8.0.1/busybox-1.25.1/

make clean

cd ~/LibreELEC.tv/build.LibreELEC-RPi2.arm-8.0.1/.stamps

rm -r busybox

Questions

1) Is it expected behaviour that 'scripts/clean busybox' cause so many packages to be rebuild?

2) What are the advised steps to re-compile busybox for the target (PRi2)?

3) Is it possible/needed to properly fix the 'Permission denied' failures for re-compiling e2fsprogs?

4) Is there a fix for the second make error "Could NOT find FreeType (missing: FREETYPE_INCLUDE_DIR) (found version "18.5.12")"?

Resulting steps

(long list just to give in idea how many packages are rebuild)

Code

CLEAN    busybox
  Buildoptions:
   CLEAN    configtools
   UNPACK   configtools
   BUILD    configtools (host)
   CLEAN    make
   UNPACK   make
       APPLY PATCH (common)   ~/LibreELEC.tv.test/packages/devel/make/patches/make-3.82-011-noclock_gettime.patch
       APPLY PATCH (common)   ~/LibreELEC.tv.test/packages/devel/make/patches/make-3.82-016-weird-shell.patch
       FIXCONFIG   build.LibreELEC-RPi2.arm-8.0.2/make-4.2.1/config/
   BUILD    make (host)
   CLEAN    xz
   UNPACK   xz
       FIXCONFIG   build.LibreELEC-RPi2.arm-8.0.2/xz-5.2.2/build-aux/
   CLEAN    ccache
   UNPACK   ccache
       FIXCONFIG   build.LibreELEC-RPi2.arm-8.0.2/ccache-3.3.3/
   BUILD    ccache (host)
   BUILD    xz (host)
   CLEAN    sed
   UNPACK   sed
       FIXCONFIG   build.LibreELEC-RPi2.arm-8.0.2/sed-4.2.2/build-aux/
   BUILD    sed (host)
   CLEAN    pkg-config
   UNPACK   pkg-config
       APPLY PATCH (common)   ~/LibreELEC.tv.test/packages/devel/pkg-config/patches/pkg-config-0001-use-sysroot-path.patch
       FIXCONFIG   build.LibreELEC-RPi2.arm-8.0.2/pkg-config-0.29.1/
       FIXCONFIG   build.LibreELEC-RPi2.arm-8.0.2/pkg-config-0.29.1/glib/
   CLEAN    gettext
   UNPACK   gettext
       APPLY PATCH (common)   ~/LibreELEC.tv.test/packages/devel/gettext/patches/gettext-0.18.2-non_interactive.patch
       APPLY PATCH (common)   ~/LibreELEC.tv.test/packages/devel/gettext/patches/gettext-dont_build_docs_and_examples.patch
       FIXCONFIG   build.LibreELEC-RPi2.arm-8.0.2/gettext-0.19.8.1/gettext-tools/examples/hello-c++-kde/admin/
       FIXCONFIG   build.LibreELEC-RPi2.arm-8.0.2/gettext-0.19.8.1/build-aux/
   BUILD    gettext (host)
   BUILD    pkg-config (host)
   CLEAN    autoconf
   UNPACK   autoconf
       APPLY PATCH (common)   ~/LibreELEC.tv.test/packages/devel/autoconf/patches/autoconf-autoreconf-exclude.patch
       FIXCONFIG   build.LibreELEC-RPi2.arm-8.0.2/autoconf-2.69/build-aux/
   CLEAN    m4
   UNPACK   m4
       FIXCONFIG   build.LibreELEC-RPi2.arm-8.0.2/m4-1.4.17/build-aux/
   BUILD    m4 (host)
   BUILD    autoconf (host)
   CLEAN    automake
   UNPACK   automake
       APPLY PATCH (common)   ~/LibreELEC.tv.test/packages/devel/automake/patches/automake-01-fix-help2man.patch
       FIXCONFIG   build.LibreELEC-RPi2.arm-8.0.2/automake-1.15/lib/
   BUILD    automake (host)
   CLEAN    libtool
   UNPACK   libtool
       APPLY PATCH (common)   ~/LibreELEC.tv.test/packages/devel/libtool/patches/libtool-01_dont_relink_against_host.patch
       APPLY PATCH (common)   ~/LibreELEC.tv.test/packages/devel/libtool/patches/libtool-02-use_ld.patch
       APPLY PATCH (common)   ~/LibreELEC.tv.test/packages/devel/libtool/patches/libtool-03-remove-help2man-dependency.patch
       FIXCONFIG   build.LibreELEC-RPi2.arm-8.0.2/libtool-2.4.6/build-aux/
   BUILD    libtool (host)
   CLEAN    intltool
   UNPACK   intltool
   BUILD    intltool (host)
   CLEAN    autoconf-archive
   UNPACK   autoconf-archive
   BUILD    autoconf-archive (host)
   CLEAN    gcc
   UNPACK   gcc
       APPLY PATCH (common)   ~/LibreELEC.tv.test/packages/lang/gcc/patches/gcc-4.8.2-disable_multilib_i386_linux64.patch
       APPLY PATCH (common)   ~/LibreELEC.tv.test/packages/lang/gcc/patches/gcc-allow-newer-autoconf.patch
       APPLY PATCH (common)   ~/LibreELEC.tv.test/packages/lang/gcc/patches/gcc-crosscompile-badness.patch
       APPLY PATCH (common)   ~/LibreELEC.tv.test/packages/lang/gcc/patches/gcc-reduce-genautomata-memory-footprint-for-arm-bug-70473.patch
       FIXCONFIG   build.LibreELEC-RPi2.arm-8.0.2/gcc-6.2.0/
       FIXCONFIG   build.LibreELEC-RPi2.arm-8.0.2/gcc-6.2.0/libjava/libltdl/
       FIXCONFIG   build.LibreELEC-RPi2.arm-8.0.2/gcc-6.2.0/libjava/classpath/
   CLEAN    binutils
   UNPACK   binutils
       APPLY PATCH (common)   ~/LibreELEC.tv.test/packages/devel/binutils/patches/binutils-01-warn-for-uses-of-system-directories-when-link.patch
       FIXCONFIG   build.LibreELEC-RPi2.arm-8.0.2/binutils-2.27/
   CLEAN    bison
   UNPACK   bison
       FIXCONFIG   build.LibreELEC-RPi2.arm-8.0.2/bison-3.0.4/build-aux/
   BUILD    bison (host)
   CLEAN    flex
   UNPACK   flex
       APPLY PATCH (common)   ~/LibreELEC.tv.test/packages/devel/flex/patches/flex-001-plex.malloc.patch
       FIXCONFIG   build.LibreELEC-RPi2.arm-8.0.2/flex-2.5.39/
   BUILD    flex (host)
   CLEAN    linux
   UNPACK   linux
       APPLY PATCH (common)   ~/LibreELEC.tv.test/packages/linux/patches/linux-004_lower_undefined_mode_timeout.patch
       APPLY PATCH (common)   ~/LibreELEC.tv.test/packages/linux/patches/linux-007_die_floppy_die.patch
       APPLY PATCH (common)   ~/LibreELEC.tv.test/packages/linux/patches/linux-009_disable_i8042_check_on_apple_mac.patch
   BUILD    linux (host)
   BUILD    binutils (host)
   CLEAN    gmp
   UNPACK   gmp
       FIXCONFIG   build.LibreELEC-RPi2.arm-8.0.2/gmp-6.1.1/
   BUILD    gmp (host)
   CLEAN    mpfr
   UNPACK   mpfr
       FIXCONFIG   build.LibreELEC-RPi2.arm-8.0.2/mpfr-3.1.5/
   BUILD    mpfr (host)
   CLEAN    mpc
   UNPACK   mpc
       FIXCONFIG   build.LibreELEC-RPi2.arm-8.0.2/mpc-1.0.3/
   BUILD    mpc (host)
   CLEAN    glibc
   UNPACK   glibc
       APPLY PATCH (common)   ~/LibreELEC.tv.test/packages/devel/glibc/patches/glibc-fix-dns-with-broken-routers.patch
       FIXCONFIG   build.LibreELEC-RPi2.arm-8.0.2/glibc-2.24/scripts/
   BUILD    autotools (host)
   BUILD    gcc (bootstrap)
   BUILD    glibc (target)
   BUILD    gcc (host)
   CLEAN    cmake
   UNPACK   cmake
       APPLY PATCH (common)   ~/LibreELEC.tv.test/packages/devel/cmake/patches/cmake-000-disable-sslv3.patch
       APPLY PATCH (common)   ~/LibreELEC.tv.test/packages/devel/cmake/patches/cmake-001-disable-free-comp-methods.patch
   CLEAN    libressl
   UNPACK   libressl
       APPLY PATCH (common)   ~/LibreELEC.tv.test/packages/security/libressl/patches/libressl-trusted-first.patch
       FIXCONFIG   build.LibreELEC-RPi2.arm-8.0.2/libressl-2.4.4/scripts/
       FIXCONFIG   build.LibreELEC-RPi2.arm-8.0.2/libressl-2.4.4/
   BUILD    libressl (host)
       AUTORECONF   libressl
   BUILD    cmake (host)
   CLEAN    yasm
   UNPACK   yasm
       FIXCONFIG   build.LibreELEC-RPi2.arm-8.0.2/yasm-1.3.0/config/
   BUILD    yasm (host)
   BUILD    toolchain (target)
   CLEAN    squashfs
   UNPACK   squashfs
       APPLY PATCH (common)   ~/LibreELEC.tv.test/packages/sysutils/squashfs/patches/squashfs-4.2-defaults-0.1.patch
   CLEAN    zlib
   UNPACK   zlib
   BUILD    zlib (host)
   CLEAN    lzo
   UNPACK   lzo
       FIXCONFIG   build.LibreELEC-RPi2.arm-8.0.2/lzo-2.09/autoconf/
   BUILD    lzo (host)
   BUILD    squashfs (host)
   CLEAN    dosfstools
   UNPACK   dosfstools
   BUILD    dosfstools (host)
   CLEAN    fakeroot
   UNPACK   fakeroot
       FIXCONFIG   build.LibreELEC-RPi2.arm-8.0.2/fakeroot-1.20.2/
   CLEAN    libcap
   UNPACK   libcap
   BUILD    libcap (host)
   BUILD    fakeroot (host)
   CLEAN    kmod
   UNPACK   kmod
       APPLY PATCH (common)   ~/LibreELEC.tv.test/packages/sysutils/kmod/patches/kmod-02_fix-pkgconf.patch
       FIXCONFIG   build.LibreELEC-RPi2.arm-8.0.2/kmod-23/build-aux/
   BUILD    kmod (host)
   CLEAN    mtools
   UNPACK   mtools
       APPLY PATCH (common)   ~/LibreELEC.tv.test/packages/tools/mtools/patches/mtools-01-fix-creation-of-dot-directories.patch
       APPLY PATCH (common)   ~/LibreELEC.tv.test/packages/tools/mtools/patches/mtools-05-fix-install.patch
       FIXCONFIG   build.LibreELEC-RPi2.arm-8.0.2/mtools-4.0.18/
   BUILD    mtools (host)
       AUTORECONF   mtools
   CLEAN    populatefs
   UNPACK   populatefs
   CLEAN    e2fsprogs
   UNPACK   e2fsprogs
       FIXCONFIG   build.LibreELEC-RPi2.arm-8.0.2/e2fsprogs-1.43.3/config/
   BUILD    e2fsprogs (host)
              
(rebuild of e2fsprogs fails, due to two files not removed by the clean script.)

Display More

Error e2fsprogs:

Code

make[1]: Leaving directory '~/LibreELEC.tv.test/build.LibreELEC-RPi2.arm-8.0.2/e2fsprogs-1.43.3/.x86_64-linux-gnu/lib/ext2fs'
cp: cannot create regular file '~/LibreELEC.tv.test/build.LibreELEC-RPi2.arm-8.0.2/toolchain/lib/libcom_err.a': Permission denied
cp: cannot create regular file '~/LibreELEC.tv.test/build.LibreELEC-RPi2.arm-8.0.2/toolchain/lib/libext2fs.a': Permission denied
Makefile:12: recipe for target 'image' failed
make: *** [image] Error 1

Workaround for 'Permission denied' failure

Code

ls -la ~/LibreELEC.tv.test/build.LibreELEC-RPi2.arm-8.0.2/toolchain/lib/libcom_err.a
ls -la ~/LibreELEC.tv.test/build.LibreELEC-RPi2.arm-8.0.2/toolchain/lib/libext2fs.a
mv ~/LibreELEC.tv.test/build.LibreELEC-RPi2.arm-8.0.2/toolchain/lib/libcom_err.a ~/LibreELEC.tv.test/build.LibreELEC-RPi2.arm-8.0.2/toolchain/lib/libcom_err.a.orig
mv ~/LibreELEC.tv.test/build.LibreELEC-RPi2.arm-8.0.2/toolchain/lib/libext2fs.a ~/LibreELEC.tv.test/build.LibreELEC-RPi2.arm-8.0.2/toolchain/lib/libext2fs.a.orig
PROJECT=RPi2 ARCH=arm scripts/clean e2fsprogs
PROJECT=RPi2 ARCH=arm make imag

RomMon · June 9, 2017 at 9:28 PM

Second part

After building a lot of packages make fails while building kodi

PROJECT=RPi2 ARCH=arm make image

Failure messages

Code

BUILD    kodi (target)
                                                
Executing (target): cmake -DCMAKE_TOOLCHAIN_FILE=~/LibreELEC.tv.test/build.LibreELEC-RPi2.arm-8.0.2/toolchain/etc/cmake-armv7ve-libreelec-linux-gnueabi.conf -DCMAKE_INSTALL_PREFIX=/usr -DCMAKE_BUILD_TYPE=MinSizeRel -DNATIVEPREFIX=~/LibreELEC.tv.test/build.LibreELEC-RPi2.arm-8.0.2/toolchain -DWITH_TEXTUREPACKER=~/LibreELEC.tv.test/build.LibreELEC-RPi2.arm-8.0.2/toolchain/bin/TexturePacker -DDEPENDS_PATH=~/LibreELEC.tv.test/build.LibreELEC-RPi2.arm-8.0.2/kodi-147cec4/depends -DPYTHON_INCLUDE_DIRS=~/LibreELEC.tv.test/build.LibreELEC-RPi2.arm-8.0.2/toolchain/armv7ve-libreelec-linux-gnueabi/sysroot/usr/include/python2.7 -DGIT_VERSION=147cec4 -DENABLE_INTERNAL_FFMPEG=OFF -DFFMPEG_INCLUDE_DIRS=~/LibreELEC.tv.test/build.LibreELEC-RPi2.arm-8.0.2/toolchain/armv7ve-libreelec-linux-gnueabi/sysroot/usr -DENABLE_INTERNAL_CROSSGUID=OFF -DENABLE_SDL=OFF -DENABLE_OPENSSL=ON -DENABLE_UDEV=ON -DENABLE_DBUS=ON -DENABLE_XSLT=ON -DENABLE_CCACHE=ON -DENABLE_LIRC=ON -DENABLE_EVENTCLIENTS=ON -DENABLE_LDGOLD=OFF -DWITH_ARCH=arm -DENABLE_OPENGL=OFF -DENABLE_OPENGLES=ON -DENABLE_VDPAU=OFF -DENABLE_VAAPI=OFF -DENABLE_CEC=ON -DENABLE_X11=OFF -DENABLE_SMBCLIENT=ON -DENABLE_NFS=ON -DENABLE_DVDCSS=ON -DLIBDVDCSS_URL=~/LibreELEC.tv.test/sources/libdvdcss/libdvdcss-2f12236.tar.gz -DLIBDVDNAV_URL=~/LibreELEC.tv.test/sources/libdvdnav/libdvdnav-43b5f81.tar.gz -DLIBDVDREAD_URL=~/LibreELEC.tv.test/sources/libdvdread/libdvdread-17d99db.tar.gz -DENABLE_AVAHI=ON -DENABLE_UPNP=ON -DENABLE_MYSQLCLIENT=ON -DENABLE_SSH=ON -DENABLE_PLIST=ON -DENABLE_AIRTUNES=ON -DENABLE_NONFREE=ON -DENABLE_OPTICAL=ON -DENABLE_BLURAY=ON -DENABLE_MMAL=ON -DCORE_SYSTEM_NAME=rbpi ~/LibreELEC.tv.test/build.LibreELEC-RPi2.arm-8.0.2/kodi-147cec4/project/cmake
-- The CXX compiler identification is GNU 6.2.0
-- The C compiler identification is GNU 6.2.0
-- The ASM compiler identification is GNU
-- Found assembler: ~/LibreELEC.tv/build.LibreELEC-RPi2.arm-8.0.2/toolchain/bin/armv7ve-libreelec-linux-gnueabi-gcc
-- Check for working CXX compiler: ~/LibreELEC.tv/build.LibreELEC-RPi2.arm-8.0.2/toolchain/bin/armv7ve-libreelec-linux-gnueabi-g++
-- Check for working CXX compiler: ~/LibreELEC.tv/build.LibreELEC-RPi2.arm-8.0.2/toolchain/bin/armv7ve-libreelec-linux-gnueabi-g++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Check for working C compiler: ~/LibreELEC.tv/build.LibreELEC-RPi2.arm-8.0.2/toolchain/bin/armv7ve-libreelec-linux-gnueabi-gcc
-- Check for working C compiler: ~/LibreELEC.tv/build.LibreELEC-RPi2.arm-8.0.2/toolchain/bin/armv7ve-libreelec-linux-gnueabi-gcc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Source directory: ~/LibreELEC.tv.test/build.LibreELEC-RPi2.arm-8.0.2/kodi-147cec4
-- Build directory: ~/LibreELEC.tv.test/build.LibreELEC-RPi2.arm-8.0.2/kodi-147cec4/.armv7ve-libreelec-linux-gnueabi
-- Generator: Single-configuration: MinSizeRel (Unix Makefiles)
-- CMake Version: 3.6.3
-- System type: Linux
-- Checking to see if CXX compiler accepts flag -std=c++11
-- Checking to see if CXX compiler accepts flag -std=c++11 - yes
-- Found CXX11: -std=c++11  
-- Core system type: rbpi
-- Platform: 
-- CPU: arm, ARCH: arm
-- Cross-Compiling: TRUE
-- Execute build artefacts on host: FALSE
-- Depends based build: 
-- Could not find hardware support for SSE (missing:  _SSE_TRUE _SSE_OK) 
-- Could not find hardware support for SSE2 (missing:  _SSE2_TRUE _SSE2_OK) 
-- Could not find hardware support for SSE3 (missing:  _SSE3_TRUE _SSE3_OK) 
-- Could not find hardware support for SSSE3 (missing:  _SSSE3_TRUE _SSSE3_OK) 
-- Could not find hardware support for SSE4.1 (missing:  _SSE41_TRUE _SSE41_OK) 
-- Could not find hardware support for SSE4.2 (missing:  _SSE42_TRUE _SSE42_OK) 
-- Could not find hardware support for AVX (missing:  _AVX_TRUE _AVX_OK) 
-- Could not find hardware support for AVX2 (missing:  _AVX2_TRUE _AVX2_OK) 
-- Found PkgConfig: ~/LibreELEC.tv.test/build.LibreELEC-RPi2.arm-8.0.2/toolchain/bin/pkg-config (found version "0.29.1") 
-- Found TexturePacker: ~/LibreELEC.tv.test/build.LibreELEC-RPi2.arm-8.0.2/toolchain/bin/TexturePacker  
-- Found EXPAT: ~/LibreELEC.tv/build.LibreELEC-RPi2.arm-8.0.2/toolchain/armv7ve-libreelec-linux-gnueabi/sysroot/usr/lib/libexpat.so (found version "2.2.0") 
-- Found Sqlite3: ~/LibreELEC.tv/build.LibreELEC-RPi2.arm-8.0.2/toolchain/armv7ve-libreelec-linux-gnueabi/sysroot/usr/lib/libsqlite3.a (found version "3.15.2") 
CMake Error at ~/LibreELEC.tv.test/build.LibreELEC-RPi2.arm-8.0.2/toolchain/share/cmake-3.6/Modules/FindPackageHandleStandardArgs.cmake:148 (message):
  Could NOT find FreeType (missing: FREETYPE_INCLUDE_DIR) (found version "18.5.12")
Call Stack (most recent call first):
  ~/LibreELEC.tv.test/build.LibreELEC-RPi2.arm-8.0.2/toolchain/share/cmake-3.6/Modules/FindPackageHandleStandardArgs.cmake:388 (_FPHSA_FAILURE_MESSAGE)
  modules/FindFreeType.cmake:29 (find_package_handle_standard_args)
  scripts/common/Macros.cmake:354 (find_package)
  CMakeLists.txt:140 (core_require_dep)


-- Configuring incomplete, errors occurred!
See also "~/LibreELEC.tv.test/build.LibreELEC-RPi2.arm-8.0.2/kodi-147cec4/.armv7ve-libreelec-linux-gnueabi/CMakeFiles/CMakeOutput.log".
See also "~/LibreELEC.tv.test/build.LibreELEC-RPi2.arm-8.0.2/kodi-147cec4/.armv7ve-libreelec-linux-gnueabi/CMakeFiles/CMakeError.log".
Makefile:12: recipe for target 'image' failed
make: *** [image] Error 1

Display More

**chewitt** · June 10, 2017 at 6:02 AM Official Post

Which OS/distro and version are you building on?

**vpeter** · June 10, 2017 at 6:55 AM

Solution for e2fsprogs is 14f5fefa2a392ba1e979fd55bda5e116491053b4#commitcomment-20534303

RomMon · June 10, 2017 at 11:53 AM

I'm building in a vm with Ubuntu 16.04.

Code

$ cat /etc/os-release
NAME="Ubuntu"
VERSION="16.04.2 LTS (Xenial Xerus)"
ID=ubuntu
ID_LIKE=debian
PRETTY_NAME="Ubuntu 16.04.2 LTS"
VERSION_ID="16.04"
HOME_URL="http://www.ubuntu.com/"
SUPPORT_URL="http://help.ubuntu.com/"
BUG_REPORT_URL="http://bugs.launchpad.net/ubuntu/"
VERSION_CODENAME=xenial
UBUNTU_CODENAME=xenial

Display More

Ok, so the e2fsprogs re-build issues is a known/resolved issue for a future release.

(I'm not familiar with github enough to find more details about commit 14f5fef e.g. why didn't it make it in 8.0.x.)