[Fixed] Compile error LE 8.0.1, xz: (stdin): File format not recognized

RomMon · April 28, 2017 at 11:32 PM

Get the following error while compiling a LE 8.0.1 image.

Last lines of the output:

Code

UNPACK   bcm2835-driver
  UNPACK   dtc
xz: (stdin): File format not recognized
tar: Child returned status 1
tar: Error is not recoverable: exiting now
Makefile:12: recipe for target 'image' failed
make: *** [image] Error 2
@libreelec:~/LibreELEC.tv$

Based on the output I get that the unpack of dtc fails.
But don't see an issue with the file.

Code

cd ~/LibreELEC.tv/sources/dtc
$ cat dtc-1.4.2.tar.xz.md5
04891daf4544da49958b60109ed4beb1  sources/dtc/dtc-1.4.2.tar.xz
$ md5sum dtc-1.4.2.tar.xz
04891daf4544da49958b60109ed4beb1  dtc-1.4.2.tar.xz
$ tar -tvf dtc-1.4.2.tar.xz
drwxrwxr-x root/root         0 2016-09-03 13:02 1.4.2/
-rw-rw-r-- root/root       130 2016-09-03 13:02 1.4.2/.gitignore
-rw-rw-r-- root/root        57 2016-09-03 13:02 1.4.2/.travis.yml
drwxrwxr-x root/root         0 2016-09-03 13:02 1.4.2/Documentation/
-rw-rw-r-- root/root      1275 2016-09-03 13:02 1.4.2/Documentation/dtc-paper.bib
<snip>
-rw-rw-r-- root/root      6165 2016-09-03 13:02 1.4.2/treesource.c
-rw-rw-r-- root/root      9598 2016-09-03 13:02 1.4.2/util.c
-rw-rw-r-- root/root      7674 2016-09-03 13:02 1.4.2/util.h
:~/LibreELEC.tv/sources/dtc$

Display More

Compiled on a newly created VM with Ubuntu 16.04
Commands used.

Code

sudo apt-get update
sudo apt-get upgrade
sudo apt-get install gcc make git
sudo dpkg-reconfigure dash
cd ~
git clone [url]https://github.com/LibreELEC/LibreELEC.tv.git[/url]
cd ~/LibreELEC.tv
git checkout 8.0.1
PREFER_PACKAGE_MIRROR=yes PROJECT=RPi2 ARCH=arm tools/download-tool
PROJECT=RPi2 ARCH=arm make image

Link to last ~2000 lines output.
https://forum.libreelec.tv/thread-7906.html - Pastebin.com

Buzzthebuzzsaw · April 29, 2017 at 7:50 PM

Hi RomMon,

I'm not sure if you're seeing the same problem as me, but I'm getting the same error when building for the Raspberry Pi and it's stopping at: UNPACK kernel-firmware

When I trace back the output I can see that the build is attempting to download an xz file, and gets redirected to a gz file instead.
It saves the file as an xz file and try's to decompress it as an xz file.

I couldn't see any downloads happening in your log but the issue seems similar.
If you can check the file by running the file command on it, it'll tell you the file type (I'm getting "gzip compressed data" which is causing the problem).
Unfortunately this only diagnoses the problem, I'm unsure how to fix it, it only surfaced for me yesterday when I kicked off a new build.

Hopefully it'll simply 'go away', but if I find a fix I'll pass it on.
Regards,
B.

**vpeter** · April 29, 2017 at 7:58 PM

RomMon, seems your source file is corrupted. Remove it and run make again.

Code

rm sources/dtc/dtc-1.4.2.tar.xz*

RomMon · April 30, 2017 at 1:00 AM

Buzzthebuzzsaw,

You are right it is not a tar.xz compressed file but tar.gz.

Code

$ file dtc-1.4.2.tar.xz  
dtc-1.4.2.tar.xz: gzip compressed data, from Unix  
  
$ file bcm2835-driver-2ef9cb6.tar.xz  
bcm2835-driver-2ef9cb6.tar.xz: XZ compressed data

On the site I also only see tar.gz sources available: dtc/dtc.git - The Device Tree Compiler

Changing it to a tar.gz makes it continue:

Code

vi ~/LibreELEC.tv/packages/tools/dtc/package.mk  
 change PKG_URL="[url]https://git.kernel.org/cgit/utils/dtc/dtc.git/snapshot/$PKG_VERSION.tar.xz[/url]"
 to PKG_URL="[url]https://git.kernel.org/cgit/utils/dtc/dtc.git/snapshot/$PKG_VERSION.tar.gz[/url]"
rm ~/LibreELEC.tv/sources/dtc/dtc-1.4.2.tar.xz*
cd ~/LibreELEC.tv
PROJECT=RPi2 ARCH=arm make image

The md5sum is still the same, but now for the correct filetype:

Code

$ cat ~/LibreELEC.tv/sources/dtc/dtc-1.4.2.tar.gz.md5
04891daf4544da49958b60109ed4beb1  sources/dtc/dtc-1.4.2.tar.gz

make output:

Code

--2017-04-30 01:45:57--  [url]https://git.kernel.org/cgit/utils/dtc/dtc.git/snapshot/1.4.2.tar.gz[/url]
Resolving git.kernel.org (git.kernel.org)... 147.75.205.195, 2604:1380:2000:f000::7
Connecting to git.kernel.org (git.kernel.org)|147.75.205.195|:443... connected.
HTTP request sent, awaiting response... 301 Moved Permanently
Location: [url]https://git.kernel.org/pub/scm/utils/dtc/dtc.git/snapshot/1.4.2.tar.gz[/url] [following]
--2017-04-30 01:45:58--  [url]https://git.kernel.org/pub/scm/utils/dtc/dtc.git/snapshot/1.4.2.tar.gz[/url]
Reusing existing connection to git.kernel.org:443.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [application/x-gzip]
Saving to: 'sources/dtc/dtc-1.4.2.tar.gz'sources/dtc/dtc-1.4.2.tar.g     [ <=>                                       ] 139.83K  --.-KB/s    in 0.1s   2017-04-30 01:45:58 (1.03 MB/s) - 'sources/dtc/dtc-1.4.2.tar.gz' saved [143183]  UNPACK   dtc
  BUILD    dtc (target)
Executing (target): make dtc
make[1]: Entering directory '~/LibreELEC.tv/build.LibreELEC-RPi2.arm-8.0.1/dtc-1.4.2'
         DEP tests/dumptrees.c
         DEP tests/trees.S
         DEP tests/testutils.c
         DEP tests/value-labels.c
         DEP tests/asm_tree_dump.c
         DEP tests/truncated_property.c
         DEP tests/subnode_iterate.c
<snip>

Display More

RomMon · April 30, 2017 at 12:23 PM

Buzzthebuzzsaw, vpeter,

With your combined advice I finished my first image.

Code

$ ls -la ~/LibreELEC.tv/target/
<snip>
-rw-rw-r--  1 <user> <group> 131687220 Apr 30 04:34 LibreELEC-RPi2.arm-8.0.1.img.gz
-rw-r--r--  1 <user> <group>   5932496 Apr 30 04:31 LibreELEC-RPi2.arm-8.0.1.kernel
-rw-r--r--  1 <user> <group> 134369280 Apr 30 04:32 LibreELEC-RPi2.arm-8.0.1.system
-rw-rw-r--  1 <user> <group> 145111040 Apr 30 04:33 LibreELEC-RPi2.arm-8.0.1.tar
$

The only change I made was with ~/http://LibreELEC.tv/packages/tools/dtc/package.mk changing the download from a xz compressed file to a gzip compressed file.

**vpeter** · April 30, 2017 at 12:25 PM

Quote from RomMon

With your combined advice I finished my first image.

Congratulation.

Quote from RomMon

The only change I made was with ~/http://LibreELEC.tv/packages/tools/dtc/package.mk changing the download from a xz compressed file to a gzip compressed file.

Yes, there were some changes and required fixes are already send to repository.

RomMon · April 30, 2017 at 12:39 PM

Quote from vpeter

Congratulation.

Thanks!

Quote from vpeter

Yes, there were some changes and required fixes are already send to repository.

Thanks again. I see them on githup

Buzzthebuzzsaw · May 1, 2017 at 11:19 AM

Congrats RomMon!
I haven't had a chance to kick off my build again, but I'm going to try the changes too and see how it goes.