LE10 network boot (PXE) with Pi4/B 4GB doesn't work

NullDev · June 29, 2021 at 7:22 PM

I have a running setup booting the RasPi 4 Model B 4GB with Debian from my DHCP/TFTP/NFS environment.
Trying to do the same thing with LE10 doesn't work. There are repeating tftp-requests for files like
start4.elf, start.elf, config.txt, vl805.sig, pieeprom.sig, recover4.elf and more,

files which are part of the Debian boot partition but not in LE10.

As cmdline.txt is not requested there is no NFS access from the Pi.

Is there a special bootcode.bin for Pi4, LE10 and PXE available or where is my problem located?

Thanks, Devlin

**Klojum** · June 29, 2021 at 8:42 PM Official Post

It's possible that PXE boot is not yet part of the RPi4B firmware.

You could double-check at the Raspberry Pi forums/devs to hear what the status on network booting is.

NullDev · June 29, 2021 at 9:15 PM

Quote from Klojum

It's possible that PXE boot is not yet part of the RPi4B firmware.
You could double-check at the Raspberry Pi forums/devs to hear what the status on network booting is.

It's possible since ~2yrs and I have a running Debian installation for the same box booting from network. So PXE boot with Pi4 works.
But all available examples tell me just to move bootcode.bin to tftp and probably cmdline.txt which contains the referral to the NFS server. All additional files should then be loaded via NFS.
It seems as if bootcode.bin requests different files when booting from network.

**CvH** · June 30, 2021 at 10:54 AM Official Post

maybe here ? (I am not using it so no real idea)

https://wiki.libreelec.tv/configuration/network-boot

NullDev · June 30, 2021 at 6:53 PM

Quote from CvH

maybe here ? (I am not using it so no real idea)
https://wiki.libreelec.tv/configuration/network-boot

I just double checked it. The actual Pi4 firmware seems to ignore dhcp option 67 (boot filename) and directly tries to read start4.elf which is available in Debian but not in LE10.

**HiassofT** · June 30, 2021 at 7:07 PM

RPi4 doesn't need bootcode.bin or a SD card, everything's in the boot eeprom - just make sure it's up-to-date and network boot is enabled in BOOT_ORDER.

Copying the contents of the FAT partition on the SD card to a directory served via TFTP and NFS and creating a NFS share for the storage partition is enough - the bootloader in eeprom will fall back to start.elf if start4.elf can't be found.

so long,

Hias

NullDev · July 1, 2021 at 10:36 AM

Quote from HiassofT

RPi4 doesn't need bootcode.bin or a SD card, everything's in the boot eeprom - just make sure it's up-to-date and network boot is enabled in BOOT_ORDER.
Copying the contents of the FAT partition on the SD card to a directory served via TFTP and NFS and creating a NFS share for the storage partition is enough - the bootloader in eeprom will fall back to start.elf if start4.elf can't be found.
so long,
Hias

That's exactly what I tried to describe. Pi4 boots from eeprom, connects to the tftpserver and requests a bunch of files like start4.elf, start.elf, config.txt, vl805.sig, pieeprom.sig, recover4.elf and more. start.elf and config.txt exist in LE10, but not the others.

And cmdline.txt is never requested, so no try to access anything via NFS.
I still have no clue where my error is located. DHCP and tft work, Debian is able to boot in that environment but not LE10.

Any idea?

**HiassofT** · July 1, 2021 at 1:26 PM

How did you populate the TFTP directory?

In general copying all files from the FAT partition of the SD card should just work (after adjusting cmdline.txt). If you populated it from the contents of the tarball you'll need to rename KERNEL to kernel.img.

Netbooting LE10 on RPi4s is working fine here, I've been doing that for a while now for easy development testing.

I chose to organize TFTP and NFS directories using the RPi4 serial number at the top level, RPi4 firmware looks there first when TFTP-booting (and then falls back to TFTP root dir). This makes it easy to serve different (LE) versions to different RPis and the LE init script also supports that quite well, it substitutes "@UID@" in boot/disk with the serial - so I can use an identical cmdline.txt for all installations. The relevant part of cmdline.txt looks like this here:

Code

ip=dhcp boot=NFS=192.168.1.20:/wd/srv/tftp/@UID@ disk=NFS=192.168.1.20:/wd/srv/le-storage/@UID@

TFTP root directory (I'm using atftpd here) is /wd/srv/tftp and /wd/srv is exported via NFS, and my DHCP server announces the TFTP server via option 66 (tftp in dnsmasq) in DHCP replies.

Check your tftp logs, also for missing files. For reference here's the tftp log output from a boot here:

Code

atftpd[2270]: Serving 8eb25f41/start4.elf to 192.168.1.70:7088
atftpd[2270]: File /wd/srv/tftp/8eb25f41/start4.elf not found
atftpd[2270]: Serving 8eb25f41/start.elf to 192.168.1.70:7089
atftpd[2270]: Serving 8eb25f41/config.txt to 192.168.1.70:7090
atftpd[2270]: Serving 8eb25f41/vl805.sig to 192.168.1.70:7091
atftpd[2270]: File /wd/srv/tftp/8eb25f41/vl805.sig not found
atftpd[2270]: Serving 8eb25f41/pieeprom.sig to 192.168.1.70:7092
atftpd[2270]: File /wd/srv/tftp/8eb25f41/pieeprom.sig not found
atftpd[2270]: Serving 8eb25f41/recover4.elf to 192.168.1.70:7093
atftpd[2270]: File /wd/srv/tftp/8eb25f41/recover4.elf not found
atftpd[2270]: Serving 8eb25f41/recovery.elf to 192.168.1.70:7094
atftpd[2270]: File /wd/srv/tftp/8eb25f41/recovery.elf not found
atftpd[2270]: Serving 8eb25f41/start4.elf to 192.168.1.70:7095
atftpd[2270]: File /wd/srv/tftp/8eb25f41/start4.elf not found
atftpd[2270]: Serving 8eb25f41/start.elf to 192.168.1.70:7096
atftpd[2270]: Serving 8eb25f41/fixup.dat to 192.168.1.70:7097
atftpd[2270]: Serving 8eb25f41/recovery.elf to 192.168.1.70:49153
atftpd[2270]: File /wd/srv/tftp/8eb25f41/recovery.elf not found
atftpd[2270]: Serving 8eb25f41/config.txt to 192.168.1.70:49154
atftpd[2270]: Serving 8eb25f41/config.txt to 192.168.1.70:49155
atftpd[2270]: Serving 8eb25f41/distroconfig.txt to 192.168.1.70:49156
atftpd[2270]: Serving 8eb25f41/distroconfig.txt to 192.168.1.70:49157
atftpd[2270]: Serving 8eb25f41/dt-blob.bin to 192.168.1.70:49158
atftpd[2270]: File /wd/srv/tftp/8eb25f41/dt-blob.bin not found
atftpd[2270]: Serving 8eb25f41/recovery.elf to 192.168.1.70:49159
atftpd[2270]: File /wd/srv/tftp/8eb25f41/recovery.elf not found
atftpd[2270]: Serving 8eb25f41/config.txt to 192.168.1.70:49160
atftpd[2270]: Serving 8eb25f41/config.txt to 192.168.1.70:49161
atftpd[2270]: Serving 8eb25f41/distroconfig.txt to 192.168.1.70:49162
atftpd[2270]: Serving 8eb25f41/distroconfig.txt to 192.168.1.70:49163
atftpd[2270]: Serving 8eb25f41/bootcfg.txt to 192.168.1.70:49164
atftpd[2270]: File /wd/srv/tftp/8eb25f41/bootcfg.txt not found
atftpd[2270]: Serving 8eb25f41/edid.cpio to 192.168.1.70:49165
atftpd[2270]: Serving 8eb25f41/edid.cpio to 192.168.1.70:49166
atftpd[2270]: Serving 8eb25f41/bcm2711-rpi-4-b.dtb to 192.168.1.70:49167
atftpd[2270]: Serving 8eb25f41/bcm2711-rpi-4-b.dtb to 192.168.1.70:49168
atftpd[2270]: Serving 8eb25f41/overlays/overlay_map.dtb to 192.168.1.70:49169
atftpd[2270]: Serving 8eb25f41/overlays/overlay_map.dtb to 192.168.1.70:49170
atftpd[2270]: Serving 8eb25f41/config.txt to 192.168.1.70:49171
atftpd[2270]: Serving 8eb25f41/config.txt to 192.168.1.70:49172
atftpd[2270]: Serving 8eb25f41/distroconfig.txt to 192.168.1.70:49173
atftpd[2270]: Serving 8eb25f41/distroconfig.txt to 192.168.1.70:49174
atftpd[2270]: Serving 8eb25f41/overlays/vc4-kms-v3d-pi4.dtbo to 192.168.1.70:49175
atftpd[2270]: Serving 8eb25f41/overlays/vc4-kms-v3d-pi4.dtbo to 192.168.1.70:49176
atftpd[2270]: Serving 8eb25f41/overlays/rpivid-v4l2.dtbo to 192.168.1.70:49177
atftpd[2270]: Serving 8eb25f41/overlays/rpivid-v4l2.dtbo to 192.168.1.70:49178
atftpd[2270]: Serving 8eb25f41/overlays/disable-bt.dtbo to 192.168.1.70:49179
atftpd[2270]: Serving 8eb25f41/overlays/disable-bt.dtbo to 192.168.1.70:49180
atftpd[2270]: Serving 8eb25f41/overlays/disable-wifi.dtbo to 192.168.1.70:49181
atftpd[2270]: Serving 8eb25f41/overlays/disable-wifi.dtbo to 192.168.1.70:49182
atftpd[2270]: Serving 8eb25f41/overlays/gpio-ir.dtbo to 192.168.1.70:49183
atftpd[2270]: Serving 8eb25f41/overlays/gpio-ir.dtbo to 192.168.1.70:49184
atftpd[2270]: Serving 8eb25f41/cmdline.txt to 192.168.1.70:49185
atftpd[2270]: Serving 8eb25f41/cmdline.txt to 192.168.1.70:49186
atftpd[2270]: Serving 8eb25f41/recovery8.img to 192.168.1.70:49187
atftpd[2270]: File /wd/srv/tftp/8eb25f41/recovery8.img not found
atftpd[2270]: Serving 8eb25f41/recovery8-32.img to 192.168.1.70:49188
atftpd[2270]: File /wd/srv/tftp/8eb25f41/recovery8-32.img not found
atftpd[2270]: Serving 8eb25f41/recovery7l.img to 192.168.1.70:49189
atftpd[2270]: File /wd/srv/tftp/8eb25f41/recovery7l.img not found
atftpd[2270]: Serving 8eb25f41/recovery7.img to 192.168.1.70:49190
atftpd[2270]: File /wd/srv/tftp/8eb25f41/recovery7.img not found
atftpd[2270]: Serving 8eb25f41/recovery.img to 192.168.1.70:49191
atftpd[2270]: File /wd/srv/tftp/8eb25f41/recovery.img not found
atftpd[2270]: Serving 8eb25f41/kernel8.img to 192.168.1.70:49192
atftpd[2270]: File /wd/srv/tftp/8eb25f41/kernel8.img not found
atftpd[2270]: Serving 8eb25f41/kernel8-32.img to 192.168.1.70:49193
atftpd[2270]: File /wd/srv/tftp/8eb25f41/kernel8-32.img not found
atftpd[2270]: Serving 8eb25f41/kernel7l.img to 192.168.1.70:49194
atftpd[2270]: File /wd/srv/tftp/8eb25f41/kernel7l.img not found
atftpd[2270]: Serving 8eb25f41/kernel7.img to 192.168.1.70:49195
atftpd[2270]: File /wd/srv/tftp/8eb25f41/kernel7.img not found
atftpd[2270]: Serving 8eb25f41/kernel.img to 192.168.1.70:49196
atftpd[2270]: Serving 8eb25f41/kernel.img to 192.168.1.70:49197
atftpd[2270]: Serving 8eb25f41/armstub8-32-gic.bin to 192.168.1.70:49198
atftpd[2270]: File /wd/srv/tftp/8eb25f41/armstub8-32-gic.bin not found
atftpd[2270]: Serving 8eb25f41/kernel.img to 192.168.1.70:49199
atftpd[2270]: Serving 8eb25f41/kernel.img to 192.168.1.70:49200

Display More

so long,

Hias

NullDev · July 1, 2021 at 2:43 PM

Hi Hias,

I have pretty the same setup, but for ease of debug I have a flat structure.

cmdline.txt looks like this

Code

boot=NFS=192.168.1.231:/export/le-system/5c5e0a58 disk=NFS=192.168.1.231:/export/le-storage/5c5e0a58 ssh ip=dhcp rootwait elevator=deadline debugging

tftp-dir has the same content as /export/le-system, both are simply a copy of /flash of the running LE10 booting from sdcard. With modifed cmdline.txt of course.

But my tftp-log looks different. I'm running bootloader 1b43d5b6 from March, 18th 2021, update-ts 1612279788, bootmode network mode 2 order 21, fw start4.elf fixup4.elf and my tftp-log looks different to yours:

Code

Jul  1 15:24:00 raspberrypi tftpd[5415]: tftpd: trying to get file: 5c5e0a58/start4.elf
Jul  1 15:24:00 raspberrypi tftpd[5415]: tftpd: serving file from /export/tftpboot
Jul  1 15:24:02 raspberrypi tftpd[5418]: tftpd: trying to get file: 5c5e0a58/start4.elf
Jul  1 15:24:02 raspberrypi tftpd[5418]: tftpd: serving file from /export/tftpboot
Jul  1 15:24:04 raspberrypi tftpd[5420]: tftpd: trying to get file: 5c5e0a58/start4.elf
Jul  1 15:24:04 raspberrypi tftpd[5420]: tftpd: serving file from /export/tftpboot
Jul  1 15:24:06 raspberrypi tftpd[5422]: tftpd: trying to get file: 5c5e0a58/start4.elf
Jul  1 15:24:06 raspberrypi tftpd[5422]: tftpd: serving file from /export/tftpboot
Jul  1 15:24:08 raspberrypi tftpd[5424]: tftpd: trying to get file: 5c5e0a58/start4.elf
Jul  1 15:24:08 raspberrypi tftpd[5424]: tftpd: serving file from /export/tftpboot
Jul  1 15:24:10 raspberrypi tftpd[5426]: tftpd: trying to get file: 5c5e0a58/start4.elf
Jul  1 15:24:10 raspberrypi tftpd[5426]: tftpd: serving file from /export/tftpboot
Jul  1 15:24:12 raspberrypi tftpd[5428]: tftpd: trying to get file: 5c5e0a58/start4.elf
Jul  1 15:24:12 raspberrypi tftpd[5428]: tftpd: serving file from /export/tftpboot
Jul  1 15:24:14 raspberrypi tftpd[5430]: tftpd: trying to get file: 5c5e0a58/start4.elf
Jul  1 15:24:14 raspberrypi tftpd[5430]: tftpd: serving file from /export/tftpboot
Jul  1 15:24:16 raspberrypi tftpd[5432]: tftpd: trying to get file: 5c5e0a58/start4.elf
Jul  1 15:24:16 raspberrypi tftpd[5432]: tftpd: serving file from /export/tftpboot
Jul  1 15:24:18 raspberrypi tftpd[5434]: tftpd: trying to get file: 5c5e0a58/start4.elf
Jul  1 15:24:18 raspberrypi tftpd[5434]: tftpd: serving file from /export/tftpboot
Jul  1 15:24:20 raspberrypi tftpd[5436]: tftpd: trying to get file: 5c5e0a58/start4.elf
Jul  1 15:24:20 raspberrypi tftpd[5436]: tftpd: serving file from /export/tftpboot
Jul  1 15:24:22 raspberrypi tftpd[5438]: tftpd: trying to get file: 5c5e0a58/start4.elf
Jul  1 15:24:22 raspberrypi tftpd[5438]: tftpd: serving file from /export/tftpboot
Jul  1 15:24:24 raspberrypi tftpd[5440]: tftpd: trying to get file: 5c5e0a58/start4.elf
Jul  1 15:24:24 raspberrypi tftpd[5440]: tftpd: serving file from /export/tftpboot
Jul  1 15:24:26 raspberrypi tftpd[5442]: tftpd: trying to get file: 5c5e0a58/start4.elf
Jul  1 15:24:26 raspberrypi tftpd[5442]: tftpd: serving file from /export/tftpboot
Jul  1 15:24:28 raspberrypi tftpd[5444]: tftpd: trying to get file: 5c5e0a58/start4.elf
Jul  1 15:24:28 raspberrypi tftpd[5444]: tftpd: serving file from /export/tftpboot
Jul  1 15:24:32 raspberrypi tftpd[5448]: tftpd: trying to get file: 5c5e0a58/start.elf
Jul  1 15:24:32 raspberrypi tftpd[5448]: tftpd: serving file from /export/tftpboot
Jul  1 15:24:32 raspberrypi tftpd[5450]: tftpd: trying to get file: 5c5e0a58/config.txt
Jul  1 15:24:32 raspberrypi tftpd[5450]: tftpd: serving file from /export/tftpboot
Jul  1 15:24:33 raspberrypi tftpd[5452]: tftpd: trying to get file: 5c5e0a58/vl805.sig
Jul  1 15:24:33 raspberrypi tftpd[5452]: tftpd: serving file from /export/tftpboot
Jul  1 15:24:35 raspberrypi tftpd[5454]: tftpd: trying to get file: 5c5e0a58/vl805.sig
Jul  1 15:24:35 raspberrypi tftpd[5454]: tftpd: serving file from /export/tftpboot
Jul  1 15:24:37 raspberrypi tftpd[5456]: tftpd: trying to get file: 5c5e0a58/vl805.sig
Jul  1 15:24:37 raspberrypi tftpd[5456]: tftpd: serving file from /export/tftpboot
Jul  1 15:24:39 raspberrypi tftpd[5458]: tftpd: trying to get file: 5c5e0a58/vl805.sig
Jul  1 15:24:39 raspberrypi tftpd[5458]: tftpd: serving file from /export/tftpboot
Jul  1 15:24:41 raspberrypi tftpd[5460]: tftpd: trying to get file: 5c5e0a58/vl805.sig
Jul  1 15:24:41 raspberrypi tftpd[5460]: tftpd: serving file from /export/tftpboot
Jul  1 15:24:43 raspberrypi tftpd[5462]: tftpd: trying to get file: 5c5e0a58/vl805.sig
Jul  1 15:24:43 raspberrypi tftpd[5462]: tftpd: serving file from /export/tftpboot
Jul  1 15:24:45 raspberrypi tftpd[5464]: tftpd: trying to get file: 5c5e0a58/vl805.sig
Jul  1 15:24:45 raspberrypi tftpd[5464]: tftpd: serving file from /export/tftpboot
Jul  1 15:24:47 raspberrypi tftpd[5466]: tftpd: trying to get file: 5c5e0a58/vl805.sig
Jul  1 15:24:47 raspberrypi tftpd[5466]: tftpd: serving file from /export/tftpboot
Jul  1 15:24:49 raspberrypi tftpd[5468]: tftpd: trying to get file: 5c5e0a58/vl805.sig
Jul  1 15:24:49 raspberrypi tftpd[5468]: tftpd: serving file from /export/tftpboot
Jul  1 15:24:51 raspberrypi tftpd[5470]: tftpd: trying to get file: 5c5e0a58/vl805.sig
Jul  1 15:24:51 raspberrypi tftpd[5470]: tftpd: serving file from /export/tftpboot
Jul  1 15:24:53 raspberrypi tftpd[5472]: tftpd: trying to get file: 5c5e0a58/vl805.sig
Jul  1 15:24:53 raspberrypi tftpd[5472]: tftpd: serving file from /export/tftpboot
Jul  1 15:24:55 raspberrypi tftpd[5474]: tftpd: trying to get file: 5c5e0a58/vl805.sig
Jul  1 15:24:55 raspberrypi tftpd[5474]: tftpd: serving file from /export/tftpboot
Jul  1 15:24:57 raspberrypi tftpd[5476]: tftpd: trying to get file: 5c5e0a58/vl805.sig
Jul  1 15:24:57 raspberrypi tftpd[5476]: tftpd: serving file from /export/tftpboot
Jul  1 15:24:59 raspberrypi tftpd[5478]: tftpd: trying to get file: 5c5e0a58/vl805.sig
Jul  1 15:24:59 raspberrypi tftpd[5478]: tftpd: serving file from /export/tftpboot
Jul  1 15:25:01 raspberrypi tftpd[5480]: tftpd: trying to get file: 5c5e0a58/vl805.sig
Jul  1 15:25:01 raspberrypi tftpd[5480]: tftpd: serving file from /export/tftpboot
Jul  1 15:25:05 raspberrypi tftpd[5484]: tftpd: trying to get file: 5c5e0a58/pieeprom.sig
Jul  1 15:25:05 raspberrypi tftpd[5484]: tftpd: serving file from /export/tftpboot
Jul  1 15:25:07 raspberrypi tftpd[5488]: tftpd: trying to get file: 5c5e0a58/pieeprom.sig
Jul  1 15:25:07 raspberrypi tftpd[5488]: tftpd: serving file from /export/tftpboot
Jul  1 15:25:09 raspberrypi tftpd[5490]: tftpd: trying to get file: 5c5e0a58/pieeprom.sig
Jul  1 15:25:09 raspberrypi tftpd[5490]: tftpd: serving file from /export/tftpboot
Jul  1 15:25:11 raspberrypi tftpd[5492]: tftpd: trying to get file: 5c5e0a58/pieeprom.sig
Jul  1 15:25:11 raspberrypi tftpd[5492]: tftpd: serving file from /export/tftpboot
Jul  1 15:25:13 raspberrypi tftpd[5494]: tftpd: trying to get file: 5c5e0a58/pieeprom.sig
Jul  1 15:25:13 raspberrypi tftpd[5494]: tftpd: serving file from /export/tftpboot
Jul  1 15:25:15 raspberrypi tftpd[5496]: tftpd: trying to get file: 5c5e0a58/pieeprom.sig
Jul  1 15:25:15 raspberrypi tftpd[5496]: tftpd: serving file from /export/tftpboot
Jul  1 15:25:17 raspberrypi tftpd[5498]: tftpd: trying to get file: 5c5e0a58/pieeprom.sig
Jul  1 15:25:17 raspberrypi tftpd[5498]: tftpd: serving file from /export/tftpboot
Jul  1 15:25:19 raspberrypi tftpd[5500]: tftpd: trying to get file: 5c5e0a58/pieeprom.sig
Jul  1 15:25:19 raspberrypi tftpd[5500]: tftpd: serving file from /export/tftpboot
Jul  1 15:25:21 raspberrypi tftpd[5502]: tftpd: trying to get file: 5c5e0a58/pieeprom.sig
Jul  1 15:25:21 raspberrypi tftpd[5502]: tftpd: serving file from /export/tftpboot
Jul  1 15:25:23 raspberrypi tftpd[5504]: tftpd: trying to get file: 5c5e0a58/pieeprom.sig
Jul  1 15:25:23 raspberrypi tftpd[5504]: tftpd: serving file from /export/tftpboot
Jul  1 15:25:25 raspberrypi tftpd[5506]: tftpd: trying to get file: 5c5e0a58/pieeprom.sig
Jul  1 15:25:25 raspberrypi tftpd[5506]: tftpd: serving file from /export/tftpboot
Jul  1 15:25:27 raspberrypi tftpd[5508]: tftpd: trying to get file: 5c5e0a58/pieeprom.sig
Jul  1 15:25:27 raspberrypi tftpd[5508]: tftpd: serving file from /export/tftpboot
Jul  1 15:25:29 raspberrypi tftpd[5511]: tftpd: trying to get file: 5c5e0a58/pieeprom.sig
Jul  1 15:25:29 raspberrypi tftpd[5511]: tftpd: serving file from /export/tftpboot
Jul  1 15:25:31 raspberrypi tftpd[5513]: tftpd: trying to get file: 5c5e0a58/pieeprom.sig
Jul  1 15:25:31 raspberrypi tftpd[5513]: tftpd: serving file from /export/tftpboot
Jul  1 15:25:35 raspberrypi tftpd[5517]: tftpd: trying to get file: 5c5e0a58/recover4.elf
Jul  1 15:25:35 raspberrypi tftpd[5517]: tftpd: serving file from /export/tftpboot
Jul  1 15:25:37 raspberrypi tftpd[5519]: tftpd: trying to get file: 5c5e0a58/recover4.elf
Jul  1 15:25:37 raspberrypi tftpd[5519]: tftpd: serving file from /export/tftpboot
Jul  1 15:25:39 raspberrypi tftpd[5521]: tftpd: trying to get file: 5c5e0a58/recover4.elf
Jul  1 15:25:39 raspberrypi tftpd[5521]: tftpd: serving file from /export/tftpboot
Jul  1 15:25:41 raspberrypi tftpd[5523]: tftpd: trying to get file: 5c5e0a58/recover4.elf
Jul  1 15:25:41 raspberrypi tftpd[5523]: tftpd: serving file from /export/tftpboot
Jul  1 15:25:43 raspberrypi tftpd[5525]: tftpd: trying to get file: 5c5e0a58/recover4.elf
Jul  1 15:25:43 raspberrypi tftpd[5525]: tftpd: serving file from /export/tftpboot
Jul  1 15:25:45 raspberrypi tftpd[5527]: tftpd: trying to get file: 5c5e0a58/recover4.elf
Jul  1 15:25:45 raspberrypi tftpd[5527]: tftpd: serving file from /export/tftpboot
Jul  1 15:25:47 raspberrypi tftpd[5529]: tftpd: trying to get file: 5c5e0a58/recover4.elf
Jul  1 15:25:47 raspberrypi tftpd[5529]: tftpd: serving file from /export/tftpboot
Jul  1 15:25:49 raspberrypi tftpd[5531]: tftpd: trying to get file: 5c5e0a58/recover4.elf
Jul  1 15:25:49 raspberrypi tftpd[5531]: tftpd: serving file from /export/tftpboot
Jul  1 15:25:51 raspberrypi tftpd[5533]: tftpd: trying to get file: 5c5e0a58/recover4.elf
Jul  1 15:25:51 raspberrypi tftpd[5533]: tftpd: serving file from /export/tftpboot
Jul  1 15:25:53 raspberrypi tftpd[5535]: tftpd: trying to get file: 5c5e0a58/recover4.elf
Jul  1 15:25:53 raspberrypi tftpd[5535]: tftpd: serving file from /export/tftpboot
Jul  1 15:25:55 raspberrypi tftpd[5537]: tftpd: trying to get file: 5c5e0a58/recover4.elf
Jul  1 15:25:55 raspberrypi tftpd[5537]: tftpd: serving file from /export/tftpboot
Jul  1 15:25:57 raspberrypi tftpd[5539]: tftpd: trying to get file: 5c5e0a58/recover4.elf
Jul  1 15:25:57 raspberrypi tftpd[5539]: tftpd: serving file from /export/tftpboot
Jul  1 15:25:59 raspberrypi tftpd[5541]: tftpd: trying to get file: 5c5e0a58/recover4.elf
Jul  1 15:25:59 raspberrypi tftpd[5541]: tftpd: serving file from /export/tftpboot
Jul  1 15:26:01 raspberrypi tftpd[5543]: tftpd: trying to get file: 5c5e0a58/recover4.elf
Jul  1 15:26:01 raspberrypi tftpd[5543]: tftpd: serving file from /export/tftpboot
Jul  1 15:26:05 raspberrypi tftpd[5547]: tftpd: trying to get file: 5c5e0a58/recovery.elf
Jul  1 15:26:05 raspberrypi tftpd[5547]: tftpd: serving file from /export/tftpboot
Jul  1 15:26:07 raspberrypi tftpd[5549]: tftpd: trying to get file: 5c5e0a58/recovery.elf
Jul  1 15:26:07 raspberrypi tftpd[5549]: tftpd: serving file from /export/tftpboot
Jul  1 15:26:09 raspberrypi tftpd[5551]: tftpd: trying to get file: 5c5e0a58/recovery.elf
Jul  1 15:26:09 raspberrypi tftpd[5551]: tftpd: serving file from /export/tftpboot
Jul  1 15:26:11 raspberrypi tftpd[5553]: tftpd: trying to get file: 5c5e0a58/recovery.elf
Jul  1 15:26:11 raspberrypi tftpd[5553]: tftpd: serving file from /export/tftpboot
Jul  1 15:26:13 raspberrypi tftpd[5555]: tftpd: trying to get file: 5c5e0a58/recovery.elf
Jul  1 15:26:13 raspberrypi tftpd[5555]: tftpd: serving file from /export/tftpboot
Jul  1 15:26:15 raspberrypi tftpd[5557]: tftpd: trying to get file: 5c5e0a58/recovery.elf
Jul  1 15:26:15 raspberrypi tftpd[5557]: tftpd: serving file from /export/tftpboot
Jul  1 15:26:17 raspberrypi tftpd[5559]: tftpd: trying to get file: 5c5e0a58/recovery.elf
Jul  1 15:26:17 raspberrypi tftpd[5559]: tftpd: serving file from /export/tftpboot
Jul  1 15:26:19 raspberrypi tftpd[5561]: tftpd: trying to get file: 5c5e0a58/recovery.elf
Jul  1 15:26:19 raspberrypi tftpd[5561]: tftpd: serving file from /export/tftpboot
Jul  1 15:26:21 raspberrypi tftpd[5563]: tftpd: trying to get file: 5c5e0a58/recovery.elf
Jul  1 15:26:21 raspberrypi tftpd[5563]: tftpd: serving file from /export/tftpboot
Jul  1 15:26:23 raspberrypi tftpd[5565]: tftpd: trying to get file: 5c5e0a58/recovery.elf
Jul  1 15:26:23 raspberrypi tftpd[5565]: tftpd: serving file from /export/tftpboot
Jul  1 15:26:25 raspberrypi tftpd[5567]: tftpd: trying to get file: 5c5e0a58/recovery.elf
Jul  1 15:26:25 raspberrypi tftpd[5567]: tftpd: serving file from /export/tftpboot
Jul  1 15:26:27 raspberrypi tftpd[5570]: tftpd: trying to get file: 5c5e0a58/recovery.elf
Jul  1 15:26:27 raspberrypi tftpd[5570]: tftpd: serving file from /export/tftpboot
Jul  1 15:26:29 raspberrypi tftpd[5572]: tftpd: trying to get file: 5c5e0a58/recovery.elf
Jul  1 15:26:29 raspberrypi tftpd[5572]: tftpd: serving file from /export/tftpboot
Jul  1 15:26:31 raspberrypi tftpd[5574]: tftpd: trying to get file: 5c5e0a58/recovery.elf
Jul  1 15:26:31 raspberrypi tftpd[5574]: tftpd: serving file from /export/tftpboot

Display More

At this point it restarts the next boot loop.

Thanks for your help, Dev

**HiassofT** · July 1, 2021 at 3:26 PM

Hmm, I use the same bootloader version but with a flat layout (firmware etc in TFTP root) it looks very different. I see one request to SERIAL/start4.elf and another one to SERIAL/start.elf, then bootloader falls back to root:

Code

Jul  1 16:09:01 camel2 atftpd[10722]: Serving 8eb25f41/start4.elf to 192.168.1.70:26574
Jul  1 16:09:01 camel2 atftpd[10722]: File /wd/srv/tftp-flat/8eb25f41/start4.elf not found
Jul  1 16:09:01 camel2 atftpd[10722]: Serving 8eb25f41/start.elf to 192.168.1.70:26575
Jul  1 16:09:01 camel2 atftpd[10722]: File /wd/srv/tftp-flat/8eb25f41/start.elf not found
Jul  1 16:09:01 camel2 atftpd[10722]: Serving config.txt to 192.168.1.70:26576
Jul  1 16:09:01 camel2 atftpd[10722]: Serving vl805.sig to 192.168.1.70:26577
Jul  1 16:09:01 camel2 atftpd[10722]: File /wd/srv/tftp-flat/vl805.sig not found
Jul  1 16:09:01 camel2 atftpd[10722]: Serving pieeprom.sig to 192.168.1.70:26578
Jul  1 16:09:01 camel2 atftpd[10722]: File /wd/srv/tftp-flat/pieeprom.sig not found
Jul  1 16:09:01 camel2 atftpd[10722]: Serving recover4.elf to 192.168.1.70:26579
Jul  1 16:09:01 camel2 atftpd[10722]: File /wd/srv/tftp-flat/recover4.elf not found
Jul  1 16:09:01 camel2 atftpd[10722]: Serving recovery.elf to 192.168.1.70:26580
Jul  1 16:09:01 camel2 atftpd[10722]: File /wd/srv/tftp-flat/recovery.elf not found
Jul  1 16:09:01 camel2 atftpd[10722]: Serving start4.elf to 192.168.1.70:26581
Jul  1 16:09:01 camel2 atftpd[10722]: File /wd/srv/tftp-flat/start4.elf not found
Jul  1 16:09:01 camel2 atftpd[10722]: Serving start.elf to 192.168.1.70:26582
Jul  1 16:09:02 camel2 atftpd[10722]: Serving fixup.dat to 192.168.1.70:26583
Jul  1 16:09:04 camel2 atftpd[10722]: Serving recovery.elf to 192.168.1.70:49153
Jul  1 16:09:04 camel2 atftpd[10722]: File /wd/srv/tftp-flat/recovery.elf not found
Jul  1 16:09:04 camel2 atftpd[10722]: Serving config.txt to 192.168.1.70:49154
Jul  1 16:09:04 camel2 atftpd[10722]: Serving config.txt to 192.168.1.70:49155
Jul  1 16:09:04 camel2 atftpd[10722]: Serving distroconfig.txt to 192.168.1.70:49156
Jul  1 16:09:04 camel2 atftpd[10722]: Serving distroconfig.txt to 192.168.1.70:49157

...

Display More

Your log however shows SERIAL/start4.elf requests repeating in 2 second intervals - and tftpd serving it (?)

Might be worth digging into the tftp config/setup, something seems to be odd there (maybe permissions or timeouts).

For reference here's my bootloader config (basically default settings, except for boot uart and order)

Code

LibreELEC:~ # rpi-eeprom-config 
[all]
BOOT_UART=1
WAKE_ON_GPIO=1
POWER_OFF_ON_HALT=0
DHCP_TIMEOUT=45000
DHCP_REQ_TIMEOUT=4000
TFTP_FILE_TIMEOUT=30000
ENABLE_SELF_UPDATE=1
DISABLE_HDMI=0
SD_BOOT_MAX_RETRIES=1
USB_MSD_BOOT_MAX_RETRIES=1
BOOT_ORDER=0xf21

Display More

so long,

Hias

NullDev · July 1, 2021 at 4:28 PM

This was my original eeprom-config:

Code

[all]
BOOT_UART=0
WAKE_ON_GPIO=1
POWER_OFF_ON_HALT=0
DHCP_TIMEOUT=45000
DHCP_REQ_TIMEOUT=4000
TFTP_FILE_TIMEOUT=30000
TFTP_IP=192.168.1.231
TFTP_PREFIX=0
BOOT_ORDER=0x21
SD_BOOT_MAX_RETRIES=3
NET_BOOT_MAX_RETRIES=5
[none]
FREEZE_VERSION=0

Display More

I've changed it to exactly your config but no differenc when booting from net. It still directly accesses the UID-subdir within tftp.

And there is no obvious permission problem as the Pi can load start.elf and config.txt successfully. All other requested files simply don't exist.

I still can't understand why your Pi requests a totally different set of files.

Thanks, urle

**HiassofT** · July 1, 2021 at 6:43 PM Best Answer

Which tftp server are you using, is it by chance the netkit one ("tftpd" package in debian/raspbian)? If yes, don't use it, it doesn't work (just tested that here locally) and even the package description warns that it has issues:

Code

hias@camel2:~$ apt-cache show tftpd
...
 Warning: Does not support 'tsize', which is required by some tftp clients,
 especially PXE, and various other network boot clients. For those, use atftpd
 or tftpd-hpa.
...

Both atftpd (which I usually use) and tftpd-hpa work fine here.

so long,

Hias

NullDev · July 1, 2021 at 9:18 PM

Thanks for that tip, I'll give it a try.

NullDev · July 5, 2021 at 10:10 AM

Quote from HiassofT
Which tftp server are you using, is it by chance the netkit one ("tftpd" package in debian/raspbian)? If yes, don't use it, it doesn't work (just tested that here locally) and even the package description warns that it has issues:
Code
hias@camel2:~$ apt-cache show tftpd
...
 Warning: Does not support 'tsize', which is required by some tftp clients,
 especially PXE, and various other network boot clients. For those, use atftpd
 or tftpd-hpa.
...
Both atftpd (which I usually use) and tftpd-hpa work fine here.
so long,
Hias

Hello Hias,

switching over to atftpd worked finally.

Thanks so much for your patience!

Best, Dev