I found the issue.
On LE when I run ethtool eth0 it shows its only running at 100mb and not 1000mb. While on Pi OS its running at GB speeds.
I've just booted latest nightly on Pi4.
Code
LibreELEC:~ # uname -a
Linux LibreELEC 5.15.61 #1 SMP Thu Sep 15 23:40:51 UTC 2022 aarch64 GNU/Linux
LibreELEC:~ # ethtool eth0 | grep Speed
Speed: 1000Mb/s
So I'm not seeing the issue on my network.