Copy a 'problem' test file to the local SD card. If it plays fine (which it probably will) the finger points at the nework being unable to sustain the required data rate. If you bump to an LE12 nightly it's possible to fiddle with cache settings in the GUI (in LE11 you can do the same though advancedsettings.xml) but cache fiddling is a double edged sword and causes as many problems as it solves. If you increase the cache size the RPi5 may be able to cope better with temp glitches in connectivity and data rates, but you'll also need to read more data over the flaky connection before playback starts. The read-factor may be the better tool to adjust, and reducing the cache or read-factor can sometimes also be the solution, not increasing. It's all about what works in YOUR network so it's all about testing and experimentation not reading forum posts on what worked for someone else.
If the file doesn't play well from SD card .. then it's something else, but my money's on the evil that is WiFi connectivity. I'm playing a wide assortment of very large filesize media from a wired NAS to a wired RPi5 with zero issues.