Yes, reducing video quality to increase audio quality points to a weak data bus. That's why your above RPi sound card will not do the trick.
If you search for best audio compatibility (Dolby Atmos etc.), and price doesn't matters, then have a look at the Nvidia Shield TV. It's probably the best streaming box (also available as "pro" version).
If you want to stay with LE, an Intel NUC will provide better performance. I don't have this, so other users should verify AAC / H265 compatibility before you buy.