If I connect via librespot it gets choppy.
So it might has something to do with the plug-in.
That's possible. You probably have an outdated version of librespot, because the add-on repo is different for newer Kodi / LE.
You can't use librespot from a newer repo, because it has different software dependencies (Python version).
Compiling your own librespot needs programming skills.