There is a complication with live streams (like PVR) that the clock of the backend is probably not synchronised with the clock of the frontend.
The clocks will typically be driven by a crystal oscillator with an accuracy of around 100ppm (0.01%).
If it turns out that the frontend clock runs 0.1% faster than the backend, the amount of buffered data will gradually deplete until it is empty and kodi will pause to buffer again.
It is possible you are hitting this issue and by pausing you are giving more time before the buffered data runs out.
The good news is that if this is your issue then Kodi Krypton has a solution for this (audio resampling is used to manage the amount of buffered data, so synchronising the backend and frontend clocks).
You could try a LE 17 Kypton alpha build, or a Milhouse nightly build to see if the issue is still present.