It will affect the video audio too if you are not using passthrough.
If you have this issue with passthrough audio, then there is nothing kodi can do -
the audio is decoded and output by the TV/AVR and kodi has no influence on how it sounds.
I just enabled passthrough but nothing changed. The GUI volume has always been set at 100%