That's not much if you are developing something
Anyway, push your kernel to github or some similar service, so I can check what's missing. Having kernel config would also be useful.
Jernej, I tired your patches on linux 5.3.7 and now the hdmi sound works. Seems something was broken in 5.3.6.