Hello, I'm also experiencing a nasty memory leak with LE on RPi 4B 4Gb.
I've a similar setup as OP, where I've the RPi connected to a LG TV alongside a Denon Receiver with HDMI ARC (not sure if that's relevant, I've only just started to investigate the problem).
I've tried setting MALLOC_ARENA_MAX=8 as mentioned in this forum but it hasn't resolved nor mitigated the problem.