Does LibreElec have a way to do this easily? I could try to watch some tv shows / movies and check the temps afterwards but not sure how feasible it would be
Yes for the CPU temperature - leave the movie playing in the background and go into Settings - System Information - Hardware.