Raspberry Pi PoE hat fan not running

So I have an RPi4, generally runs OK, but can run hot. I have it with the official PoE (not the + version) hat, but for some reason the fan never seems to come on even though it appears the firmware settings for the fan curves are turned on. Any ideas?