Settings > System > Input > Peripherals > CEC Adaptor > set "Devices to power on during startup" to "none"
Thanks chewitt, that did it! In my case that wasn't enough and I also had to disable the option ”Switch source to this device on startup” on the same menu.
Cheers!