I'm using the latest beta (9.1.501) and even the controller configuration dialog does react to the button presses, I can't use the controller to navigate the interface... I feel like I'm missing something obvious?
I ended up using the default Kodi controller instead and mapping the buttons to whatever matched on the OUYA controller, and I can now use that to navigate