Ok , i Just found a Solution to my issue, its maybe not a beautiful one , but it works, at least for now , not sure if it will cause some other things to not work , didnt tested it to much .
Just in case someone has the same issue , here is my solution.
Navigate into the keymaps folder.
Create a new File called mouse.xml
paste this into the file
Then Press ctrl + x then press y followed by enter to save the file you just created.
then do a simply reboot with
And everything should work fine now
You can of curse also use a SFTP Client like Filezilla to connect and create the file =)