Hey guys, after a while I finally got everything lined together. I assembled my PCBs and put them on the Joystick and I am getting a strange behaviour.
So I tried all my PCBs on a single axis, all of them worked as expected, then I tried two of them at the same time and it worked for about 20 seconds and then the Arduino shut itself down, I would reconnect it but it wouldn't turn on.
Then i disconected the +5V cable to one of the PCBs and reconnected and it instantly started working and both axis were working again.