The real answer is to use the D-Pad, using the Analog stick for this kind of game is wack.
The answer you probably want is to use a deadzone, that could for example be done using Steam Input settings (Steam→Settings→Controller→Calibration & Advanced Settings)
The idea is to increase the Deadzone size until the stick snapping back remains inside of it.