Doesn't matter what I do, I can't seem to push the arm all the way, even though the screw is tight and it feels stable:

I just replaced a worn out and damaged arm but they look similar enough to not have this gap (old on the left, right is new):