Doesn't matter what I do, I can't seem to push the arm all the way, even though the screwbolt is tight and it feels stable:
I just replaced a worn out and damaged arm but they look similar enough to not have this gap (old on the left, right is new):