Same as this question one side of brake pad retention problem (i.e. attached to rim) but mine is a cantilever brake. The answer there doesn't work as mine doesn't have those screws and the brake holders look very different.
The bike is a mountain bike if it matters.