I look at it the other way - whatswhat's the required number of figuresfingers to maintain a hold of the handle bars. On a sealed road it's close to 0, leaving 4 for braking. In a serious rough/rocky track, it might take four, leaving none for the brakes (along with praying it smooths out soon). Lose the handle bar, you lose brakes and steerage - theresthere's only one way that ends, and you are a passenger. Going too fast with steerage - there is more than one possible outcome, which you have a degree of control over the outcome, and can usually minimize the damage.
Off road, I typically use my outer figuresfingers first - pinky + 1 is the minimum for useful braking, never more than pinky + 2.