- Take a few days off. Keep the area clean and dry.

- Try diaper rash ointment or maybe Aloe Vera and perhaps something like neosporin or OTC acne ointment. 

- Cover affected area(s) with bandaging… such as a hydrocolloid or semiocclusive hydrogel dressing. Personally, I'd use this over an anti-bacterial ointment. This especially if you aren't taking days off.

The goal is to avoid infection and speed healing. You don't want boils forming.