Take a few days off. Keep the area clean and dry.
Try diaper rash ointment or maybe Aloe Vera and perhaps something like neosporin or OTC acne ointment.
Cover affected area(s) with bandaging… such as a hydrocolloid or semiocclusive hydrogel dressing. Personally, I'd use this over an anti-bacterial ointment. This especially if you aren't taking days off.
The goal is to avoid infection and speed healing. You don't want boils forming.