I'm surprised they willingly went right back to work (though apparently with a raise for Kittia at least) but i guess it is easy to see why, after the last 40 years or so, a gym has to be fast and thorough with its response to abuse allegations.
Just saying "Coach X has taken a leave of absence" will be seen as weak and protectionist if it comes out they were abusive, but "you are fired because there are hints of a problem...oh sorry" looks weak and reactive. There really isn't a good option, especially if the gym owner hasn't been keeping an eye on everything to know if there is any smoke, much less fire.
I suppose SafeSport could give out rankings for its investigations, to give the communities a hint of how bad it looks to be without getting into details. Like a Level 1, we aren't sure it isn't just some disgruntled parents, Level 3, things are looking bad, and Level 5, keep children away, stat. Either way Holcomb's apology doesn't feel like their lawyers looked at it, or else they told him to fall on his sword.