If there are reports on abuse in the past, may I assume that they were also investigated? Since nothing occurred, may I also assume that they were found unsubstantiated? May I also assume that you continued to live with your spouse and he had access to the children and may have cared for them when you were unavailable?
In short, unless you have somethinbg to indicate abuse is occurring now, the old allegations that provide unsubstantiated, and your conduct which inconsistent with significant concern, would have little impact now.
Once again, I am quite certain that there is much more to this story than meets the eye.