An investigation has found that children were left in a foster home for years after allegations of sexual abuse against one foster family.