A 78-year-old man has been charged with the rape and indecent assault of four people at hospitals in the 1970s and 80s.