A day care centre for people with intellectual disabilities has apologised after leaving a young man behind on a swimming trip.