A father of three who had legal aid withdrawn after he went on holidays instead of appearing in court was on his first family vacation in seven years, a judge has been told.