Mortgage lender and life assurance company Irish Life & Permanent has appointed former EU Commissioner and Attorney General David Byrne as a non-executive director.