PAT HICKEY considered quitting as Olympic Council of Ireland president five years ago following a campaign to oust him from the role.