A former Garda officer alleged to have been suspicious that three of his colleagues colluded with the IRA has claimed he cannot recall rumours that they were linked to subversives.