BILLY WALSH admitted yesterday that he was irked by the suggestion from Belfast opponent James Gorman that he only had temporary custody of the All-Ireland welterweight championship belt.