Former junior finance minister Brian Hayes says that social media speculation over who his guests were at the Oireachtas Golf Society dinner is "all made up".