The proprietor of a Kerry hotel which is set to close has cited speculation that the venue was to house asylum seekers as one of the reasons it has gone out of business.