A four-star luxury castle hotel in Kerry has been refused planning permission for an extension, because of the adverse impact it would have on the historic building.