The Irish Polish Society has said comments made by a District Court Judge about the Polish community were "inappropriate and irresponsible".