Transport minister Shane Ross is refusing to allow a cabinet of politicians to have the final say on how judges are chosen.