John Perry, the junior jobs minister, has been heavily criticised after he declared people were “emigrating by choice”.