The Vice Chair of the Labour Party has said it is up to the Tánaiste if he see's fit to leave the Department of Foreign Affairs.