Switzerland’s defence minister said it was “unthinkable” that his country’s accords with the EU would be terminated as result of a referendum to curb immigration, saying threats of retaliation by the bloc were overblown.