Australian Foreign Minister Alexander Downer today rejected calls by legislators to ban Zimbabwean President Robert Mugabe from a Commonwealth summit in October.