Australia's team bosses have refused to move staff or athletes into the Olympic Village in Rio after claiming the buildings are dangerous and uninhabitable.