Former taoisigh have warned of violent and criminal consequences if Brexit triggers the setting up of fresh border infrastructure in the North.