An underlying, "low-grade hostility” to the Irish voice in the UK had emerged as a result of Brexit and relation between the two countries will never be the same again, an economic conference has been told.