Business confidence among Irish brokers has deteriorated significantly in the last six months, according to a new survey.