Over a third of TDs are afraid that speaking out about immigration rights could lose them electoral support, a new report has revealed.