Social workers in north Dublin say the welfare of their clients could be at risk if a plan to relocate them to a new office is implemented.