Former workers at a building materials company in Co Cavan have agreed to attend talks at the Labour Relations Commission (LRC) this Friday.