'X Factor' boy band Union J may be sued by a former manager who wants five per cent of their earnings.