Mick Wallace has been forced to break ranks with a group of independents over his tax affairs.