A French politician has quit of the Socialist Party after he was criticised for saying there were too many black players on the national football team.