Former US treasury secretary Lawrence Summers has withdrawn from consideration to be chairman of the Federal Reserve, saying it would hurt the nation for him to go forward with what would be a contentious confirmation before the US Senate.