David Cameron has been dealt a fresh blow as a former Tory leader said the EU renegotiation had "met with failure".