DAVID BLUNKETT declared yesterday that he would not allow his critics to drive him out of office as he battled to save his career.