The fraud investigation of fallen US financier Bernard Madoff took an unusual twist as the US attorney general removed himself from the criminal probe.