The AGSI has told the Government “not to throw the baby out with the bathwater” in parachuting a police officer from another country in as commissioner.