Cliff Richard has turned down the freedom of his adopted Portuguese home city after finding himself at the centre of a police sex abuse investigation.