A radical Muslim cleric has refused to discuss with police his alleged links to the terror group blamed for the Bali nightclub bombings.