A row has broken out over where an anchor from a scuttled gun-running ship should be displayed.