Volunteers who have been at the forefront in promoting a famed harbour fort as a major tourist attraction are seeking to have a say in its future.