An island community off the south-west coast has asked people not to visit, as part of an effort to protect the elderly living there.