One of the more surprising facts about Whiddy Island in Bantry Bay is the size of its population in the 19th century.