DATING way back to the time of Henry the Second, Ballycogley Castle was built by the Wadding family, colonists who did well out of the English invasion of this area of Co Wexford.