The British and Irish Lions have insisted they are not to blame for the high ticket prices that have led to disappointing attendances during their tour of South Africa.