The head of the IMO's GP committee has said there is evidence that people are putting off visiting their doctor based on whether or not they can afford it.