I met Margaret Thatcher half-a-dozen times in the fraught 1980s. She was inquisitive, formidable, and indifferent to opinion of her,says Allan Prosser