The landlord of a historic pub in England has described how a man "escorted from the premises" was the driver of a car which then crashed into the front door, injuring four people.