A man accused of a taxi driver’s manslaughter told gardaí he threw a punch to avoid being hit over a dispute about a fare.