A father of two who punched a 72-year-old woman on her way home from Mass has been jailed for two and a half years.