Black gave the home side the lead with a deflected drive in the 28th minute and in the 56th minute he was crunched in a tackle by Joe Ledley to earn the Hoops midfielder a red card.
Two minutes later the Gorgie men scored a breakaway second through Templeton.
After a penalty claim was ignored by referee Craig Thomson, when Jambos substitute Ryan Stevenson, on for Black, looked like he might have used an arm in the box, the raging Lennon was dismissed from the dugout after aggressively complaining to fourth official Steven McLean and linesman Graham Chambers. The incident is sure to spark more controversy in light of Lennon’s spat with the SFA and referee Dougie McDonald after the official rescinded a penalty at Dundee United and then lied to Lennon about how he reached the decision.
HEARTS: Kello, Palazuelos, Bouzid, Zaliukas, Jonsson, Templeton (Santana 87), Black (Stevenson 64), Mrowiec, Skacel (Craig Thomson 78), Kyle, Elliott.
CELTIC: Forster, Wilson (Cha 62), Majstorovic, Hooiveld, Izaguirre, Maloney, Ledley, Ki, Samaras, Stokes (McGinn 62), Hooper.
Referee: C Thomson.