Insight Venture Partners topped a $25.50-a-share bid that Quest Software received from an unidentified suitor, intensifying a takeover battle for the software maker, according to a person familiar with matter.