A member of the banking inquiry has called on Fianna Fáil to apologise for Brian Lenihan's claim that "we all partied".