The Environment Minister Alan Kelly says Michael Lowry's controversial note to the Taoiseach Enda Lenny contained a "silly and stupid" comment, but would not go so far as to call it sexist.