Denying Michael Lowry the right to meet ministers would deprive his constituents of a voice in parliament, James Reilly has said.