The Minister for Transport Leo Varadkar says he fears that a rise in fares on public transport will be counter-productive, but insisted: "I don't set the fares".