The budget deficit contracted to €3.5bn at the end of May compared to a €5.3bn deficit for the same period last year.