One of the last surviving Irish soldiers granted a pardon after fighting against Nazi Germany has laid a wreath to remember his comrades.