A NUMBER of farmers have withdrawn from potato production because they want to consolidate their Single Payment, according to IFA.