A shadow cabinet minister has described a key Labour Brexit policy as "bollocks", according to reports.