Sinn Fein party leader Gerry Adams is to visit Cuban President Fidel Castro next week on a trip that Irish-American supporters say they oppose.