Former members of the board of the Central Remedial Clinic, who were forced out over the charity top-ups scandal, have refused to turn up for a high-profile meeting on the issue.