Four travellers who had been playing soccer for North Clare club, Sporting Ennistymon, have quit the sport following numerous incidences of racist abuse.