A football team has revealed that scramblers driving at high speeds are forcing children to train away from their usual pitch.