David Holdsworth has left his managerial post at Goole just days after sacked defender Karl Colley’s altercation with a visiting fan.