People in positions of power need to go out to communities battling drugs, crime and neglect and put resources into them and give people living there “a chance”, a conference on young people and gangs has heard.