People with disabilities, young people, refugees and migrants face significant barriers to employment which could be increased by the Covid-19 pandemic, a new report has warned.