A new report looking at the long-term effects of the recession shows most people have not felt the recovery yet.