Campaigners have said the Government has been too slow to put measures in place to deal with the housing crisis.