Landlords have defended themselves from claims they are to blame for the housing crisis and said the Government should take responsibility.