A local authority has been accused of abandoning dozens of residents living in an apartment complex condemned as a fire trap.