The father of an infant who fell to his death from an apartment said he would not wish what he was going through on his worst enemy.