A father who was found not guilty of the manslaughter of his newborn son, 16 years after shaking the baby, said the "devastating" prosecution "turned my world upside down".