Justin Timberlake has been blasted for not spending time with the children of a charity he raised money for.