A criminal investigation has been launched after a battery was found inside a chocolate Easter bunny.