A major Japanese Buddhist temple has pulled out of a plan to host the Beijing Olympics torch relay, it was reported today, amid speculation that the monks sympathised with Tibetan protesters.