The number of Japanese taking overseas trips in November fell by a record on-year margin amid continued fear in the wake of the terrorist attacks in the US, a travel organization said.