A five-year-old boy must leave his English mother and return to Spain to live with his Moroccan father, a High Court judge has ruled.