This odd-shaped, brick-faced and well-sited ‘60s Tivoli House, replaced a Palladian manor, which had its origins in the mid-1700s.