Some five million years of slugging it out with our fists has left its mark on the human face, scientists believe.