Good question. I just recommended a book about that in the Christmas book thread.
Here is a review of that book:
http://physicsweb.org/articles/review/15/3/1
I think the "beuty" is related to "simplicity". It is all about finding the simplest way to explain something, and then wrap it all up in the shortest equation possible. Like E=mc2...