This page looks at a machine learning algorithm developed at Yahoo Labs that distinguishes beautiful portraits from the not-so perfect.
The results… The single most important factor is the sharpness of the image, especially the eyes, and the contrast between the face and background. Curiously, under and overexposed images scored better, suggesting that photographers can create beautiful images by playing with under and overexposed images.