FACIAL SOFT BIOMETRICS - Library of Ph.D. Theses | EURASIP

FACIAL SOFT BIOMETRICS - Library of Ph.D. Theses | EURASIP FACIAL SOFT BIOMETRICS - Library of Ph.D. Theses | EURASIP

theses.eurasip.org
from theses.eurasip.org More from this publisher
13.07.2015 Views

78 6. SOFT BIOMETRICS FOR QUANTIFYING AND PREDICTING FACIAL AESTHETICS Figure 6.5: Comparison of average MOS for subjects of the HOTorNOT database and of averagêMOS for subjects of the People’s magazine most beautiful people list. AverageMOS and ̂MOSvalues with related a confidence interval for 95%.they age. We specifically selected females with images available from a broad time spectrum,e.g. images available from an age about 18 years old to 60 years old. We annotated labeled theseimages with the facial and photographic traits from Section 6.3.2 and Section 6.3.3 and computedthe corresponding ̂MOS values. We obtained per subject several beauty scores spanned over time.Since the range of these beauty functions differed on the MOS scale between different females, wenormalized the functions to1, with1being the maximum ̂MOS per female. We then averaged thenormalized beauty over time functions and estimated based on the result a polynomial function ofthe 5th degree. Figure 6.6 displays the merged functions and the related estimation function. Theresulting beauty function over time bares a maximum between the ages 23 to 33. The outcomecan be explained on the one hand by traits changes like wrinkles and presence of glasses withadvancing age, as well as on the other hand by a reduced interest in regards to make up or hairstyle. Figure 6.6: ̂MOS for females of different ages normalized to 1 per female, with 1 being themaximum ̂MOS per female, and furthermore averaged over all considered females.6.6.3 Facial surgeryWe also examined the effect of blepharoplasty (eyelid lifting surgery) on the beauty index.Our choice of this specific parameter and surgery was motivated by the fact that eye size has been

79shown to have a high impact on our chosen beauty metric. We randomly selected 20 image pairs(before and after the surgery 2 , see Figure 6.7) from the plastic surgery database [SVB + 10], andafter annotation, we computed the related beauty indices. Interestingly our analysis suggested arelatively small surgery gain in the ̂MOS increase. Specifically the increase revealed a modestsurgery impact on the beauty index, with variations ranging in average between 1% and 4%.Figure 6.7: Examples of the Plastic Surgery Database. The left images depict the subjects beforesurgery, the right images after surgery.We proceed with the analysis and simulation of an automatic tool for facial beauty prediction.6.7 Towards an automatic tool for female beauty predictionAn automatic tool including classification regarding all 37 above presented traits will havethe benefit of a maximal achievable prediction score, at the same time though each automaticallydetected trait will bring an additional classification error into the prediction performance. Thus indesigning such an automatic tool a tradeoff between possible prediction score and categorizationerror has to be considered. We illustrate an analysis of prediction scores evoked by differentcombinations of traits in Table 6.2.Trait x iPearson’s correlationcoefficient r i,MOSx 1 0.5112x 1 , x 2 0.5921x 1 , x 2 , x 12 0.5923x 1 , x 2 , x 3 0.6319x 1 , x 2 , x 8 0.6165x 1 , x 2 , x 12 , x 15 0.5930x 1 , x 2 , x 3 , x 8 0.6502x 1 , x 2 , x 12 , x 15 , x 14 0.6070x 1 , x 2 , x 4 , x 12 , x 14 , x 15 0.6392x 1 , x 2 , x 4 , x 5 , x 12 , x 14 , x 15 0.6662x 1 , x 2 , x 4 , x 5 , x 12 , x 14 , x 15 , x 20 0.6711x 1 , x 2 , x 8 , x 14 , x 20 , x 23 0.6357Motivated by this Table 6.2 and towards simulating a realistic automatic tool for beauty prediction,we select a limited set of significant traits, x 1 ,x 2 ,x 8 , with other words factors describing1how big the eyes of a person 1 2 are, the ratio head width/head height and the presence of glasses.1 2 8Moreover we add acquisition traits with no extra error impact, such as x 14 ,x 20 ,x 23 , namely im-1 2 8 14 20 231age format, JPEG quality measure and image resolution. We then proceed to appropriate reliability1 21 2 8scores related tox 1 ,x 2 ,x 8 based on state of the art categorization algorithms:14 20 23 1 2 82. For this experiment all values attached to non permanent traits were artificially kept constant for "before surgery"and "after surgery" images.

79shown to have a high impact on our chosen beauty metric. We randomly selected 20 image pairs(before and after the surgery 2 , see Figure 6.7) from the plastic surgery database [SVB + 10], andafter annotation, we computed the related beauty indices. Interestingly our analysis suggested arelatively small surgery gain in the ̂MOS increase. Specifically the increase revealed a modestsurgery impact on the beauty index, with variations ranging in average between 1% and 4%.Figure 6.7: Examples <strong>of</strong> the Plastic Surgery Database. The left images depict the subjects beforesurgery, the right images after surgery.We proceed with the analysis and simulation <strong>of</strong> an automatic tool for facial beauty prediction.6.7 Towards an automatic tool for female beauty predictionAn automatic tool including classification regarding all 37 above presented traits will havethe benefit <strong>of</strong> a maximal achievable prediction score, at the same time though each automaticallydetected trait will bring an additional classification error into the prediction performance. Thus indesigning such an automatic tool a trade<strong>of</strong>f between possible prediction score and categorizationerror has to be considered. We illustrate an analysis <strong>of</strong> prediction scores evoked by differentcombinations <strong>of</strong> traits in Table 6.2.Trait x iPearson’s correlationcoefficient r i,MOSx 1 0.5112x 1 , x 2 0.5921x 1 , x 2 , x 12 0.5923x 1 , x 2 , x 3 0.6319x 1 , x 2 , x 8 0.6165x 1 , x 2 , x 12 , x 15 0.5930x 1 , x 2 , x 3 , x 8 0.6502x 1 , x 2 , x 12 , x 15 , x 14 0.6070x 1 , x 2 , x 4 , x 12 , x 14 , x 15 0.6392x 1 , x 2 , x 4 , x 5 , x 12 , x 14 , x 15 0.6662x 1 , x 2 , x 4 , x 5 , x 12 , x 14 , x 15 , x 20 0.6711x 1 , x 2 , x 8 , x 14 , x 20 , x 23 0.6357Motivated by this Table 6.2 and towards simulating a realistic automatic tool for beauty prediction,we select a limited set <strong>of</strong> significant traits, x 1 ,x 2 ,x 8 , with other words factors describing1how big the eyes <strong>of</strong> a person 1 2 are, the ratio head width/head height and the presence <strong>of</strong> glasses.1 2 8Moreover we add acquisition traits with no extra error impact, such as x 14 ,x 20 ,x 23 , namely im-1 2 8 14 20 231age format, JPEG quality measure and image resolution. We then proceed to appropriate reliability1 21 2 8scores related tox 1 ,x 2 ,x 8 based on state <strong>of</strong> the art categorization algorithms:14 20 23 1 2 82. For this experiment all values attached to non permanent traits were artificially kept constant for "before surgery"and "after surgery" images.

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!