FACIAL SOFT BIOMETRICS - Library of Ph.D. Theses | EURASIP

FACIAL SOFT BIOMETRICS - Library of Ph.D. Theses | EURASIP FACIAL SOFT BIOMETRICS - Library of Ph.D. Theses | EURASIP

theses.eurasip.org
from theses.eurasip.org More from this publisher
13.07.2015 Views

24 2. SOFT BIOMETRICS: CHARACTERISTICS, ADVANTAGES AND RELATED WORKfrom videos and exploited in a multiple camera video surveillance scenario in order to track thesubjects that cross the surveillance network. In [LLZ06] an approach for recognizing the gender,ethnicity and age with facial images is proposed. The approach incorporates Gabor filter, Adaboostlearning as well as support vector machine classifiers. A further hybrid classification basedon gender and ethnicity is considered in [GPW98] and [GW99]. The hybrid approach consistsof an ensemble of radial basis function networks and inductive decision trees. The authors showrobustness and good performance. A different approach for analysis in hybrid soft biometric systemsis provided in [SGN08] and [RN10], where semantic information (which corresponds to softbiometric classifiers) is manually extracted from a series of videos. Using the analysis of variancethe authors select a pool of traits which are considered the most representative. Those traits arethen used together with gait information. The authors demonstrate that the additional informationprovided by the semantic traits increases the performance of the people recognition system basedon gait. Those results are extended in [RNS11] and in [RN11]. The authors in [ACPR10] go onestep further and study the relation of human body measures, which allows for certain applicationsthe prediction of missing body measures. In [VFT + 09] the authors propose an approach for peoplesearch in surveillance data, characterized by three main elements: sensors, body parts, and theirattributes. The body parts and attributes are here closely related to soft biometrics.2.4 Domains of applicationSoft biometrics are either employed as uni modal systems, classifying a single trait classifiers,or in a combination with other systems. We differentiate following main domains of application.Fusion with classical biometric traits : SBSs are incorporated in multi modal biometricalsystems with the goal of increasing the overall reliability. Such an approach has been followed, in[JDN04b], where the benefits of soft biometrics in addition to fingerprint lead to an improvementof approximately 5% over the primary biometric system.Pruning the search : SBS were employed in previous works to pre filter large biometricdatabases with the aim of higher search efficiency. Scientific work on using soft biometricsfor pruning the search can be found in [KBN08, KBBN09], where a multitude of attributes,like age, gender, hair and skin color were used for classification of a face database, as well asin [GBDB97, New95] where the impact of pruning traits like age, gender and race was identifiedin enhancing the performance of regular biometric systems.A third application is the employment of a multi modal SBS with the goal of human identificationor human re-identification.Human (re-)identification : For human (re-)identification the soft biometric trait related limitationsof distinctiveness and permanence are overcome by combining multiple traits. The concept ofBag of Soft Biometrics(BoSB) is directly inspired from the idea of Bag of Words [Joa98, WPS06]and Bag of Features [LSP06] developed under the context of text mining and content based imageretrieval. For the BoSB the “items” of the bag are soft biometric signatures extracted from thevisual appearance of the subject.Other possible applications relate to the ability to match people based on their biometric-traitpreferences, acquiring statistical properties of biometric identifiers of groups, avatar modellingbased on the instantaneous facial characteristics (glasses, beard or different hair color), statisticalsampling of audiences, and many others.

25Chapter 3Bag of facial soft biometrics for humanidentificationThe concept of person identification based on soft biometrics originates in the way humansperform face recognition. Specifically human minds decompose and hierarchically structure complexproblems into fractions and those fractions into further sub-fractions, cf. [Ley96], [Sim96].Consequently face recognition performed by humans is the division of the face into parts, andsubsequent classification of those parts into sub-categories. Those sub-categories are associatedwith what refer to as soft biometrics and the key is that each individual can be categorized in termsof such characteristics, by humans or by image processing algorithms. Although features suchas hair, eye and skin color, facial hair and shape, or body height and weight, gait, clothing colorand human metrology are generally non distinctive, a cumulative combination of such featuresprovides an increasingly refined and explicit description of a human.3.1 Main parameters: authentication group, traits, trait-instances,and categoriesThe setting of interest corresponds to the general scenario where, out of a large population, anauthentication group is randomly extracted as a random set ofnpeople, out of which one person ispicked for identification (and is different from all the other members of the authentication group).We note that this general scenario is consistent with both, the case of person verification as well asof identification. A general soft-biometric system employs detection that relates toλsoft biometrictraits (hair color, skin color, etc), where each trait i, i = 1,2,...,λ, is subdivided into µ i traitinstances, i.e., each trait i can take one of µ i values. We henceforth denote as category to be anyλ-tuple of different trait-instances, and we let Φ = {φ i } ρ i=1define a set of all ρ categories, i.e.,the set of all ρ combinations of soft-biometric trait-instances. The number of ρ, that the system isendowed with, is given byρ = Π λ i=1µ i (3.1)We slightly abuse notation and henceforth say that a subject belongs to category φ if hisor her trait-instances are the λ-tuple corresponding to category φ. We here note that to haveconclusive identification of a subject, and subsequent differentiation from the other subjects of theauthentication group, it must be the case that the subject does not belong in the same category asother members of the authentication group. Given a specific authentication group, the maximumlikelihoodoptimizing rule for detecting the most probable category in which a chosen subject

24 2. <strong>SOFT</strong> <strong>BIOMETRICS</strong>: CHARACTERISTICS, ADVANTAGES AND RELATED WORKfrom videos and exploited in a multiple camera video surveillance scenario in order to track thesubjects that cross the surveillance network. In [LLZ06] an approach for recognizing the gender,ethnicity and age with facial images is proposed. The approach incorporates Gabor filter, Adaboostlearning as well as support vector machine classifiers. A further hybrid classification basedon gender and ethnicity is considered in [GPW98] and [GW99]. The hybrid approach consists<strong>of</strong> an ensemble <strong>of</strong> radial basis function networks and inductive decision trees. The authors showrobustness and good performance. A different approach for analysis in hybrid s<strong>of</strong>t biometric systemsis provided in [SGN08] and [RN10], where semantic information (which corresponds to s<strong>of</strong>tbiometric classifiers) is manually extracted from a series <strong>of</strong> videos. Using the analysis <strong>of</strong> variancethe authors select a pool <strong>of</strong> traits which are considered the most representative. Those traits arethen used together with gait information. The authors demonstrate that the additional informationprovided by the semantic traits increases the performance <strong>of</strong> the people recognition system basedon gait. Those results are extended in [RNS11] and in [RN11]. The authors in [ACPR10] go onestep further and study the relation <strong>of</strong> human body measures, which allows for certain applicationsthe prediction <strong>of</strong> missing body measures. In [VFT + 09] the authors propose an approach for peoplesearch in surveillance data, characterized by three main elements: sensors, body parts, and theirattributes. The body parts and attributes are here closely related to s<strong>of</strong>t biometrics.2.4 Domains <strong>of</strong> applicationS<strong>of</strong>t biometrics are either employed as uni modal systems, classifying a single trait classifiers,or in a combination with other systems. We differentiate following main domains <strong>of</strong> application.Fusion with classical biometric traits : SBSs are incorporated in multi modal biometricalsystems with the goal <strong>of</strong> increasing the overall reliability. Such an approach has been followed, in[JDN04b], where the benefits <strong>of</strong> s<strong>of</strong>t biometrics in addition to fingerprint lead to an improvement<strong>of</strong> approximately 5% over the primary biometric system.Pruning the search : SBS were employed in previous works to pre filter large biometricdatabases with the aim <strong>of</strong> higher search efficiency. Scientific work on using s<strong>of</strong>t biometricsfor pruning the search can be found in [KBN08, KBBN09], where a multitude <strong>of</strong> attributes,like age, gender, hair and skin color were used for classification <strong>of</strong> a face database, as well asin [GBDB97, New95] where the impact <strong>of</strong> pruning traits like age, gender and race was identifiedin enhancing the performance <strong>of</strong> regular biometric systems.A third application is the employment <strong>of</strong> a multi modal SBS with the goal <strong>of</strong> human identificationor human re-identification.Human (re-)identification : For human (re-)identification the s<strong>of</strong>t biometric trait related limitations<strong>of</strong> distinctiveness and permanence are overcome by combining multiple traits. The concept <strong>of</strong>Bag <strong>of</strong> S<strong>of</strong>t Biometrics(BoSB) is directly inspired from the idea <strong>of</strong> Bag <strong>of</strong> Words [Joa98, WPS06]and Bag <strong>of</strong> Features [LSP06] developed under the context <strong>of</strong> text mining and content based imageretrieval. For the BoSB the “items” <strong>of</strong> the bag are s<strong>of</strong>t biometric signatures extracted from thevisual appearance <strong>of</strong> the subject.Other possible applications relate to the ability to match people based on their biometric-traitpreferences, acquiring statistical properties <strong>of</strong> biometric identifiers <strong>of</strong> groups, avatar modellingbased on the instantaneous facial characteristics (glasses, beard or different hair color), statisticalsampling <strong>of</strong> audiences, and many others.

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!