08.05.2014 Views

The Ideal Profile AnalasisPhD Thesis by Thierry Worch

The Ideal Profile AnalasisPhD Thesis by Thierry Worch

The Ideal Profile AnalasisPhD Thesis by Thierry Worch

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

THESE/AGROCAMPUS OUEST<br />

In Partnership with OP&P PRODUCT RESEARCH<br />

To obtain the diploma of:<br />

DOCTEUR DE L’INSTITUT SUPERIEUR DES SCIENCES AGRONOMIQUES, AGRO‐<br />

LIMENTAIRES, HORTICOLES ET DU PAYSAGE<br />

Specialization: Mathematic – Physics – Computer science<br />

Doctorial school: Vie‐Agro‐Santé<br />

Presented <strong>by</strong>:<br />

<strong>Thierry</strong> WORCH<br />

<strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong> Analysis: From the validation to the statistical analysis of<br />

<strong>Ideal</strong> <strong>Profile</strong> data.<br />

Defended July the 9 th in front of the commission<br />

Composition of the jury: Christopher FINDLAY President<br />

Compusense Inc.<br />

Marc DANZART<br />

Reviewer<br />

AgroParisTech, Massy<br />

Halliday MACFIE<br />

Reviewer<br />

Hal MacFie Sensory Training Ltd<br />

Jérôme PAGES<br />

Advisor<br />

Agrocampus Ouest, Rennes<br />

Sébastien LE<br />

Co‐advisor<br />

Agrocampus Ouest, Rennes<br />

Pieter PUNTER<br />

Co‐advisor<br />

OP&P Product Research, Utrecht<br />

i


1<br />

1 Illustration : Marion VIALADE<br />

iii


Table of Contents<br />

1. Introduction .................................................................................................................................. 11<br />

2. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong> Method in Practice. ........................................................................................... 19<br />

2.1. Presentation of the <strong>Ideal</strong> <strong>Profile</strong> Method ............................................................................. 21<br />

2.2. Complementary studies and justification of the point of views adopted ............................. 45<br />

2.2.1. Correction of the ideal data .......................................................................................... 47<br />

2.2.2. Justification of the correction ....................................................................................... 48<br />

2.2.2.1. Relationship between perceived and ideal ratings ............................................... 48<br />

2.2.2.2. Justification of the correction <strong>by</strong> translation ........................................................ 49<br />

2.2.2.3. Should the ideal ratings be also standardized? ..................................................... 53<br />

2.2.2.4. Conclusion ............................................................................................................. 56<br />

2.2.3. Extension of the uniqueness of the ideal ratings at the consumer level ...................... 57<br />

2.2.4. Extension of the typology of the consumers and attributes ......................................... 58<br />

2.3. Conclusion ............................................................................................................................. 63<br />

3. Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s .................................................................................................. 67<br />

3.1. Sensory Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s .............................................................................. 71<br />

3.1.1. Assessment of the consistency of the ideal profiles ..................................................... 73<br />

3.1.2. Extension to L‐PLS, presentation of the methodology .................................................. 89<br />

3.1.2.1. Algorithms ............................................................................................................. 90<br />

3.1.2.2. Adaptations to our study ....................................................................................... 92<br />

3.1.2.3. Results and discussion (perfume project) ............................................................. 93<br />

3.1.2.4. Conclusions concerning the L‐PLS procedure........................................................ 96<br />

3.1.3. Conclusions on the sensory consistency of the ideal data ............................................ 97<br />

3.1.3.1. At the panel level ................................................................................................... 97<br />

3.1.3.2. At the consumer level............................................................................................ 99<br />

3.2. Hedonic Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s ........................................................................... 101<br />

3.2.1. Extension of the consistency of the ideal data ............................................................ 103<br />

3.2.2. Complementary results on the simulations ................................................................ 113<br />

3.2.2.1. Comparison of and ............................................................. 113<br />

3.2.2.2. Error α in the selection of models ....................................................................... 118<br />

3.2.3. General conclusions on the hedonic consistency of the ideal data ............................ 121<br />

v


3.2.3.1. Quality of the individual models ......................................................................... 123<br />

3.2.3.2. Significance of the liking potential ...................................................................... 125<br />

3.2.3.3. (hedonic) consistency of the ideal profiles.......................................................... 126<br />

4. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong>s as a Tool for Optimization ............................................................................. 129<br />

4.1. Pre‐Treatment of the Data .................................................................................................. 131<br />

4.1.1. Clustering ..................................................................................................................... 133<br />

4.1.2. Single vs. multiple ideals ............................................................................................. 137<br />

4.2. <strong>The</strong> <strong>Ideal</strong> Product used as Reference .................................................................................. 149<br />

4.2.1. Presentation of the IdMap .......................................................................................... 151<br />

4.2.2. Complementary comparison between IdMap and PrefMapD .................................... 168<br />

4.2.2.1. Level of acceptance in the PrefMapD ................................................................. 168<br />

4.2.2.2. Stability of the PrefMapD .................................................................................... 172<br />

4.3. Optimization Procedure using <strong>Ideal</strong> <strong>Profile</strong>s ....................................................................... 175<br />

4.3.1. Review of the existing methodologies ........................................................................ 177<br />

4.3.2. Proposition of a Product Based Optimization ............................................................. 178<br />

5. General Conclusions: Validation of the IPA ............................................................................... 195<br />

5.1. Description of the study ...................................................................................................... 197<br />

5.1.1. <strong>The</strong> products ................................................................................................................ 197<br />

5.1.2. <strong>The</strong> consumers ............................................................................................................ 197<br />

5.1.3. Method ........................................................................................................................ 197<br />

5.1.4. Preliminary study of the sensory space of the creams ............................................... 198<br />

5.1.5. Preliminary study of the ideal product space.............................................................. 199<br />

5.2. Consistency of the ideal data (§3.)...................................................................................... 201<br />

5.2.1. Sensory consistency (§3.1) .......................................................................................... 201<br />

5.2.2. Hedonic consistency (§3.2).......................................................................................... 203<br />

5.3. Optimization of the tested products (§4.)........................................................................... 206<br />

5.3.1. Segmentation of the panel and uniqueness of the ideal (§4.1).................................. 206<br />

5.3.2. Determination of the sensory profile of the ideal product of reference (§4.2).......... 208<br />

5.3.3. Optimization of the products according to the ideal of reference (§4.3)................... 210<br />

5.4. Formulation of two new products ....................................................................................... 212<br />

5.4.1. New sensory task ......................................................................................................... 212<br />

5.4.2. Results: liking scores of the products .......................................................................... 213<br />

vi


6. References................................................................................................................................... 217<br />

7. Annexes ....................................................................................................................................... 223<br />

7.1. Experts vs. Consumers ......................................................................................................... 225<br />

7.2. Implementation in R ............................................................................................................ 239<br />

7.2.1. <strong>The</strong> R‐Project and SensoMineR ................................................................................... 241<br />

7.2.2. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong> Analysis in R ...................................................................................... 241<br />

7.2.2.1. Measuring the influence of the tested products on the ideal ratings ................ 241<br />

7.2.2.2. Checking for multiple ideals ................................................................................ 242<br />

7.2.2.3. Consistency of the ideal data .............................................................................. 242<br />

7.2.2.4. Use of the ideal data ........................................................................................... 242<br />

7.2.2.5. References ........................................................................................................... 243<br />

Acknowledgements ............................................................................................................................ 245<br />

vii


To all of you,<br />

who are making my life<br />

closer to <strong>Ideal</strong>.


1. Introduction


1. Introduction<br />

For the Food and Cosmetics industry, optimization and innovation are important steps in product<br />

development. This requires a good understanding of the products, both from a sensory point of view as well as<br />

from a hedonic point of view. In other words, we need to understand how the products are perceived and how<br />

the products are appreciated. Taken separately, this information is not sufficient for product improvement. But<br />

combined, it is: we can determine which sensory characteristics drive the hedonic judgments. This relationship<br />

is usually defined using statistical methods (Daillant‐Spinnler, MacFie, Beyts, & Hedderley, 1996). Once the<br />

relationship between sensory characteristics and the hedonics is set, the industry can focus on these sensory<br />

characteristics for product optimization (Moskowitz, 1995; Moskowitz, & Krieger, 1998).<br />

First we need to gather the sensory and hedonic descriptions of the products. Current practice consists of<br />

first asking subjects to describe the products according to a list of sensory attributes. This practice is known as<br />

“descriptive analysis” (such as QDA®, Stone, Sidel, Woosley, & Singleton, 1974; Spectrum TM , Meilgaard, Civille,<br />

& Carr, 2006) and results in “sensory profiles”. In descriptive analysis, subjects are asked to evaluate the<br />

presented products in a monadic sequence and to rate the perceived intensity for each of them according to<br />

the pre‐established list of sensory attributes. <strong>The</strong> products are presented one after the other according to a<br />

pre‐established experimental design which takes care of order and carry over effects (MacFie, Bratchell,<br />

Greenhoff, & Vallis, 1989). In general, the subjects who participate in these tests are either specialists who<br />

know the family of products tested well, and hence are qualified as “experts” (e.g. oenologist tasting wine), or<br />

people who are trained accordingly in order (1) to understand the sensory attributes used, (2) to detect the<br />

differences between the products (discrimination of the products) and (3) to rate them adequately (consensus<br />

between subjects) and repeatably (repeatability of the ratings) on the scale of notation used.<br />

In parallel to the descriptive analysis to obtain the sensory profiles of the products, another test is<br />

performed. During this test, subjects are asked to rate the same products on overall liking. In order to have<br />

successful products, they must satisfy consumers. Hence, we need the judgments of the consumers about their<br />

liking or acceptance of the products (i.e. consumers’ hedonic judgments).<br />

After collecting the sensory and hedonic descriptions of the products they are linked in order to define<br />

which sensory characteristics drive the hedonic judgments (Rivière, Monrozier, Rogeaux, Pagès, & Saporta,<br />

2006). For this, we often use the preference mapping techniques (Carroll, 1972; Greenhoff, & MacFie, 1995;<br />

Jaeger, Wakeling, & MacFie, 2000; Danzart, 2009a). In practice, two types of preference mapping techniques<br />

exist: internal preference mapping (MDPref, Carroll, 1972) and external preference mapping (PrefMap, Carroll,<br />

1972). A comparison of these two techniques is done <strong>by</strong> van Kleef, van Trijp, and Luning (2006).<br />

Internal preference mapping starts with the hedonic ratings provided <strong>by</strong> the consumers, the sensory<br />

profiles of the products being projected as supplementary variables in the hedonic space based on the linear<br />

relationships between the hedonic data and the sensory attributes. External preference mapping starts with<br />

the sensory description of the products. In this case, the hedonic scores provided <strong>by</strong> the consumers are<br />

regressed in the sensory dimensions of product space on the sensory of the products. A common limitation in<br />

sensory perception is related to the saturation of the sensory attributes. Indeed, the products which are not<br />

sweet enough or on the other hand which are too sweet will not be fully appreciated. Hence, it is important to<br />

consider this saturation effect within the individual models in order to define the optimal intensity of the<br />

sensory attributes. To do so, quadratic effects as well as the interaction between the two first dimensions of<br />

the sensory space are added to the linear effects (Danzart, 1998) within the individual models in the external<br />

preference mapping. <strong>The</strong> individual models thus created are then applied to each point of the sensory space,<br />

which allows defining a zone of acceptance for each consumer. <strong>The</strong>se individual zones of acceptances are<br />

13


1. Introduction<br />

combined in order to define a global surface plot at the panel level. From this global surface plot we can define<br />

the zone of the space in which the associated product would be accepted <strong>by</strong> a maximum of consumers (Mao, &<br />

Danzart, 2008). <strong>The</strong> characteristics of this “ideal” product can then be defined and used as reference for the<br />

optimization of the existing products, or for the formulation of a new potentially successful product (Danzart,<br />

2009b; Moskowitz & Krieger, 1998; van Trijp, Punter, Mickartz, & Kruithof, 2007).<br />

In order to get closer to the market, more importance should be given to the consumer. In this case, we<br />

would prefer to use the sensory descriptions of the products obtained from consumers over the sensory<br />

descriptions of the products obtained from experts or trained panelists. Thus, we would ask to the same<br />

consumer to perform both tasks simultaneously, which results in sensory profiles and the hedonic judgments.<br />

This procedure has the advantage that we can link the appreciation to the sensory perception of the products<br />

directly for each consumer. This link hence seems more direct.<br />

<strong>The</strong> "intensive" use of consumers for sensory tests is not accepted <strong>by</strong> everybody in the sensory<br />

community. In the literature, numerous critics concerning the use of consumers for tests other then hedonic<br />

have been formulated: (1) "…as with any untrained panel, beyond the overall acceptance judgment there is no<br />

assurance that the responses are reliable or valid“ (Stone, & Sidel, 1993) and (2) “…consumers can only tell you<br />

what they like or dislike” (Lawless, & Heymann, 1999). According to these authors, the use of consumers for<br />

sensory descriptive tasks is not appropriate as consumers lack two major qualities: consensus and repeatability<br />

to which we should add the uncertainty of the good comprehension of the meaning of the sensory attributes.<br />

Moreover, Earthy, MacFie, and Hedderley (1997) showed that associating sensory questions with hedonic<br />

questions can have an inconvenient halo effect. Although this effect is not always verified in practice (Popper,<br />

Rosenstock, Schaidt, & Kroll, 2004), the long and thoughtful perception of the products can affect the hedonic<br />

judgment of the consumers. This seems to be the price to pay if we wish to obtain sensory profiles from<br />

consumers.<br />

Other authors are more optimistic concerning the use of consumers to obtain sensory profiles. Moskowitz<br />

(1996) and Husson, Le Dien, and Pagès (2001) have shown through different studies that consumers can<br />

describe the sensory characteristics of the products with a precision comparable to the one obtained from<br />

experts. In that case, the larger size of the consumer panel counterbalances the lack of training. On the other<br />

hand, the use of consumers puts a restriction on the choice of sensory attributes used in the test. With<br />

consumers, only “simple” sensory attributes can be used, we cannot use technical or chemical terms.<br />

Since the use of consumers for descriptive tasks is highly important for the rest of this study, we had to<br />

check the capacity of the consumers to provide valid sensory profiles of products. For that matter, we decided<br />

to compare sensory profiles obtained from consumers with profiles obtained from experts for the same<br />

products. This study is at the origin of the paper entitled “How reliable are the consumers? Comparison of<br />

sensory profiles from consumers and experts” from <strong>Worch</strong> et al. presented in Annex (§7.1). In this example, we<br />

have shown that the capacity of consumers in describing the sensory aspect of the products has the same<br />

quality of discrimination and repeatability as that of experts.<br />

Although the sensory and hedonic descriptions are obtained from the same consumers, we still need to<br />

link them together. However, it can happen in some cases that the sensory descriptions and the hedonic<br />

judgments are “independent”. This would correspond to the situation where the major sensory differences<br />

which are detected do not influence the appreciation of the products for those consumers. In this case, the<br />

user will not be able to find links between the hedonic and the sensory descriptions of the products (Faber,<br />

14


1. Introduction<br />

Mojet, & Poelman, 2003). This is the reason why integrating a reference to the hedonic within the description<br />

of the products attribute <strong>by</strong> attribute has been considered. Such a task needs the use of consumers.<br />

A first way of doing so consists in asking consumers to describe the perceived intensity of the products in<br />

function of the representation they have of their ideal (Moskowitz, 1972; Shepherd, Smith, & Farleigh, 1989). In<br />

this case, the consumers mention whether the product is too much, just about right or too little for each of the<br />

attributes considered. <strong>The</strong> scale of notation thus used is known as JAR scale (Meullenet, Xiong, & Findlay, 2007;<br />

Rothman, & Parker, 2009). In this case, the difference between the perceived intensity and the ideal intensity is<br />

measured. However, the notion of “just about right” can be confusing. Indeed, for the consumers, does the jar<br />

level refer to the acceptance of the product or to a preference (Gacula, Rutenbeck, Pollack, Resurreccion, &<br />

Moskowitz, 2007)?<br />

In the same purpose of integrating a reference to the hedonic in the description of the products attribute<br />

<strong>by</strong> attribute, a second method consists in asking the consumers directly to describe their ideals, thus gathering<br />

the hedonic and descriptive aspects of the products simultaneously (Moskowitz, 1972; Szcezsniak, Loew, &<br />

Skinner, 1975). In practice, during such test, the consumers are asked to rate both the perceived and ideal<br />

intensity of the products on a list of predefined attributes. In this case, the consumers are asked to rate their<br />

ideal product on the same attributes and the same scale of notation as the tested products.<br />

This technique, known as the <strong>Ideal</strong> <strong>Profile</strong> Method (IPM), is used <strong>by</strong> several professionals in industry.<br />

Nevertheless, only few articles in the literature concerning the analysis of this particular data can be found.<br />

Moreover, those articles only describe the testing protocol used and the final analysis of the data gathered.<br />

From a practical point of view, these studies show that the use of ideal data brings useful information for the<br />

optimization of products (Hoggan, 1975; Moskowitz, Stanley, & Chandler, 1977; Cooper, Earle, & Triggs, 1989).<br />

However, the methodology of the IPM can be questioned. Indeed, the ideal profiles are fragile data since they<br />

are provided <strong>by</strong> consumers who are describing fictive (ideal) products. So, which value can be granted to these<br />

data? To which extent can the use of ideal profiles guide product optimization?<br />

In order to answer these questions, we will have to get deeper insight in this data and thus try to better<br />

understand how they are obtained.<br />

This PhD document is first describing the <strong>Ideal</strong> <strong>Profile</strong> Method as it is used at OP&P Product Research. In<br />

this case, the methodology consists in asking the consumers to describe their ideal for each product tested,<br />

providing variability of ideal data between and within consumers. By studying the variability within consumers<br />

we gain better insight in these data and can we study the impact of the tested product on the ideal.<br />

Additionally, the study of the variability between consumers helps evaluating the degree of homogeneity at the<br />

panel level.<br />

In a second step, the value that can be granted to the ideal data is evaluated. To do so, a methodology to<br />

measure the consistency of the ideal profiles has been set up. This methodology evaluates the link existing<br />

between the sensory, hedonic and ideal descriptions <strong>by</strong> checking on the one hand whether the consumers<br />

describe their ideal with similar sensory characteristics as the most appreciated product and on the other hand<br />

whether the ideal product they defined is associated with a higher liking score than the tested products.<br />

Once the consistency of the ideal data (as mentioned above) is checked, these data can be used to guide<br />

on improvement. To do so, the principle of the external preference mapping technique adapted to our ideal<br />

data is used. Hence, we have been adapting the treatment of the consumer data <strong>by</strong> integrating the variability<br />

between and within consumers of the ideal data. This new procedure of optimization implies (1) the definition<br />

of groups of consumers and homogeneous subcategories of products, (2) the choice of a consensual ideal<br />

products used as reference to match in the optimization process (IdMap) and finally (3) the development of<br />

15


1. Introduction<br />

methodologies allowing the optimization of products based on the consensual ideal product defined previously<br />

while taking into consideration the link between the perception of an attribute and the appreciation of the<br />

products. To do so, the difference between the perceived and ideal intensity of each attribute is weighted<br />

according to whether the attribute is a strong driver of liking or not.<br />

<strong>The</strong> entire methodology developed through this PhD allows the complete analysis of the ideal data (from<br />

checking for the consistency to the optimization of the products) and is referenced here as the <strong>Ideal</strong> <strong>Profile</strong><br />

Analysis (IPA).<br />

<strong>The</strong> different parts of this thesis are articulated through one or many articles submitted or published in<br />

Food Quality and Preference, to which are added “complement to the articles” presenting extensions or<br />

justifications of the choices made for the methodology proposed.<br />

Since <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong> Method has been applied for many years at OP&P Product Research, Utrecht, the<br />

Netherlands, I had access to a large database. <strong>The</strong> methodologies developed in my PhD have been applied<br />

systematically to a selection of 24 projects involving all types of food products (dairy products, candy bars,<br />

soups, water, etc.). <strong>The</strong> choice of the projects has been based on the number of products involved (minimum<br />

of 7 products) and of the experimental design used (only full designs). From these meta‐analyses were<br />

extracted general tendencies related to the ideal descriptions. A list of the projects including the number of<br />

products and consumers involved in the tests is presented Table 1.1.<br />

project<br />

#<br />

products<br />

#<br />

consumers<br />

#<br />

attributes<br />

project<br />

#<br />

products<br />

#<br />

consumers<br />

#<br />

attributes<br />

Applesauce 8 180 23 Cream yoghurt 2 10 128 23<br />

Beer 8 84 32 Ice cream 12 84 35<br />

Croissants 9 151 26 Soup 1 9 109 25<br />

Donuts 1 8 126 36 Soup 2 9 104 28<br />

Donuts 2 8 167 28 Flavoured water 10 83 21<br />

Licorice 9 80 22 Lemon water 9 100 23<br />

Coffee 8 77 16 Candy bar 7 81 30<br />

Meal salad 10 82 29 Vanilla dessert 8 76 30<br />

Water 8 163 18 Milk drink 7 88 38<br />

Perfume 14 103 21 Yoghurt 1 8 84 27<br />

Rye bread 8 157 38 Yoghurt 2 9 117 29<br />

Cream yoghurt 1 7 128 29 Organic yoghurt 8 127 34<br />

Table 1.1: List of the 24 datasets considered for the meta‐analysis.<br />

16


1. Introduction<br />

Work accomplished<br />

Articles<br />

Articles accepted<br />

<strong>Worch</strong>, T., Lê, S., Punter, P., & Pagès, J. (2013). <strong>Ideal</strong> <strong>Profile</strong> Method (IPM): the ins and outs. Food Quality and<br />

Preference. In press (http://dx.doi.org/10.1016/j.foodqual.2012.08.001)<br />

<strong>Worch</strong>, T., Lê, S., Punter, P., & Pagès, J. (2012). Construction of an <strong>Ideal</strong> Map (IdMap) based on the ideal<br />

profiles obtained directly from consumers. Food Quality and Preference, 26, 93‐104.<br />

<strong>Worch</strong>, T., Lê, S., Punter, P., & Pagès, J. (2012). Extension of the consistency of the data obtained with the <strong>Ideal</strong><br />

<strong>Profile</strong> Method: Would the ideal products be more liked than the tested products? Food Quality and<br />

Preference, 26, 74‐80.<br />

<strong>Worch</strong>, T., Lê, S., Punter, P., & Pagès, J. (2012). Assessment of the consistency of ideal profiles according to<br />

non‐ideal data for IPM. Food Quality and Preference, 24, 99‐110.<br />

<strong>Worch</strong>, T., Dooley, L., Meullenet, J.F., & Punter, P. (2010). Comparison of PLS dummy variables and Fishbone<br />

method to determine optimal product characteristics from ideal profiles. Food Quality and Preference, 21,<br />

1077‐1087.<br />

<strong>Worch</strong>, T., Lê, S., & Punter, P. (2010). How reliable are the consumers? Comparison of sensory profiles from<br />

consumers and experts. Food Quality and Preference, 21, 309‐318.<br />

Jaeger, S.R., Bava, C.M., <strong>Worch</strong>, T., Dawson, J., & Marshall, D.D. (2011). <strong>The</strong> food choice kaleidoscope. A<br />

framework for structured description of product, place and person as sources of variation in food choices.<br />

Appetite, 56, 412‐423.<br />

Articles submitted<br />

<strong>Worch</strong>, T., & Ennis, J.M. Investigating the single ideal assumption using <strong>Ideal</strong> <strong>Profile</strong> Method. Submitted to Food<br />

Quality and Preference.<br />

Oral presentation (the name of the speaker is underlined)<br />

<strong>Worch</strong>, T., Lê, S., Punter, P., & Pagès, J. Validation of the ideal profiles provided directly from consumers. 12 th<br />

Agrostat Meeting, Paris, France.<br />

<strong>Worch</strong>, T. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong> Method. As part of the workshop: Current status and future directions for<br />

alternative descriptive sensory methods workshop. 9 th Pangborn Meeting, Toronto, Canada.<br />

<strong>Worch</strong>, T., Lê, S., & Pagès, J. Validation of the ideal data using Multivariate Analysis: the ideal products? Space<br />

as a link between the products and their preferences. 50 th anniversary of CARME, Rennes, France.<br />

<strong>Worch</strong>, T., Lê, S., Punter, P., & Pagès, J. Can the consumers express their needs? Use of <strong>Ideal</strong> <strong>Profile</strong>s to<br />

understand and validate what is in the consumers’ mind. 2 nd Meeting of the Society of Sensory<br />

Professional, Napa, USA.<br />

<strong>Worch</strong>, T., Lê, S., Punter, P., & Pagès, J. What is in the consumer’s mind? Understanding and (external)<br />

validation of <strong>Ideal</strong> <strong>Profile</strong> data. 4 th EuroSense conference, Vitoria‐Gasteiz, Spain.<br />

<strong>Worch</strong>, T., Lê, S., Punter, P., & Pagès, J. Can we trust consumers’ ideal? Study of the relationship between the<br />

consumers’ preference and their ideals. 10 th Sensometrics meeting, Rotterdam, the Netherlands.<br />

17


1. Introduction<br />

Punter, P., & <strong>Worch</strong>, T. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong> Method: combining classical profiling with JAR methodology. 1st SPISE<br />

meeting, HoChiMinh‐City, Vietnam.<br />

Dooley, L., <strong>Worch</strong>, T., Meullenet, J.F., & Punter, P. Comparison of PLS and the Fishbone method to determine<br />

optimal product characteristics. 8 th Pangborn Meeting, Firenze, Italy.<br />

<strong>Worch</strong>, T., Lê, S., & Punter, P. How reliable are the consumers? Comparison of sensory profiles from consumers<br />

and experts. 9 th Sensometrics meeting, St Catherines, Canada.<br />

<strong>Worch</strong>, T., & Delcher, R. Evaluation of the panel and panelists performances in R. As part as the workshop on<br />

Panel Performance, 9 th Sensometrics meeting, St Catherines, Canada.<br />

Posters<br />

<strong>Worch</strong>, T., Lê, S., Punter, P., & Pagès, J. Analyses of ideal data obtained <strong>by</strong> <strong>Ideal</strong> <strong>Profile</strong> Method to better<br />

understand consumers and their needs. 9 th Pangborn Meeting, Toronto, Canada.<br />

<strong>Worch</strong>, T., & Punter, P. Evaluation of the stability of the PCA products’ map in function of the data taken in<br />

consideration. 10 th Agrostat Meeting, Louvain‐la‐Neuve, Belgium.<br />

18


2. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong> Method<br />

in Practice.


2.1. Presentation of the<br />

<strong>Ideal</strong> <strong>Profile</strong> Method


2. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong> Method in Practice<br />

In this section, the presentation of the <strong>Ideal</strong> <strong>Profile</strong> Method as well as a methodology developed for<br />

understanding how consumers define their ideal is presented. This is done through the paper from <strong>Worch</strong>, Lê,<br />

Punter, and Pagès (2013) entitled “<strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong> Method (IPM): the ins and outs” published in Food Quality<br />

and Preference, and completed with justifications of the correction and studies extending the analysis of the<br />

variability between and within consumers of the ideal data. In this paper, the notations used for the rest of the<br />

documents are presented.<br />

As a reminder, the analyses developed along this document were applied to dataset from 24 different case<br />

studies. More information concerning these studies is given in Table 1.1, page 16.<br />

Journal:<br />

Title:<br />

Food Quality and Preference<br />

<strong>Ideal</strong> <strong>Profile</strong> Method (IPM): the ins and outs.<br />

Authors: <strong>Worch</strong>, T., Lê, S., Punter, P., & Pagès, J.<br />

Abstract:<br />

Keywords:<br />

Reference:<br />

<strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong> Method is a sensory methodology mixing classical profiling (such as<br />

QDA®) and JAR scale. It is performed <strong>by</strong> consumers who are asked to rate each product on<br />

both their perceived and ideal intensities for a list of attributes. In the same test, consumers<br />

also rate the products on liking.<br />

<strong>The</strong> strength of such methodology is that it brings a lot of information about the products<br />

and the consumers. Indeed each consumer provides the sensory profile of the products (i.e.<br />

how do they perceive the products), their liking ratings (i.e. how do they appreciate the<br />

products) as well as their ideal profiles (i.e. what are their expectations).<br />

<strong>The</strong> ideal profiles are directly actionable to guide for products’ improvement. However,<br />

this particular information should be carefully managed since it is obtained from consumers<br />

and it describes virtual products. It relies on three main assumptions: (1) consumers should<br />

rate a unique and stable ideal product, (2) consumers can describe different ideals and (3) the<br />

ideal profiles provided <strong>by</strong> consumers should be consistent with the other descriptions (sensory<br />

and hedonic).<br />

<strong>The</strong> study of these assumptions on 24 projects help understanding the consumers and<br />

how they define their ideals. It comes out that, although some consumers’ ideal ratings are<br />

slightly influenced positively <strong>by</strong> the products, most of the consumers are reliable. Indeed, the<br />

consumers rate unique ideal products which are consistent according to the sensory and<br />

hedonic descriptions also provided. It also appears that it needs all to make a world, as<br />

consumers show differences in their ideal products.<br />

Consumer, ideal profiles, multiple ideals, descriptive analysis.<br />

<strong>Worch</strong>, T., Lê, S., Punter, P., & Pagès, J. (2013). <strong>Ideal</strong> <strong>Profile</strong> Method (IPM): the ins and outs.<br />

Food Quality and Preference, http://dx.doi.org/10.1016/j.foodqual.2012.08.001<br />

23


2.1. Presentation of the <strong>Ideal</strong> <strong>Profile</strong> Method<br />

1. Introduction<br />

In sensory analysis, one of the main objectives is to characterize a set of products according to the way they are<br />

perceived. To do so, a common practice consists in asking subjects to rate the products on the perceived intensities of a list<br />

of attributes. This practice, also known as descriptive analysis (such as QDA®, Stone, Sidel, Oliver, Woolse, & Singleton,<br />

1974), results in the definition of the sensory profile of the products, that is to say, a description of how these products are<br />

perceived <strong>by</strong> the subjects. In fine, the objective of such methodology is to obtain a product space, which is a map<br />

positioning the products that are perceived as similar close to each other, and placing apart those that are perceived as<br />

different. For this task, the subjects considered are usually experts or trained panelists (i.e. subjects who have training<br />

sessions during which they have learned to recognize and rate the perceived intensities of the pre‐established list of<br />

attributes).<br />

Although this methodology is extensively used, some alternative methods have been developed. <strong>The</strong>se methods differ<br />

according to the points of view adopted. Subjects can:<br />

• be free in the choice of attributes used to describe the products in a sequential monadic way, as for example<br />

in Free Choice Profiling (Williams, & Langrons, 1984) or Flash Profiling (Sieffermann, 2002; Dairou, &<br />

Sieffermann, 2002);<br />

• assess the entire product set simultaneously, as for example in Napping® (Pagès, 2005) or Ultra Flash <strong>Profile</strong><br />

(Perrin, Symoneaux, Master, Asselin, Jourjon, & Pagès, 2008);<br />

• use holistic approaches to compare the products as in the case of Free Sorting Task (Lawless, 1989; Cadoret,<br />

Lê, & Pagès, 2009), Hierarchical Sorting Task (Cadoret, Lê, & Pagès, 2011) or Sorted Napping (Pagès, Cadoret,<br />

& Lê, 2010).<br />

All these methodologies are defined as rapid methodologies because no or short training is required (Dehlholm,<br />

Brockhoff, Meinert, Aaslyng, & Bredie, 2012). <strong>The</strong> different alternatives highlight different approaches, for example:<br />

detailed vs. short description of the products, analytic vs. holistic approaches, use of trained panelists/experts vs. naïve<br />

consumers (Gazano, Ballay, Eladan, & Sieffermann, 2005; Nestrud, & Lawless, 2008).<br />

Due to the fact that consumers are being more and more involved in the product development process, their points of<br />

view are currently often required. Moskowitz (1996), Husson, Le Dien, and Pagès (2001) and more recently <strong>Worch</strong>, Lê, and<br />

Punter (2010) showed in different studies that consumers can profile products while meeting the requirements of<br />

discrimination, consensus and reproducibility of a sensory panel. This is particularly true when the attributes which are<br />

evaluated are not complex and understandable <strong>by</strong> naïve consumers.<br />

It has also been shown that subjects can use an internal imagined product as reference to compare products (Booth,<br />

Conner, & Marie, 1987). Such comparison is done when using tasks involving Just About Right (JAR) scales, in which<br />

consumers are asked to rate the intensity of the products on each attribute <strong>by</strong> indicating whether the intensity of that<br />

attribute is just about right, too strong, or too weak. <strong>The</strong> idea behind this is that if consumers can rate the perceived<br />

intensities of the products in function of an imagined ideal that works as a reference, one can also expect them to be able<br />

to rate their ideal explicitly.<br />

Moskowitz (1972) worked on this idea and proposed to extend the classical sensory evaluation <strong>by</strong> integrating the<br />

opinion of the subjects who test the food in the optimization process. To do so, he proposed to give the subjects the<br />

opportunity to suggest the degree on a scale to which they would alter products for the given attribute set so that the<br />

products would be closer to the representation of their ideals. Depending on the study, the subject was either asked to rate<br />

the ideal directly (IPM type of measurement), or to rate the perceived intensity relatively to this ideal (JAR type of<br />

measurement). Some years later, Szczesniak, Loew, and Skinner (1975) proposed a derivative of the texture profile<br />

technique (Brandt, Skinner, & Coleman, 1963) using consumers. In their study, apart from providing descriptions of the<br />

texture of the products, the consumers were also requested to rate the ideal intensity on the specific texture attributes.<br />

Hoggan (1975) applied a similar technique for optimizing beers, <strong>by</strong> including taste attributes as well. In these two studies,<br />

the ideal intensity was rated only once <strong>by</strong> each consumer.<br />

<strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong> Method (IPM), which is presented in this paper, is a variant of these methodologies. After presenting<br />

in detail the protocol as used routinely at OP&P Product Research (Utrecht, <strong>The</strong> Netherlands), guidelines for a better<br />

understanding of how consumers define and rate their ideals towards a product are given.<br />

2. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong> Method, in practice<br />

<strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong> Method (IPM) is a descriptive analysis performed <strong>by</strong> consumers where additional questions about the<br />

ideal intensities and liking are asked. In practice, each consumer assesses a series of products, and rates each product on<br />

the same set of sensory attributes. <strong>The</strong> products are presented in randomized monadic sequence in order to avoid firstorder<br />

and carry‐over effects (MacFie, Bratchell, Greenhoff, & Vallis, 1989). For each attribute, both the perceived and ideal<br />

intensities are rated on the same type of scale (here, an unstructured scale with unique unlabeled anchors at 10% and 90%<br />

is used). So, if the first question is: "Please rate the sweetness of this product", the second question will be: "Please rate<br />

your ideal sweetness for this product". This methodology has been adopted with the aim to mimic the JAR scale, but using<br />

the perceived and ideal intensities instead of the difference with an imagined ideal.<br />

24


2. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong> Method in Practice<br />

At the end of the task, each consumer has rated as many times the profile of his/her "ideal product" (also called ideal<br />

profile) as he/she has tested products using the same set of attributes. Thus, if a consumer rates the profiles of P products,<br />

he/she also rates P times his/her ideal profile. As mentioned earlier, also hedonic questions are asked for each product<br />

using a 9‐point category scale, after the sensory and ideal ratings. So summarizing, at the end of the test, each consumer<br />

has provided information about his/her sensory and hedonic appraisal of the products as well as the description of his/her<br />

ideal product (Figure 1).<br />

Figure 1: Data provided <strong>by</strong> each consumer during the IPM.<br />

Unlike experts or trained panelists, consumers do not take part in any prior training. For this reason, the size of the<br />

panel must be larger: in practice the authors use a panel size of around 100 consumers, which is considered to be a reliable<br />

number of participants in this kind of tasks (Moskowitz, 1997).<br />

Another option of this methodology would be to ask the consumers to rate their ideal profiles only once. In this latter<br />

case, each consumer would rate P+1 profiles vs. 2*P as in the methodology described above. Since Szczesniak et al. (1975)<br />

concluded that it makes little difference in the results whether the ideal product is described before or after tasting the set<br />

of samples, the ideal intensities could be rated either at the end of test, after the consumers have tasted and rated all the<br />

products, or at the beginning, before consumers have even started tasting the products. As this perspective has not been<br />

tested <strong>by</strong> the authors yet, no comparative information concerning the outcomes can be given.<br />

3. Material and method<br />

3.1. Material<br />

To illustrate the statistical methodology for a better understanding of the ideal profiles provided <strong>by</strong> consumers, 24<br />

datasets obtained with the IPM are used. A summary of the 24 datasets is given in Table 2.<br />

project # of products # of consumers project # of products # of consumers<br />

Applesauce 8 180 Cream yoghurt 2 10 128<br />

Beer 8 84 Ice cream 12 84<br />

Croissant 9 151 Soup 1 9 109<br />

Donuts 1 8 126 Soup 2 9 104<br />

Donuts 2 8 167 Flavoured water 10 83<br />

Licorice 9 80 Lemon water 9 100<br />

Coffee 8 77 Candy bar 7 81<br />

Meal salad 10 82 Vanilla dessert 8 76<br />

Water 8 163 Milk drink 7 88<br />

Perfume 14 103 Yoghurt 1 8 84<br />

Rye bread 8 157 Yoghurt 2 9 117<br />

Cream yoghurt 1 7 128 Organic yoghurt 8 127<br />

Table 2: List of the dataset considered.<br />

As all the datasets were obtained in a similar way, only one of them (the perfume dataset, <strong>Worch</strong> et al., 2010) will be<br />

described in detail here. It concerned 12 luxurious women perfumes (Table 3) rated on 21 attributes (listed in Table 3) <strong>by</strong><br />

103 Dutch consumers in two 1‐hour sessions.<br />

25


2.1. Presentation of the <strong>Ideal</strong> <strong>Profile</strong> Method<br />

Products Type Attributes<br />

Angel Eau de Parfum Intensity Spicy<br />

Cinema Eau de Parfum Freshness Woody<br />

Pleasures Eau de Parfum Jasmine Leather<br />

Aromatics Elixir Eau de Parfum Rose Nutty<br />

Lolita Lempicka Eau de Parfum Chamomile Musk<br />

Chanel N⁰5 Eau de Parfum Fresh lemon Animal<br />

L’Instant Eau de Parfum Vanilla Earthy<br />

J’Adore (EP) Eau de Parfum Citrus Incense<br />

J’Adore (ET) Eau de Toilette Anis Green<br />

Pure Poison Eau de Parfum Sweet fruit<br />

Shalimar Eau de Toilette Honey<br />

Coco Mademoiselle Eau de Parfum Caramel<br />

Table 3: List of products and attributes.<br />

Note: during the test, the products Pure Poison and Shalimar were duplicated.<br />

Further in the document, particular results from two other studies are presented. <strong>The</strong>se results are obtained from (1) a<br />

case study on croissants involving 151 consumers who rated 9 products on both perceived and ideal intensity for 26<br />

attributes, and (2) a yoghurt study (cream yoghurt 1) involving 128 Dutch consumers who rated 7 products on 29 attributes.<br />

In both cases, the products were also rated on overall liking.<br />

3.2. Notation<br />

Let P denote the number of products tested, A the number of attributes used to describe the products and J the<br />

number of consumers who participated in the test. <strong>The</strong> following notation will be used to describe the data obtained from<br />

IPM (vectors are in bold):<br />

: intensity perceived <strong>by</strong> the consumer j for the product p and the attribute a;<br />

. ; 1: : vector of intensities perceived <strong>by</strong> the consumer j for the P products and the attribute a;<br />

. : average over the index p; average intensity perceived <strong>by</strong> the consumer j on attribute a over the P products (Table<br />

1a);<br />

.<br />

Consumer j Attribute 1 … Attribute a … Attribute A<br />

Product 1<br />

…<br />

Product p <br />

…<br />

Product P<br />

.<br />

Table 1a: Organization and notation of the sensory data provided <strong>by</strong> each consumer.<br />

: ideal intensity of the attribute a provided <strong>by</strong> the consumer j after testing the product p;<br />

. ; 1: : vector of ideal intensities of the attribute a provided <strong>by</strong> the consumer j for the P products;<br />

.: average over the index p; average ideal intensity of the attribute a provided <strong>by</strong> the consumer j over the P products<br />

(Table 1b);<br />

.<br />

Consumer j Attribute 1 … Attribute a … Attribute A<br />

Product 1<br />

…<br />

Product p <br />

…<br />

Product P<br />

.<br />

Table 1b: Organization and notation of the ideal data provided <strong>by</strong> each consumer.<br />

26


2. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong> Method in Practice<br />

: hedonic judgment provided <strong>by</strong> the consumer j for the product p;<br />

. ; 1: : vector of hedonic judgments provided <strong>by</strong> the consumer j for the P products.<br />

As mentioned in the previous section, in the studies performed, consumers rated as many times their ideal profile as<br />

they test products. If the set of samples preferably belong to the same category and type, normally people would rate their<br />

ideal attributes of the products tested in a consistent way (all of them being very similar, if not the same. Each consumer<br />

will be assigned a unique ideal profile which corresponds to the averaged ideal rating he/she gave for each attribute. This<br />

averaged ideal profile is denoted .. .; 1: and is defined <strong>by</strong> (Eq.1):<br />

. ∑<br />

.. . ; 1:<br />

<br />

(1)<br />

<br />

Since consumers do not use the scale in the same way, it is important to correct their averaged ideal profiles before<br />

comparing them. <strong>The</strong> correction for the use of the scale is done <strong>by</strong> translating the consumers’ averaged ideal profile<br />

according to the averaged perceived intensities they also provided. It is done <strong>by</strong> subtracting the averaged perceived<br />

intensities over the P products for each consumer and each attribute from his averaged ideal profile (Eq.2). This ideal profile<br />

corrected is noted .. .<br />

̃. . . (2)<br />

.. ̃. ; 1:<br />

Additional explanations concerning this correction are given in the Appendix.<br />

3.3. Method<br />

<strong>The</strong> aim of gathering ideal information from consumers is to optimize products. Since companies cannot create an<br />

optimized product for each single consumer, a solution that would satisfy a maximum number of consumers should be<br />

considered. For that matter, most of the optimization procedures found in the literature (Szczesniak et al., 1975; Hoggan,<br />

1975; Cooper, Earle, & Triggs, 1989) use the averaged ideal product for the entire panel of consumers as a reference to<br />

match. Although this averaged ideal product is not the optimal product for all the consumers (in practice, it is often<br />

observed that a small proportion of consumers appreciate more the least liked products of the majority), it has been shown<br />

it would be a satisfying solution (Hoggan, 1975).<br />

Still, one can be interested in the differences between consumers in their ideal profiles. For such analysis, considering<br />

the averaged ideal profile for each consumer is often required. Since consumers rate their ideal for each product tested,<br />

one should check first whether the consumers rate repeatedly a unique ideal or if the ideals for each tested products are<br />

different. This could be the case for products which are very different from a sensory point of view.<br />

Two questions arise: At the panel level, do all the consumers share a common ideal product, or do consumers differ in<br />

their definition of the ideal product? At the consumer level, do consumers have (and rate) a single ideal, or do they rate<br />

multiple ideals?<br />

To answer these questions, the variability of the ideal ratings is studied. This variability will be analyzed in three<br />

different ways:<br />

• the variability of the ideal ratings according to the tested products;<br />

• the variability of the ideal ratings within consumers;<br />

• the variability of the ideal ratings between consumers.<br />

<strong>The</strong> study of the variability of the ideal ratings at these different levels helps concluding whether the consumers<br />

describe one or multiple ideals. It can be check both at the panel (based on all attributes or for each attribute separately)<br />

and consumer level.<br />

3.3.1. Do consumers rate one or multiple ideals?<br />

In practice, it is common to test products with similar sensory characteristics and similar usage. In this case, one would<br />

say that the products tested should belong to the same “category” (e.g. soda drinks, cookies, dairy products, etc.).<br />

However, depending on the purpose of the test, the products tested can vary slightly (e.g., natural crisps from different<br />

brands, which, it could be said, belong to the same subcategory of product) or largely (e.g., using coke drinks, orange soda<br />

drinks, or iced teas, in a soda test, which would belong to different subcategories).<br />

<strong>The</strong> optimization procedure often assumes that consumers would associate the products tested to one unique ideal<br />

product. This assumption seems fair for products with very similar sensory characteristics; However, it shows limits when<br />

products are more different (the sensory characteristics of an ideal orange soda drink do not necessarily match the sensory<br />

characteristics of the ideal coke drink for a same consumer). In the latter case, it could happen that consumers have<br />

multiple ideals, one for each subgroup (or subcategory) of products. <strong>The</strong> different subcategories of products can be defined<br />

according to different sensory characteristics, which can either be due to the recipes solely (e.g., coke vs. orange flavored<br />

27


2.1. Presentation of the <strong>Ideal</strong> <strong>Profile</strong> Method<br />

types of soda), or to the context of usage too (e.g., perfume for the day or for the night). In that case, it is important to<br />

optimize each product according the ideal product of its corresponding subcategory.<br />

In practice, defining subcategories of products is very subjective. Some consumers might consider a group of products<br />

as from the same subcategory (and hence will associate them to one unique ideal) while some others would not (and hence<br />

will provide multiple ideals). By considering that each subcategory of product is associated to one unique ideal, we will<br />

propose a methodology (single vs. multiple ideal) which allows checking for subcategories of products within the product<br />

set tested using the ideal information provided <strong>by</strong> the consumers. Since we are not interested in differences within<br />

consumers here, the procedure proposed is performed at the panel level.<br />

3.3.1.1. Panel level:<br />

Since the optimization procedure is performed at the panel level, one should look for global patterns in the ideal<br />

ratings, to see whether or not the panel (as a whole) is influenced <strong>by</strong> the tested products. In the case the panel rates one<br />

unique ideal product, the averaged ideal product can be used to optimize all the products. In the contrary, if the panel rates<br />

multiple ideals, the optimization of the different subsets of products should be done according to the adequate ideal<br />

product.<br />

To check for these patterns, an averaged ideal product is calculated over the consumers based on the product in<br />

question: P tested products yield P averaged ideal products. <strong>The</strong>n, the uniqueness of the ideal descriptions is checked<br />

through the closeness of the profile of the P averaged ideal products. This can be done globally (i.e. based on all attributes)<br />

or for each attribute separately.<br />

When all the attributes are considered together, the uniqueness of the ideal products can be evaluated through the<br />

distance between the projections of the P averaged ideal products into the sensory product space. To do so, the sensory<br />

product space is created <strong>by</strong> PCA on the sensory profiles of the tested products. <strong>The</strong> P averaged ideal products are then<br />

projected as supplementary products into that space. If the projections of the different ideal products are close in the<br />

sensory space, consumers rate one unique ideal. In the contrary, if the projections of the P ideal products define clear<br />

different groups on the space, consumers describe multiple ideals.<br />

Since the notion of distance between the projections is subjective, this procedure is enriched <strong>by</strong> considering the<br />

variability existing around each ideal product via confidence ellipses (Husson, Lê, & Pagès, 2005). <strong>The</strong>se confidence ellipses<br />

are obtained using partial bootstrap (Cadoret, & Husson, 2012): It consists in simulating fictitious panels <strong>by</strong> resampling<br />

randomly with replacement the original one, and <strong>by</strong> projecting the averaged ideal profiles (called simulated ideals) obtained<br />

from the simulated panels into the same sensory space. This procedure is iterated a large number of times (in practice 500<br />

times) and confidence ellipses containing 95% of the projections of the corresponding simulated ideals are constructed<br />

around each product.<br />

Inspecting the resulting maps, it could be said that the panel of consumers has rated a unique ideal if the projections of<br />

the ideal products are close in the sensory space, involving an overlap of the confidence ellipses. On the contrary, they have<br />

rated multiple ideals if the projections of the ideal products are far on the space. In this latter situation, the corresponding<br />

confidence ellipses do not overlap. Since observing an overlap of the ellipses is not sufficient to conclude about the<br />

significant differences between ideal products (the differences could be observed on other sensory dimensions of the PCA),<br />

this procedure is completed <strong>by</strong> the Hotelling T² test. This MANOVA helps defining whether the ideals are significantly<br />

different or not, hence helping to define the number of subcategories of products to consider in the mind of the consumers.<br />

<strong>The</strong> uniqueness of the ideal descriptions can also be evaluated for each attribute separately. To do so, a two‐way<br />

ANOVA, which measures the product and consumer effects on each ideal attribute, is performed (Eq. 3a).<br />

<br />

Where<br />

is the constant, γ pa the product effect, β ja the consumer effect (random) and ε jpa the residual<br />

In this ANOVA, the uniqueness of the ideal ratings for an attribute a is measured through the product effect . One<br />

has to consider the particular case where the product effect is significant. In that situation, the ideal and perceived<br />

intensities are compared to determine whether the differences in the ideal ratings are due to the existence of multiple<br />

<br />

ideals or just an artifact due to the sensory differences of the tested products on that attribute. To do so, the value<br />

<br />

associated with the product effect in Eq.3a is compared to the corresponding value of the product effect measured for<br />

the perceived intensities on the corresponding attribute (Eq. 3b).<br />

<br />

(3b)<br />

Where<br />

is the constant, γ pa the product effect, β ja the consumer effect (random) and ε jpa the residual<br />

<br />

<br />

To facilitate the interpretation of the result, the ratio is considered. This ratio is considered since and<br />

<br />

are comparable values measuring the part of variability related to the products on respectively the perceived and ideal<br />

intensity, and made relative according to the residual of the respective models. In this case, we are directly interested in the<br />

one‐to‐one comparison of the F values. For that reason, the ratio is considered and compared to the value 1. When<br />

consumers rate multiple ideals, a large ratio (close or larger than 1) is expected.<br />

28<br />

(3a)


2. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong> Method in Practice<br />

Additionally, for those ideal attributes with a significant product effect, the influence of the tested products on the<br />

ideal ratings is evaluated. To do so, the P coefficients associated with the different products are extracted for each<br />

attribute from Eq. 3a. <strong>The</strong> link between these coefficients and the sensory descriptions of the products is measured (Table<br />

4) using the correlation coefficient between the perception of the products on an attribute a and the impact of the<br />

products on the ideal ratings of that attribute a. If the correlation coefficient is positive (vs. negative), the consumers rate<br />

their ideals as more intense (vs. less intense) for the attribute a after rating a product perceived as more intense on the<br />

same attribute a. A dragging (vs. compensating) effect is then observed.<br />

Product<br />

Perc.<br />

attr. 1<br />

…<br />

Perc.<br />

attr. a<br />

…<br />

Perc.<br />

attr. A<br />

Influence<br />

on attr. 1<br />

…<br />

Influence<br />

on attr. a<br />

…<br />

Influence<br />

on attr. A<br />

1<br />

…<br />

p . <br />

…<br />

P (active) (supplementary)<br />

Table 4: Organization of the perceived intensities (left)<br />

and of the influence of the products on the ideal ratings (right) submitted to the PCA.<br />

To view simultaneously this relationship for all attributes, a PCA is performed on the averaged table of perceived<br />

intensities, where the influence of the product on the ideal ratings is projected as illustrative variables.<br />

3.3.1.2. Consumer level:<br />

<strong>The</strong> uniqueness of the ideal ratings on the different attributes can also be evaluated at the consumer level. Let’s<br />

consider that each consumer rates one unique ideal on each attribute. This ideal rating can be defined <strong>by</strong> Eq. 4a.<br />

<br />

<br />

<br />

where equals the corrected ideal intensity of the consumer j for the attribute a and the residual.<br />

(4a)<br />

<br />

<strong>The</strong> uniqueness of the ideal rating is measured within the residual .<br />

Specifically, when the P ideal ratings provided<br />

<strong>by</strong> a consumer are close, indicating a low variability of the ideal ratings, the sum of squares of the residual is small.<br />

Inversely, a consumer providing different ideal ratings is associated with a large sum of squares of the residual. <strong>The</strong> value<br />

per se of the sum of squares does not give any conclusion. <strong>The</strong>refore it is compared to the corresponding sum of squares of<br />

<br />

the residual obtained from the perceived intensities provided <strong>by</strong> the same consumer. In other words, the residual is<br />

compared with the residual <br />

obtained from Eq. 4b:<br />

<br />

<br />

<br />

<br />

<br />

where the averaged perceived intensity of the attribute a <strong>by</strong> the consumer j and <br />

<br />

the residual<br />

(4b)<br />

<br />

To facilitate the comparison, the ratio <br />

<br />

between the sums of squares is used. For consumers<br />

having one unique ideal product, this ratio is expected to be lower than 1.<br />

3.3.2. How do consumers differ in their representation of their ideal?<br />

For the optimization process, the averaged ideal product for the entire panel is often considered as a reference to<br />

match. But does this averaged ideal product correspond to an optimum product to all consumers? Do they all share a close<br />

ideal?<br />

To answer this question, the focus is on the variability of the averaged ideal profiles provided from each consumer (i.e.<br />

the variability between consumers’ ideals). To evaluate such differences, one might be interested in creating an ideal space<br />

where consumers sharing similar ideals are grouped together and apart from those who have different ideals. Such ideal<br />

space can be obtained <strong>by</strong> PCA on the corrected averaged ideal profiles (a justification of the use of the corrected averaged<br />

ideal profiles is given in the Appendix). In this analysis, each entity corresponds to the corrected averaged ideal profile ..<br />

provided <strong>by</strong> a consumer.<br />

<strong>The</strong> ideal space allows creating a typology of consumers which can be enriched <strong>by</strong> associating each homogeneous<br />

group of consumers with the closest‐to‐their‐ideal tested product. To do so, the sensory profiles of the products are<br />

projected as illustrative entities in this space (Table 5).<br />

29


2.1. Presentation of the <strong>Ideal</strong> <strong>Profile</strong> Method<br />

consumer 1<br />

Attribute 1 … Attribute a … Attribute A<br />

…<br />

consumer j ̃.<br />

…<br />

consumer J<br />

(active)<br />

product 1<br />

…<br />

product p . ..<br />

…<br />

product P<br />

(supplementary)<br />

Table 5: Organization of the ideal profiles used for the construction of the ideal space,<br />

with projection of the products as supplementary.<br />

4. Results<br />

4.1. Single vs. multiple ideals<br />

<strong>The</strong> uniqueness of the ideal representations has been checked both at the panel and consumer level. At the panel<br />

level, it is checked globally (based on all attributes) and for each attribute separately.<br />

4.1.1. At the panel level<br />

4.1.1.1. Globally<br />

For the croissant project, the projections of the averaged ideal products for the panel are all located in a close area of<br />

the map, in the bottom right corner of the sensory space (Figure 2). Since the confidence ellipses constructed around the<br />

ideal products all overlap, it could be concluded that at the panel level, consumers are rating one single ideal. However, this<br />

conclusion is to relativize since the first two dimensions only explain around 55% of the total variance, and important<br />

differences might also be seen on higher dimensions. But since all the p‐values associated to the Hotelling T² test are not<br />

significant (see Table 6) in this particular project, the optimization of all the products can be done based on one unique<br />

ideal which would be the averaged over all these individual ideals.<br />

Figure 2: 95% confidence ellipses associated to the averaged ideal products of the panel for the croissant project.<br />

30


2. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong> Method in Practice<br />

1 2 3 4 5 6 7 8 9<br />

1 1,000 0,687 0,206 0,530 0,907 0,492 0,337 0,784 0,986<br />

2 0,687 1,000 0,564 0,795 0,759 0,325 0,235 0,278 0,602<br />

3 0,206 0,564 1,000 0,795 0,375 0,038 0,026 0,055 0,151<br />

4 0,530 0,795 0,795 1,000 0,768 0,122 0,080 0,227 0,439<br />

5 0,907 0,759 0,375 0,768 1,000 0,289 0,186 0,606 0,838<br />

6 0,492 0,325 0,038 0,122 0,289 1,000 0,948 0,415 0,590<br />

7 0,337 0,235 0,026 0,080 0,186 0,948 1,000 0,276 0,421<br />

8 0,784 0,278 0,055 0,227 0,606 0,415 0,276 1,000 0,819<br />

9 0,986 0,602 0,151 0,439 0,838 0,590 0,421 0,819 1,000<br />

Table 6: P‐values obtained with the Hotelling T² test showing the significant differences between each pair of products for<br />

the croissant study.<br />

Figure 3a shows the results obtained for the cream yoghurt 1 project. In this dataset, it can be seen that the<br />

confidence ellipses associated to the ideal product 7 is different from the other ideals. Indeed, the confidence ellipse of the<br />

ideal product 7 is not overlapping the confidence ellipses associated to the other ideal products. This separation is observed<br />

on the second dimension. Hence it involves different ideal intensities (Figure 3b) for the attributes fresh taste, sour odour,<br />

fruity taste (stronger ideal intensity for 7) and sweet taste, sweet odour, amount fruit (weaker ideal intensity for 7). This<br />

result is confirmed <strong>by</strong> the p‐value obtained with the Hotelling T² test given in Table 7. A closer look at this table also shows<br />

a significant difference between the product 3 and the five other products. Indeed, the confidence ellipse associated to the<br />

product 3 does not overlap with the other ellipses on the second dimension. In this case, it would also be recommended to<br />

optimize the product 3 separately. However, since the difference between the ideal product associated to 3 and the ideal<br />

product common to the five other products would be small, for this project, it would be recommended to optimize the<br />

product 7 based on its corresponding ideal, and to optimize the six other products together based on their common ideal.<br />

Figure 3a: 95% confidence ellipses associated to the averaged ideal products of the panel for the cream yoghurt 1 project.<br />

31


2.1. Presentation of the <strong>Ideal</strong> <strong>Profile</strong> Method<br />

Figure 3b: Correlation circle associated to the product space obtained for the cream yoghurt 1 project.<br />

1 2 3 4 5 6 7<br />

1 1,000 0,402 0,032 0,184 0,628 0,498 0,000<br />

2 0,402 1,000 0,005 0,813 0,851 0,431 0,000<br />

3 0,032 0,005 1,000 0,006 0,027 0,001 0,000<br />

4 0,184 0,813 0,006 1,000 0,601 0,157 0,000<br />

5 0,628 0,851 0,027 0,601 1,000 0,333 0,000<br />

6 0,498 0,431 0,001 0,157 0,333 1,000 0,000<br />

7 0,000 0,000 0,000 0,000 0,000 0,000 1,000<br />

Table 7: P‐values obtained with the Hotelling T² test showing the significant differences between each pair of products for<br />

the cream yoghurt 1 study.<br />

4.1.1.2. For each attribute<br />

At the attribute level, the definition of a single ideal was done <strong>by</strong> comparing the ratio of F values associated to the<br />

product effect on the different perceived and ideal intensities. Figure 4 shows the ratio across attributes for the different<br />

projects. As can be seen, most of the ratios are smaller than 1, meaning that the consumers described one unique ideal for<br />

the majority of the attributes. However, for some projects, such as the beer or candy bar projects, ratios larger than 1 are<br />

observed. For these attributes (length of the after taste, bitter taste and musty taste for the beers; saltiness and crunchiness<br />

for the candy bar) of these products, consumers seemed to rate multiple ideals.<br />

32


2. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong> Method in Practice<br />

Figure 4: Distribution of the ratio of the F of the product effects for the perceived and ideal intensities in each project.<br />

4.1.1.3. Influence of the products on the ideal ratings<br />

In order to check whether the ideal ratings are independent from the products tested, a two‐way ANOVA measuring<br />

the product and consumer effects on each ideal attribute was performed. In this ANOVA, we are only interested in the<br />

product effect which is expected not to be significant. However, this is not always true. For some consumers and attributes,<br />

the product effect is significant. It is the case for 13 out of 21 attributes in the perfume example. To check the nature of this<br />

product effect, the individual coefficients were extracted from this ANOVA (Eq. 3a) and were associated with the<br />

perceived intensities (Table 4). A PCA was performed on the product profiles and the coefficients were projected as<br />

supplementary variables in this analysis.<br />

Figure 5 shows that the correlation between pairs of corresponding attributes is always strong and positive. When<br />

products were perceived as more intense, consumers tended to rate their ideal as more intense. This phenomenon can be<br />

defined as a dragging effect of the perceived intensities on the ideal ratings observed for each attribute. This dragging<br />

effect was observed in all datasets.<br />

Figure 5 Relationship between the perceived intensities and the influence of the products on the ideal ratings for the<br />

perfume dataset (significant level for the attributes: ***


2.1. Presentation of the <strong>Ideal</strong> <strong>Profile</strong> Method<br />

<strong>The</strong> next step was to measure the impact of this dragging effect. To do so, the averaged ideal ratings . were<br />

compared to the averaged perceived intensities . , and the magnitude of the influence of the products on the ideal<br />

ratings was measured.<br />

<strong>The</strong> simultaneous representation of the averaged perceived intensities and the averaged ideal ratings (Figure 6) allows<br />

quantifying the dragging effect. For the perfume dataset, no impact is observed for the attribute intensity (Figure 6a),<br />

although the products are different. However, for freshness (Figure 6b), a dragging effect is observed: the fresher the<br />

product, the higher the ideal freshness. But although the products are clearly different in freshness, the ideal ratings only<br />

vary a little. It seems here that consumers rated one unique ideal for freshness.<br />

Figure 6: Influence of the perceived intensities (boxplot) on the ideal ratings (dotted line) for a non significant (intensity, a)<br />

and a significant (freshness, b) attribute.<br />

4.1.2. At the consumer level<br />

<br />

To check for uniqueness of the ideal, the ratio <br />

<br />

was considered (Eq. 4).<br />

When consumers rate unique ideals, the variability of the ideal ratings is low compared to the one associated with the<br />

products. For all the dataset considered, the majority of the ratios were lower than 1 (Figure 7), the median being often<br />

lower than 0.5. Given that the variability of the ideal ratings was much smaller than the variability of the perceived<br />

intensities, it can be concluded that for the majority of consumers, one unique ideal was found.<br />

Figure 7: Ratio of the sum of squares of the residual obtained with each project.<br />

Note: for graphical reasons, all ratio larger than 2 is forced at 2.<br />

34


2. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong> Method in Practice<br />

This corresponds for example to the consumer 12535 (perfume dataset) for whom both perceived and ideal intensities<br />

are represented Figure 8a. This is what one can expect from consumers (i.e. consumers providing close ideal ratings which<br />

are independent of the product tested). In some rare occasions, the ratio might take larger values, showing that consumers<br />

might describe multiple ideals. For consumer 13313, the ratio was close to 1 (Figure 8b) which means that he/she rated the<br />

ideal with the same variability as the products. For some other consumers, this ratio was even larger. A closer inspection at<br />

the ideal descriptions seems to show that they had difficulties describing their ideals. For consumer 13645 (Figure 9a), the<br />

high ratio is due to a non‐discrimination of the products and not to a description of different ideals. For consumer 13121<br />

(Figure 9b), the high ratio seem to be due to some difficulties in understanding or rating the products on some attributes.<br />

Indeed, this consumer rated both the perceived and ideal intensities identical (using only values between 15 and 20 on a<br />

100‐point scale) for the entire set of attributes (with the exception of freshness and intensity).<br />

Figure 8: Raw perceived and ideal intensities provided <strong>by</strong> two particular consumers (perfume dataset): (a): the consumer is<br />

associated to a ratio 1 ; (b): the consumer has a ratio ~1.<br />

35


2.1. Presentation of the <strong>Ideal</strong> <strong>Profile</strong> Method<br />

4.2. Variability of the averaged ideal profiles<br />

In order to study the variability between consumers’ ideals, a PCA was performed on the corrected averaged ideal<br />

profiles. To characterize groups of consumers sharing a similar ideal, the tested products were projected as supplementary<br />

entities into the resulting space.<br />

Since consumers were corrected for their different use of the scale, the first dimension of the PCA obtained with the<br />

perfume dataset opposes consumers (i.e. 2909) who described their ideals as less intense for all attributes to consumers<br />

(i.e. 13645) who described their ideals as more intense for all attributes (Figure 10). As the projection of the products as<br />

supplementary entities are not well separated on the first dimension, the dimensions 2 and 3 were considered for further<br />

interpretation (Figure 11). Here, the ideal space opposes the consumers 11169 and 12872 on the 2 nd dimension (Figure<br />

11a). This corresponds to consumers describing their ideals respectively with strong oriental notes vs. consumers describing<br />

their ideals with strong fresh and fruity notes (Figure 11b). <strong>The</strong> projection of the products as supplementary entities<br />

associated ideal products described with strong oriental notes (i.e. consumer 1169) with the products Shalimar, Angel and<br />

Aromatic Elixir. <strong>Ideal</strong> products with strong fresh and fruity notes were associated with the products J'Adore, Coco<br />

Mademoiselle and Pleasures (i.e. consumer 3670). <strong>The</strong> 3rd dimension shows the particular case of the consumers describing<br />

their ideals with strong honey, caramel and vanilla notes. <strong>The</strong>se consumers (i.e. consumer 13311) have ideals whose<br />

profiles are close to those of Lolita Lempicka and Cinema.<br />

Figure 10a: <strong>Ideal</strong> space (dimensions 1 and 2) with projection of the products as supplementary entities.<br />

Figure 10b: Variables representation associated with the ideal space (dimensions 1 and 2).<br />

36


2. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong> Method in Practice<br />

Figure 11a: <strong>Ideal</strong> space (dimensions 2 and 3) with projection of the products as supplementary entities.<br />

Figure 11b: Variables representation associated with the ideal space (dimensions 2 and 3).<br />

Although all consumers did not share the same ideal, it was possible to define groups of consumers sharing similar<br />

ideals. <strong>The</strong>se groups could then be characterized <strong>by</strong> the products via their proximity in the space. However, some<br />

consumers were located far away from these groups, their ideal ratings being more extreme (Figure 11a). For these<br />

particular consumers, the characteristics of their ideal products were similar to the ones of the products, but required much<br />

stronger intensities.<br />

This remark can be seen as a limitation of the IPM. Indeed, for some attributes (more precisely the ones with hedonic<br />

connotations such as freshness for mint gum, natural taste for fruit juice or throat burn for chocolate), the ideal level will<br />

never be achieved as consumers will always ask for more (or less). This is why the ideal ratings provided <strong>by</strong> consumers<br />

should be used as guidance to an improvement and not as a strict recipe. Moreover, in the process of optimizing products,<br />

it is important to consider both the deviation between the perceived and the ideal intensity for each product and each<br />

attribute, and the impact of that attribute on liking. Some methods for optimization which take these two parameters into<br />

consideration are given in <strong>Worch</strong>, Dooley, Meullenet, and Punter (2010). <strong>The</strong> methods presented in this article provide<br />

some estimation of the drop in liking score for each product for not being ideal.<br />

37


2.1. Presentation of the <strong>Ideal</strong> <strong>Profile</strong> Method<br />

4.3. Summary<br />

To summarize the results obtained previously, one can model the ideal ratings provided <strong>by</strong> the consumers. When<br />

consumers rated one unique ideal, the simple model used to characterize the ideal rating was presented (Eq. 4a). When<br />

consumers rated multiple ideals (based on all attributes), the same procedure can be applied to each subset of products<br />

associated with a unique ideal. <strong>The</strong> corresponding model obtained at the panel level is given Eq. 5:<br />

(5)<br />

However, the study of the relationship between the ideal and perceived intensities showed that the ideal ratings could<br />

be influenced <strong>by</strong> the perceived intensities of the products. <strong>The</strong> model can be extended <strong>by</strong> considering this influence. <strong>The</strong><br />

direct relationship between the perceived intensity and the ideal rating is considered and a regression factor is added (Eq.<br />

6):<br />

(6)<br />

with the slope of the regression line of the perceived on the ideal intensity provided <strong>by</strong> the consumer j for the<br />

attribute a.<br />

It has also been shown that it takes all kinds to make a world. Consumers do not necessarily share a common ideal.<br />

Hence, it is important to include the differences between consumers in the model. Not being interested in these consumers<br />

specifically, the consumer effect is set as random. <strong>The</strong> following model of analysis of covariance is obtained (Eq. 7):<br />

where is the consumer effect set as random.<br />

(7)<br />

<strong>The</strong> diversity of consumers was not only measured through the direct differences between their ideals (measured <strong>by</strong><br />

the consumer effect) but also through the different influence of the products on the ideal ratings. While rating the ideal<br />

intensity of an attribute a, some consumers might have been positively influenced <strong>by</strong> the products while others might have<br />

been influenced negatively or not at all. <strong>The</strong> interaction between the influence of the perceived intensities on the ideal<br />

ratings and the consumer is added to the previous model (Eq. 8):<br />

: (8)<br />

In this analysis of covariance, the interaction : measures the influence of the products on the ideal ratings<br />

for each consumer.<br />

With this model, the ideal information as well as the impact of the different factors on the ideal ratings (tested<br />

products, differences between consumers) can be estimated at once for each attribute. This can only be done if the ideal<br />

ratings have been rated multiple times <strong>by</strong> each consumer. A more detailed study of the coefficients of this ANCOVA can<br />

help to better understand the ideal ratings.<br />

5. Conclusions<br />

<strong>The</strong> IPM is a sensory evaluation methodology combining classical profiling with ideal ratings measured from<br />

consumers. It provides additional information (ideal profiles) which can be useful for product optimization (<strong>Worch</strong> et al.,<br />

2010). However, the IPM provides more detailed information than JAR scales (Van Trijp, Punter, Mickartz, & Kruithof, 2007)<br />

as both the perceived and ideal intensities for each attribute are measured, while only deviations from ideals are measured<br />

with JAR scales. This is why many practitioners have applied methods measuring ideal information in the past 40 years.<br />

Due to the diversity of the data acquired with IPM, <strong>Worch</strong>, Lê, Punter, and Pagès (2012a, 2012b) proposed a<br />

methodology which checks the sensory and hedonic consistency of the ideal information. This consistency is checked <strong>by</strong><br />

evaluating the agreement between the different types of data (sensory, hedonic, and ideal). In practice, consistent ideal<br />

ratings could be considered to be efficient since they validate all types of data at once. However, in practice, those cases<br />

where the three data sets are not in agreement would normally be interpreted as an inconsistency of the ideal ratings,<br />

since it is hard to imagine consumers providing good ideal ratings on one hand, and hedonic judgments which are not<br />

related to the sensory descriptions on the other hand. However, it has to be said that these apparently “inconsistent” ideal<br />

ratings can be really consistent if it happens to be that consumers rate their ideals according to other criteria than liking.<br />

For example, consumers on a diet, could like more those sweeter products, but would give a consistent ideal product which<br />

is low in sweetness, since they have health concerns. Such cases have not been taken into consideration here, but would be<br />

highly suggested.<br />

In this context, one should be cautious when improving the products. Such verification of the consistency of the<br />

dataset is not possible with other methodologies such as the JAR scale since all the information (sensory, ideal, and<br />

hedonic) is needed. However, for these methodologies, other validations (e.g. significance testing) based on bootstrap<br />

techniques could be performed.<br />

38


2. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong> Method in Practice<br />

With the IPM, the ideal information provided from consumers is directly actionable for product optimization. In order<br />

to avoid any misuse of this information, it is important to understand how consumers define their ideal. Some clues can be<br />

given <strong>by</strong> the study of the variability of the ideal ratings at both the panel and consumer level, as well as between and within<br />

consumers.<br />

From our experience, in most cases, consumers associated the product set to one unique ideal when based on all<br />

attributes. However, when attributes are considered separately, multiple ideals could be observed for some of them. At the<br />

consumer level, some show large variability in their ideal ratings. This is either due to 1) difficulties with rating their ideal<br />

intensities, 2) difficulties with the task, or 3) because they consider the products tested coming from different<br />

subcategories.<br />

When projects include products belonging to one unique subcategory, it could be interesting to ask the ideal only once<br />

to consumers. By doing so, the methodology is simplified for the consumers. However, since it has been shown that<br />

consumers were influenced <strong>by</strong> the products tested while rating their ideal intensities, it might be preferable to ask for their<br />

ideal intensities prior to the products evaluation. Since the consumers cannot use a tested product as a reference to<br />

describe his/her ideal product anymore, using a structured labeled scale for the entire task would be helpful in that<br />

situation.<br />

In the optimization process based on ideal products measured directly from consumers, the averaged ideal product<br />

calculated over the panel is often considered. By doing so, one supposes that consumers share close ideal profiles. This<br />

hypothesis was checked in a second step <strong>by</strong> studying the variability of the averaged ideal ratings between consumers. From<br />

this analysis, it was shown that consumers differ in their conception of their ideals, highlighting that “it takes all kinds to<br />

make a world”. Hence considering one averaged ideal for the entire panel as a reference to match in the optimization<br />

process might not lead to an optimal solution. Other ideal solutions might satisfy the consumers more: Among them, we<br />

can mention the solution obtained with the <strong>Ideal</strong> Mapping technique (IdMap, <strong>Worch</strong>, Lê, Punter, & Pagès, 2012c) which<br />

consists in taking the averaged ideal profile common to a maximum of consumers only. In this latter, the ideal product is<br />

more targeted since it is optimal for the larger subgroup of consumers sharing a common ideal.<br />

In summary, we consider that IPM is a valuable methodology for products’ optimization.<br />

Appendix<br />

For the evaluation of the variability of the ideal profiles between consumers, a map is created positioning the<br />

consumers together based on the proximity of their ideal products. Such ideal space has been obtained <strong>by</strong> performing a<br />

PCA on so‐called corrected averaged ideal profiles .. . <strong>The</strong>se profiles correspond to the averaged ideal profiles of the<br />

consumers after correcting for the difference in use of the scale. Hence, the data considered for each consumer is the<br />

difference ̃. between his/her averaged ideal score . and his/her averaged perceived score of the products . .<br />

By doing so, all consumers are translated <strong>by</strong> setting their averaged perceived intensity at the same origin, and the<br />

differences between consumers only concern the ideal profiles they provided. For a consumer j, a positive (vs. negative)<br />

difference ̃. means the ideal is described as more (vs. less) intense than the averaged perceived intensity of the tested<br />

product.<br />

In order to check whether the correction is relevant, the same methodology for studying the variability of the ideal<br />

products between consumers is performed on the non‐corrected data. A PCA is performed on the averaged ideal profiles ..<br />

directly. Since the dimensions of the PCA are not interpreted, the variable names are hidden.<br />

In order to check whether the consumers’ differences in their use of the scale has an impact on the results, the<br />

averaged perceived intensities . from each consumer are projected as illustrative variable on this PCA (Table A1).<br />

<strong>Ideal</strong> att. 1 … <strong>Ideal</strong> att. a … <strong>Ideal</strong> att. A Perc. att. 1 … Perc. att. a … Perc. att. A<br />

Cons. 1<br />

…<br />

Cons. j . .<br />

…<br />

Cons. J (active) (illustrative)<br />

Table A1: Organization of the data used to justify the correction of the ideal profiles.<br />

In this case, the PCA is performed on the averaged ideal profiles .. and the averaged perceived intensities .. are projected<br />

as illustrative variables.<br />

It is considered here that, if a consumer j 1 uses a higher part of the scale than a consumer j 2 to describe the products,<br />

then j 1 will also use a higher part of the scale than j 2 to describe the same ideal. When the ideal data are not corrected from<br />

the use of the scale, the PCA might separate these consumers while they should belong to the same group, as they share<br />

the same ideal.<br />

In the case where the ideal space opposes consumers according to differences in the use of the scales, the projection<br />

of the averaged perceived intensities . would be highly positively correlated to the averaged ideal attributes ..<br />

Otherwise, the projections would be orthogonal.<br />

39


2.1. Presentation of the <strong>Ideal</strong> <strong>Profile</strong> Method<br />

<strong>The</strong> PCA performed on the non‐corrected ideal profiles returns the following results (Figure A1). <strong>The</strong> correlation circle<br />

(Figure A1b) shows that the first dimension is strongly positively correlated with all the attributes. This particular situation ‐<br />

also known as size effect‐ explains 54% of the variance. It opposes consumers who scored their ideal low on all attributes<br />

(i.e. 4238) to consumers who scored all attributes high (i.e. 8118) (Figure A1a). This difference between consumers can<br />

either be related to their ideal (some want an ideal which is not intense for all attributes while some other look for an ideal<br />

that is more intense on all attributes), or to the scaling behavior of the consumers themselves (some using only the low part<br />

of the scale while some use only the high part of the scale).<br />

Figure A1: First and second dimensions of the ideal space obtained with the non‐corrected averaged ideal profiles.<br />

To conclude about the nature of the differences between consumers, the averaged perceived intensities . are<br />

projected as illustrative (Figure A2).<br />

Figure A2: Projection of the averaged perceived intensities as illustrative variables in the ideal space.<br />

<strong>The</strong> consumers’ averaged perceived intensities for each attribute are also projected along the first dimension and are<br />

highly positively correlated with the corresponding ideal attributes. In other words, a similar size effect is observed with the<br />

perceived intensities, meaning that consumers who rated the products using the higher (vs. lower) part of the scale tended<br />

to use the scale in the same manner when rating their ideal intensities. This is observed for all attributes. Hence, the<br />

differences between consumers highlighted <strong>by</strong> the first dimension of the PCA are related to a different use of the scale and<br />

not to their ideals.<br />

40


2. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong> Method in Practice<br />

Since the differences in the use of the scale are an important part of the variability, it is important to correct it. Hence,<br />

using the corrected averaged ideal profiles instead of the non‐corrected averaged ideal profiles seems relevant. However,<br />

one has to be sure that the ideal data are corrected for the differences in the use of the scale.<br />

To check that, the consumers’ differences (i.e. the averaged perceived intensities . ) are also projected on the ideal<br />

space obtained from the corrected averaged ideal profiles .. (Table A2).<br />

<strong>Ideal</strong> att. 1 … <strong>Ideal</strong> att. a … <strong>Ideal</strong> att. A Perc. att. 1 … Perc. att. a … Perc. att. A<br />

Cons. 1<br />

…<br />

Cons. j ̃. .<br />

…<br />

Cons. J (active) (illustrative)<br />

Table A2: Organization of the data used to justify the correction of the ideal profiles.<br />

In this case, the PCA is performed on the corrected averaged ideal profiles .. and the averaged perceived intensities .. are<br />

projected as illustrative variables.<br />

<strong>The</strong> PCA performed on the corrected averaged ideal profiles, in which the averaged perceived intensities per consumer<br />

are projected as illustrative (Table A2), highlights another size effect on the first dimension (Figure A3). Indeed, all the<br />

corrected ideal attributes are once again highly positively correlated with the first dimension.<br />

Figure A3: Projection of the averaged perceived intensities in the ideal space obtained from the corrected averaged ideal<br />

profiles.<br />

<strong>The</strong> projections as illustrative variables of the averaged perceived intensities are orthogonal to the corrected ideal<br />

attributes. <strong>The</strong> ideal data are corrected from the differences in the use of the scale. <strong>The</strong> size effect highlighted here on the<br />

first dimension is related to differences in the consumers’ ideals, meaning that some consumers (i.e. 2909) described their<br />

ideal as less intense than what they perceived for all attributes while for some others (i.e. 13645), the ideal should be more<br />

intense on all attributes than what they perceived. Further interpretation of this ideal space is given in the article.<br />

As a conclusion, the correction of the ideal data from the consumers’ differences in the use of the scale is done <strong>by</strong><br />

translating their ideal ratings according to their averaged perceived intensity.<br />

Acknowledgement<br />

<strong>The</strong> authors would like to thank the reviewers for their valuable comments which helped improving considerably this<br />

manuscript, as well as Prof. Danzart and Betina Piqueras for their valuable input related to the topics covered in this paper.<br />

41


2.1. Presentation of the <strong>Ideal</strong> <strong>Profile</strong> Method<br />

References<br />

Booth, D.A., Conner, M.T., & Marie, S. (1987). Sweetness<br />

and food selection: measurement of sweetners’<br />

effects on acceptance. In Sweetness (ed. J.<br />

Dobbing), Springer‐Verlag: London.<br />

Brandt, M.S., Skinner, E.Z., & Coleman, J.A. (1963).<br />

Texture profile method. Journal of Food Science,<br />

28: 404.<br />

Cadoret, M., & Husson, F. (2012). Confidence ellipses in<br />

holistic approaches. Oral presentation in 12 th<br />

European Symposium on Statistical Methods for<br />

the Food Industry, Feb.‐March, Paris, France.<br />

Cadoret, M., Lê, S., & Pagès, J. (2009). A Factorial<br />

Approach for Sorting Task data (FAST). Food<br />

Quality and Preference, 20, 410‐417.<br />

Cadoret, M., Lê, S., & Pagès, J. (2011). Statistical analysis<br />

of hierarchical sorting data. Journal of Sensory<br />

Studies, 26, 96‐105.<br />

Cooper, H.R., Earle, M.D., & Triggs, C.M. (1989). Ratios of<br />

<strong>Ideal</strong>s – A New Twist to an Old Idea. In Product<br />

Testing with Consumers for Research Guidance.<br />

ASTM STP 1035, L.S. Wu, Ed., American Society for<br />

Testing and Materials, Philadelphia, 54‐63.<br />

Dairou, V., & Sieffermann, J.M. (2002). A comparison of<br />

14 jams characterized <strong>by</strong> conventional profile and<br />

a quick original method, the Flash <strong>Profile</strong>. Journal<br />

of Food Science, 67, 2, 826‐834.<br />

Dehlholm, C., Brockhoff, P.B., Meinert, L., Aaslyng, M.D.,<br />

& Bredie, W.L.P. (2012). Rapid Descriptive Sensory<br />

Methods: Comparison of Free Multiple Sorting,<br />

Partial Napping, Napping, Flash Profiling and<br />

Conventional Profiling. Food Quality and<br />

Preference, 26, 267‐277.<br />

Gazano, G., Ballay, S., Eladan, N., & Siefferman, J.M.<br />

(2005). Flash profile and flagrance research: Using<br />

the words of the naïve consumers to better grasp<br />

the perfume’s universe. In ESOMAR fragrance<br />

research conference, 15‐17 May 2005, New York,<br />

USA.<br />

Hoggan, J. (1975). New Product Development. MBAA<br />

Technical Quarterly, 12, 81‐86.<br />

Husson, F., Le Dien, S., & Pagès, J. (2001). Which value<br />

can be granted to sensory profiles given <strong>by</strong><br />

consumers? Methodology and results. Food<br />

Quality and Preference, 12, 291‐296.<br />

Husson, F., Lê, S., & Pagès, J. (2005). Confidence ellipse<br />

for the sensory profiles obtained <strong>by</strong> principal<br />

component analysis. Food Quality and preference,<br />

16, 245‐250.<br />

Lawless, H.T. (1989). Exploration of fragrance categories<br />

and ambiguous odors using multidimensional<br />

scaling and cluster analysis. Chemical Senses, 14,<br />

349‐360.<br />

MacFie, H.J., Bratchell, N., Greenhoff, K., & Vallis, L.V.<br />

(1989). Designs to balance the effect of order of<br />

presentation and first‐order carry‐over effects in<br />

hall tests. Journal of Sensory Studies, 4, 129‐148.<br />

Moskowitz, H.R. (1972). Subjective ideals and sensory<br />

optimization in evaluating perceptual dimensions<br />

in food. Journal of Applied Psychology, 56, 60‐66.<br />

Moskowitz, H.R. (1996). Experts versus consumers: A<br />

comparison. Journal of Sensory Studies, 11, 19‐37.<br />

Moskowitz, H.R. (1997). Base size in product testing: a<br />

psychophysical viewpoint and analysis. Food<br />

Quality and Preference, 8, 247‐255.<br />

Nestrud, M.A., & Lawless, H.T. (2008). Perceptual<br />

mapping of citrus juices using projective mapping<br />

and profiling data from culinary professionals and<br />

consumers. Food Quality and Preference, 19, 431‐<br />

438.<br />

Pagès, J. (2005). Collection and analysis of perceived<br />

product inter‐distances using multiple factor<br />

analysis: Application to the study of 10 white wines<br />

from the Loire Valley. Food Quality and Preference,<br />

16, 642‐649.<br />

Pagès, J., Cadoret, M., & Lê, S. (2010). <strong>The</strong> Sorted<br />

Napping: a new holistic approach in sensory<br />

evaluation. Journal of Sensory Studies, 25, 637‐658.<br />

Perrin, L., Symoneaux, R., Maître, I., Asselin, C., Jourjon,<br />

F., & Pagès, J. (2008). Comparison of three sensory<br />

methods for use with the Napping® procedure:<br />

Case of ten wines from Loire Valley. Food Quality<br />

and Preference, 19, 1‐11.<br />

Sieffermann, J.M. (2002). Flash profiling. A new method<br />

of sensory descriptive analysis. In AIFST 35 th<br />

convention, July 21‐24, Sidney, Australia.<br />

Stone, H., Sidel, J., Oliver, S., Woosley, A., & Singleton,<br />

R.C. (1974). Sensory evaluation <strong>by</strong> quantitative<br />

descriptive analysis. Food Technology, 28, 24‐34.<br />

Szczesniak, A.S., Loew, B.L., & Skinner, E.Z. (1975).<br />

Consumer texture profile technique. Journal of<br />

Food Science, 40, 1253‐1256.<br />

Van Trijp, H.C.M., Punter, P.H., Mickartz, F., & Kruithof,<br />

L. (2007). <strong>The</strong> quest for the ideal product:<br />

Comparing different methods and approaches.<br />

Food Quality and Preference, 18, 729‐740.<br />

42


2. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong> Method in Practice<br />

Williams, A.A., & Langron, S.P. (1984). <strong>The</strong> use of freechoice<br />

profiling for the evaluation of commercial<br />

ports. Journal of the Science of Food and<br />

Agriculture, 35, 558‐568.<br />

<strong>Worch</strong>, T., Dooley, L., Meullenet, J.F., & Punter, P.H.<br />

(2010). Comparison of PLS dummy variables and<br />

Fishbone method to determine optimal product<br />

characteristics from ideal profiles. Food Quality<br />

and Preference, 21, 1077‐1087.<br />

<strong>Worch</strong>, T., Lê, S., & Punter, P.H. (2010). How reliable are<br />

the consumers? Comparison of sensory profiles<br />

from consumers and experts. Food Quality and<br />

Preference, 21, 309‐318.<br />

<strong>Worch</strong>, T., Lê, S., Punter, P.H., & Pagès, J. (2012a).<br />

Assessment of the consistency of the ideal profiles<br />

according to non‐ideal data for IPM. Food Quality<br />

and Preference, 24, 99‐110.<br />

<strong>Worch</strong>, T., Lê, S., Punter, P.H., & Pagès, J. (2012b).<br />

Extension of the consistency of the data obtained<br />

with the <strong>Ideal</strong> <strong>Profile</strong> Method: Would the ideal<br />

products be more liked than the tested products?<br />

Food Quality and Preference, 26, 74‐80.<br />

<strong>Worch</strong>, T., Lê, S., Punter, P., & Pagès, J. (2012c).<br />

Construction of an <strong>Ideal</strong> Map (IdMap) based on the<br />

ideal profiles obtained directly from consumers.<br />

Food Quality and Preference, 26, 93‐104.<br />

43


2.2. Complementary studies and<br />

justification of the point of views adopted


2. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong> Method in Practice<br />

In this paper, it has been shown that the ideal information provided <strong>by</strong> consumers can be noised <strong>by</strong><br />

consumers’ variability due to differences in the use of the scale. Instead of using the raw ideal data, the<br />

difference between ideal and perceived intensity is considered. This difference (also called correction) is<br />

defined and justified here. Moreover, to understand the consumers’ ideals, the variability of the ideal ratings<br />

was studied between and within consumers. An extension of this analysis is also presented here.<br />

2.2.1. Correction of the ideal data<br />

In order to "correct" the ideal profiles from the differences in the use of the scale, a transformation of the<br />

ideal data was proposed in the article §2.1. However, other corrections could be considered. Rather than<br />

considering the raw ideal intensities as provided <strong>by</strong> each consumer, they can be made relative to the<br />

perceived intensities also provided <strong>by</strong> the same consumer as proposed in Figure 2.1:<br />

1.<br />

2.<br />

3.<br />

4.<br />

5.<br />

y jpa<br />

y j.a z jpa z j.a<br />

Figure 2.1: Different possible correction of the ideal data.<br />

Attribute a<br />

1: <br />

<strong>The</strong> difference between the ideal intensity of the attribute a (provided <strong>by</strong> the consumer j for the product<br />

p) and the perceived intensity of the attribute a (provided <strong>by</strong> the consumer j for the product p). This approach<br />

is interesting for the optimization of the products at the consumers’ level (JAR scale inverse).<br />

2: . .<br />

<strong>The</strong> difference between the ideal and the perceived intensities of the attribute a after averaging over the P<br />

products for the consumer j. This difference represents the ideal intensity for the attribute a of the averaged<br />

ideal product provided <strong>by</strong> the consumer j, after homogenizing from the different use of the scale. This<br />

approach is the one adopted and this corrected ideal intensity is denoted (Eq.2.1a):<br />

̃. . .<br />

(2.1a)<br />

with<br />

.. ̃. ; 1: : vector of ideal intensities averaged over the index p and corrected according to the<br />

averaged intensities perceived <strong>by</strong> the consumer j considered for the A attributes. This vector is also called<br />

“corrected averaged ideal profile of the consumer j”.<br />

This correction consists in a translation of the ideal information according to the perceived intensity. An<br />

additional step consisting in standardizing this difference can be performed. In that case, the quantity ̃. is<br />

47


Complementary Studies<br />

divided <strong>by</strong> the standard deviation .<br />

of the perceived intensities provided <strong>by</strong> the consumer j for the attribute<br />

a (Eq. 2.1b).<br />

standardized ̃. z .<br />

<br />

<br />

σ .<br />

(2.1b)<br />

For the rest of the document, the translated version of the ideal intensity ̃. is preferred over its<br />

standardized version.<br />

3: .<br />

<strong>The</strong> difference between the intensity of the attribute a perceived <strong>by</strong> the consumer j for the product p and<br />

the averaged ideal intensity of the same attribute a provided <strong>by</strong> the consumer j. This approach is interesting for<br />

the optimization on an individual basis of the products taken separately based on the averaged ideal products.<br />

It is very similar to the first difference presented above.<br />

4: .<br />

<strong>The</strong> difference between the ideal intensity of the attribute a provided <strong>by</strong> the consumer j after testing the<br />

product p and the averaged perceived intensity for that attribute a <strong>by</strong> the consumer j. This difference<br />

corresponds to the corrected ideal intensity of the attribute a provided <strong>by</strong> the consumer j after testing the<br />

product p. This correction is interesting to study the variability between consumers from all the individual ideal<br />

profiles they provide.<br />

5: .<br />

<strong>The</strong> difference between the ideal intensity of the attribute a provided <strong>by</strong> the consumer j after testing the<br />

product p and the ideal intensity averaged over the P products for the same consumer j and the same attribute<br />

a. Here, the transformation is similar to centering the ideal profiles of a consumer. This difference is useful to<br />

measure the variability within each consumer of the ideal profiles he/she provided.<br />

<strong>The</strong> correction <strong>by</strong> translating the ideal information according to the averaged perceived intensity is similar<br />

to JAR scale except that in JAR situation, the anchor point used to homogenize the consumers is their ideal. <strong>The</strong><br />

consumers rate the products on a list of attributes <strong>by</strong> indicating whether the perceived intensity is just about<br />

right (the perceived intensity equals the ideal intensity), too little (the perceived intensity is lower than ideal) or<br />

too much (the perceived intensity is higher than ideal).<br />

But is this correction necessary and relevant? After investigating the relationship between the perceived<br />

and ideal intensity ratings provided <strong>by</strong> each consumer, the advantage of such correction is evaluated at both<br />

the panel and consumer level. Additional analyses comparing results obtained from translated and<br />

standardized ideal intensity are also given.<br />

2.2.2. Justification of the correction<br />

2.2.2.1. Relationship between perceived and ideal ratings<br />

In the article, it was shown that the consumers are influenced <strong>by</strong> the products tested while rating their<br />

ideals. When a product is perceived as strong for an attribute, the ideal rating of that attribute is also rated<br />

stronger. This result suggests the existence of a relationship between these two ratings. To test this, the<br />

relationship between the perceived and ideal ratings provided <strong>by</strong> the same consumer was measured. As only<br />

48


2. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong> Method in Practice<br />

linear relationships are expected, the correlation coefficient . ; . was computed for each consumer<br />

between the vectors of perceived and ideal intensity for each attribute.<br />

<strong>The</strong> correlation coefficient was calculated for each consumer and each attribute separately for the 24<br />

different projects. <strong>The</strong> distribution of these correlation coefficients for each project is given in Figure 2.2<br />

Figure 2.2: Distribution of the correlation coefficients between perceived and ideal intensities<br />

for each consumers and each attribute per project.<br />

In all the projects, the distribution of the correlation coefficients shows a strong linear relationship<br />

between the perceived and ideal ratings. In most cases, the median is larger than 0.5. <strong>The</strong> perceived and ideal<br />

ratings provided <strong>by</strong> each consumer are dependent. <strong>The</strong> larger the perceived intensity rating for a product, the<br />

larger the corresponding ideal rating. This corresponds to the dragging effect presented in the article.<br />

In sensory analysis, it is also known that consumers don’t use the response scale the same way. Since the<br />

ideal ratings and the perceived intensity ratings are correlated, one can expect that the ideal ratings are also<br />

noised <strong>by</strong> the differences in the consumers’ use of the scale. As this variability is less relevant, it is important to<br />

correct it. This is why a simple but essential correction was proposed in the article. This correction is justified<br />

here both at the panel and consumer level.<br />

2.2.2.2. Justification of the correction <strong>by</strong> translation<br />

2.2.2.2.1. Justification at the panel level<br />

<strong>The</strong> importance of correcting the ideal data from the differences in the use of the scale was justified at the<br />

panel level in the Appendix of the article presented in §2.1. This justification was done based on the study of<br />

the variability of the ideal profiles between consumers.<br />

This justification can be extended at the consumers’ level.<br />

49


Complementary Studies<br />

2.2.2.2.2. Justification at the consumers’ level<br />

At the consumers’ level, the justification of the correction of the ideal data is done through an indicator.<br />

<br />

<strong>The</strong> indicator used here is the correlation coefficient ,,<br />

measuring the sensory consistency of the ideal<br />

profiles provided <strong>by</strong> each consumer. More details about this coefficient are given in the article assessing the<br />

sensory consistency of the ideal profiles (see §3.1.1).<br />

For each consumer, the vector of linear drivers of liking/disliking was calculated using the correlation<br />

coefficient between the vector of perceived intensity for each attribute . and the vector of liking ratings . .<br />

This vector of linear drivers of liking/disliking was compared to the ideal ratings given <strong>by</strong> the corresponding<br />

consumer j. Again, the correlation coefficient was used. In the article §3.1.1, only the corrected ideal ratings<br />

were considered (Eq. 2.2a). Let’s compare it to the results obtained with the non‐corrected ideal ratings (Eq.<br />

2.2b).<br />

<br />

,,<br />

. ; . ; . <br />

<br />

. . ,,<br />

<br />

<strong>The</strong> distributions of the correlation coefficients ,,<br />

. ; . ; . <br />

<br />

and . . ,,<br />

obtained from the corrected and noncorrected<br />

ideal ratings are compared graphically in Figure 2.3 for the perfume dataset.<br />

(2.2a)<br />

(2.2b)<br />

<br />

Figure 2.3: Truncated distribution of the ,,<br />

<br />

and . . ,,<br />

obtained with the corrected and non‐corrected ideal ratings.<br />

Note: <strong>The</strong> distributions reach values larger than 1. This is an artifact due to the estimation of the distribution, the<br />

correlation coefficients being comprised between ‐1 and 1.<br />

<strong>The</strong> truncated distributions show higher coefficients when the ideal ratings are corrected. In other words,<br />

correcting for the differences in the use of the scales removes noise due to irrelevant variability which results in<br />

higher sensory consistency. This can be explained <strong>by</strong> the fact that using the difference between the ideal and<br />

the perceived intensity of an attribute gives information about the direction to change. This direction should be<br />

in agreement with the nature of the attribute (i.e. driver of liking or disliking). For drivers of liking (vs. disliking),<br />

the more (vs. the less) the better, so the difference between the ideal and perceived intensity should be<br />

positive (vs. negative). When the ideal data are not corrected, the correlation reflects the intensity ratings<br />

between attributes. In that case, the stronger (vs. weaker) drivers of liking should also be the attribute<br />

associated with the higher (vs. lower) ideal intensity. This is not necessarily true in practice.<br />

50


2. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong> Method in Practice<br />

<br />

Additionally, the one to one comparison of ,,<br />

<br />

the consumers are associated with a ,,<br />

<br />

and . . ,,<br />

(Figure 2.4) shows that although most of<br />

<br />

coefficient which is higher than the . . ,,<br />

(i.e. consumers<br />

located above the bisection line), it is not always the case. Indeed, in few cases (i.e. 11169), using the non‐<br />

<br />

corrected ideal ratings returns a higher coefficient. Still the paired t‐test performed between the ,,<br />

<br />

. . ,,<br />

coefficients shows significant differences (Table 2.1).<br />

Mean difference<br />

(corrected‐non corrected)<br />

t‐value df p‐value<br />

t‐test 0.18 4.95 102


Complementary Studies<br />

<br />

Figure 2.5: ,,<br />

<br />

and . . ,,<br />

coefficients obtained with the corrected (left) and non‐corrected (right)<br />

ideal ratings for the different projects.<br />

<strong>The</strong> paired t‐test (Table 2.2) performed between the two series of coefficients show significant difference<br />

<br />

in favor of ,,<br />

for 15 out of the 24 projects. Still for one project, significant differences were found in favor of<br />

<br />

. . ,,<br />

(croissant project). For the 8 remaining projects, no significant differences between the two series of<br />

coefficients were observed. In most of the cases, using the corrected ideal ratings lead to higher correlations.<br />

52


2. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong> Method in Practice<br />

Mean difference<br />

(cor.‐non cor.)<br />

t‐value df p‐value<br />

Mean difference<br />

(cor.‐non cor.)<br />

t‐value df p‐value<br />

Applesauce 0.01 0.78 177 0.44 Cream yoghurt2 ‐0.02 ‐0.78 127 0.44<br />

Beer 0.15 6.87 81


Complementary Studies<br />

Figure 2.6: PCA performed on the standardized averaged ideal products<br />

In Figure 2.6, the first dimension is the particular case of the consumer 13645. A closer look at the data<br />

shows that this consumer 13645 had difficulties describing the products as can be seen <strong>by</strong> his raw perceived<br />

and ideal intensities represented in Figure 9a in the paper from <strong>Worch</strong> et al. presented in §2.1. Indeed, this<br />

consumer rated all the products with the same (low) perceived intensity ratings for all the attributes. <strong>The</strong><br />

corresponding standard deviations are very small (close to 0). Thus, the standardized averaged ideal ratings are<br />

very large.<br />

After removing this particular consumer from the analysis, the result presented Figure 2.7 is obtained.<br />

Figure 2.7: PCA performed on the standardized averaged ideal profiles after removing consumer 13645.<br />

Figure 2.7 shows the same size effect as previously on the first dimension. Since we are not interested in<br />

this size effect, the second and third dimensions are considered (Figure 2.8):<br />

54


2. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong> Method in Practice<br />

Figure 2.8: 2 nd and 3 rd dimensions of the PCA performed on the standardized averaged ideals (13645 excluded).<br />

In Figure 2.8, the second dimension opposes the ideal products described as fresh and fruity to the ideal<br />

products described with stronger oriental notes. <strong>The</strong> third dimension opposes the ideal products described as<br />

intense and woody to the ideal products described with sweet fruit notes. <strong>The</strong>se results are similar to the one<br />

obtained when the averaged ideals were only translated, except for a slight rotation between the dimensions 2<br />

and 3. Concerning the consumers’ ideals, the majority of the ideal points are still projected in the centre of the<br />

map. In other words, the dimensions still seem to be related to a low proportion of particular consumers.<br />

It should be noted that the projection as supplementary entities of the products tested is more spread in<br />

the ideal space. This is due to the standardization of the averaged ideal intensities: when the averaged ideal<br />

ratings are also standardized, the two products clouds (i.e. ideal products and products tested) are of similar<br />

size.<br />

In addition, the distribution of the contribution of each individual in the construction of the dimensions is<br />

compared in three conditions (Figure 2.9): the ideal profiles are corrected <strong>by</strong> translation only, the ideal profiles<br />

are standardized and the ideal profiles are standardized (after removing consumer 13645).<br />

Figure 2.9: Distribution of the contribution of each individual in the construction of the principal components in the case<br />

where the ideal information are translated, or standardized (with and without consumer 13645).<br />

55


Complementary Studies<br />

In Figure 2.9, it can be seen that in the three situations (translation only, standardization and<br />

standardization without consumer 13645), the contributions are low for the majority of the consumers. Indeed,<br />

they are mainly under 1%, except for a couple of consumers who have a high contribution (between 2 and<br />

25%) in each case. This is particularly true in the standardization case since one consumer alone (i.e. 13645)<br />

contributes to around 77%.<br />

Although the contribution is relatively low for the majority of consumers, the structure is stable since when<br />

we discard from the analysis the highly contributing consumers, we still keep the same structure of the ideal<br />

space. This result is not shown here.<br />

To complete the comparison between corrected and standardized ideal ratings, the criterion defined to<br />

measure the sensory consistency at the consumer level is also used here. <strong>The</strong> distributions of this criterion<br />

obtained with the raw, the corrected and the standardized ideal scores are compared in Figure 2.10.<br />

Figure 2.10: Distribution of the correlation coefficient measuring the sensory consistency at the consumer level using<br />

the raw, the corrected or the standardized ideal ratings.<br />

In Figure 2.10, it can be seen that both the corrected and standardized ideal return higher coefficient than<br />

the raw ideals. Hence, it is relevant to correct the ideal ratings. However, standardizing the ideal ratings doesn’t<br />

give better results than the corrected one. In the contrary, the corrected ideal scores tend to return higher<br />

correlation coefficient than the standardized one. Based on this criterion, it seems here that standardizing the<br />

ideal data according to the perceived intensity is not necessary.<br />

Although it is not shown here, the results obtained with the Perfume dataset were systematically obtained<br />

with the 23 other projects.<br />

2.2.2.4. Conclusion<br />

Correcting the ideal data for the differences in the use of the scale returned more relevant results at both<br />

the panel and consumer level. For all the projects, the non‐corrected ideal information obtained from<br />

consumers contained a part of noise related to consumers’ differences in their use of the scale. It also<br />

appeared that the ideal ratings are more relevant when they are compared to the perceived intensity ratings of<br />

the tested products. This is why it is advised to use the distance between the ideal and the perceived intensity<br />

56


2. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong> Method in Practice<br />

ratings. In that case, we position ourselves in a situation similar to JAR in which a distance between the<br />

perceived intensities of the tested products to an ideal point is rated. However, with JAR, the consumers are<br />

standardized based on their ideal point. On the contrary, with the IPM, the correction of the averaged ideal<br />

ratings proposed uses an averaged product (i.e. the averaged perceived intensity over the products for each<br />

attribute) as anchor point. <strong>The</strong> latter point seems more realistic as consumers don’t necessarily share the same<br />

ideal product while they should agree a maximum in their descriptions of the products.<br />

It can also be argued that consumers differ in the range of their ratings. In that matter, they should also be<br />

corrected If it seems interesting to standardize (in addition to the translation already performed) the averaged<br />

ideal ratings according to the range of the perceived intensity scores, this extra step seems not necessary. Since<br />

in both cases the results are similar, the decision whether or not it should be done depends on the point of<br />

view adopted <strong>by</strong> the user. For the rest of the document, the correction of the ideal data only involves the<br />

translation step.<br />

2.2.3. Extension of the uniqueness of the ideal ratings at the consumer level<br />

In the article presented in §2.1, the uniqueness of the ideal ratings provided <strong>by</strong> each consumer was<br />

measured at the consumer level through the variability of the ideal ratings for each attribute. <strong>The</strong> ratios of the<br />

sum of squares of the residuals were considered. For a consumer describing a unique ideal ratings, his/her<br />

corresponding ratio is expected to be lower than 1.<br />

Instead of using the sum of squares of the residuals, one could consider the standard deviation of the ideal<br />

ratings provided for each attribute <strong>by</strong> each consumer. Here again, the standard deviation in itself does not<br />

allow conclusions about the stability of the ratings. This is why it is compared to the standard deviation of the<br />

perceived intensity ratings provided for the same attribute <strong>by</strong> the same consumer. To facilitate the<br />

interpretation of the results, ratios between standard deviations are considered (Eq. 2.3).<br />

.<br />

(2.3)<br />

. <br />

In this case, since no hypothesis concerning the differences in standard deviations can be formulated, the<br />

raw values are directly compared through the ratio. To simplify the interpretation of the results, a threshold<br />

value of 1 is considered for this ratio. In this case, three situations are observed:<br />

1 :<br />

1 :<br />

1 :<br />

for the consumer j and the attribute a, the variability of the ideal ratings is lower than the<br />

variability of the tested products (expected).<br />

for the consumer j and the attribute a, the ideal ratings are as variable as the variability of<br />

the tested products (slightly problematic).<br />

for the consumer j and the attribute a, the variability of the ideal ratings is larger than the<br />

variability of the tested products (problematic).<br />

As previously, a consumer j rates a unique ideal for an attribute a if the corresponding is lower<br />

than 1. <strong>The</strong> individual ratios were calculated for each consumer and each attribute, within each project. <strong>The</strong><br />

distributions of these ratios are presented in Figure 2.11.<br />

For all the projects the majority of the consumers rates stable ideals. However, for some consumers and<br />

some attributes, this ratio is much larger than 1 meaning that either the consumers have difficulties rating their<br />

ideal, or they have different ideals’ intensities for those attributes.<br />

57


Complementary Studies<br />

Figure 2.11: Standard deviations’ ratios measuring the uniqueness of the ideal ratings for each consumer<br />

and each attribute for the different projects.<br />

Note: For graphical reasons, all ratios larger than 2 are forced at 2.<br />

<strong>The</strong> part of the analysis presented here involves the variability within consumers of the ideal data. <strong>The</strong><br />

study of the variability of the ideal data can also be extended between consumers. This procedure is presented<br />

in the next section.<br />

2.2.4. Extension of the typology of the consumers and attributes<br />

In the article presented in §2.1, it was shown that consumers don’t all share a similar ideal. This was shown<br />

<strong>by</strong> PCA performed on the corrected averaged ideal profiles .. . <strong>The</strong> ideal space thus obtained helped defining a<br />

typology of consumers as it positions the ones sharing similar ideals (i.e. going in the same sensory direction)<br />

together and apart from the ones having different ideals (i.e. going in another sensory direction). This typology<br />

of consumers was enriched <strong>by</strong> the projection of the tested products in this space as illustrative, each tested<br />

product being considered as a particular consumer who would have this product as ideal. By doing so, each<br />

group of similar consumers (i.e. sharing ideals going in the same sensory direction) could be characterized <strong>by</strong><br />

the tested products which are the closest to their common ideal.<br />

Although we checked that consumers don’t all share the same ideal, it remains to check how different<br />

these ideals are. To do so, the variability of the averaged ideal products is compared with the variability of the<br />

tested products. This corresponds to answer the following questions: Is the variability around the ideal profiles<br />

larger or smaller than the variability around the tested products? Do consumers’ ideals differ on all attributes<br />

or are there attributes for which a consensus concerning their ideal ratings could be found?<br />

At the consumer level, the variability of the ideal products is studied according to the variability of the<br />

tested products <strong>by</strong> projected as illustrative the products in the ideal space. For both the ideal and tested<br />

product sets, the standard deviation of the projections along each dimension is computed. <strong>The</strong> ratio of<br />

standard deviation is calculated (Eq. 2.4). Here again, no hypothesis concerning the standard deviation of the<br />

58


2. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong> Method in Practice<br />

projection along each dimension can be formulated. For that reason, a threshold value of 1 is considered for<br />

the ratio.<br />

<br />

<br />

<br />

<br />

<br />

<br />

(2.4)<br />

If this ratio is larger than 1, the ideal products provided <strong>by</strong> the consumers are more variable than the<br />

tested products. In that case, a segmentation of the consumers according to their ideal could be considered.<br />

On the contrary, if the ratio is lower than 1, the ideal products of the consumers are less variable than the<br />

tested products and a consensual ideal product might be found.<br />

Table 2.3 shows that for the 24 projects, the ratio is always larger than 1. <strong>The</strong> variability of the averaged<br />

ideal products provided <strong>by</strong> the consumers is larger than the variability of the tested products. For none of these<br />

projects, a consensual ideal product can be found between the consumers.<br />

project ratio dim1 ratio dim2 ratio dim3 project ratio dim1 ratio dim2 ratio dim3<br />

Applesauce 2,29 2,298 1,704 Cream yoghurt 2 1,365 2,109 2,224<br />

Beer 4,082 5,584 4,023 Ice cream 3,448 1,738 1,152<br />

Croissants 2,284 2,969 1,704 Soup 1 1,204 1,782 0,791<br />

Donuts 1 2,713 2,041 3,898 Soup 2 0,866 1,624 0,87<br />

Donuts 2 1,204 3,117 1,59 Flavoured water 2,315 2,635 2,232<br />

Licorice 3,993 5,717 0,839 Lemon water 2,467 3,976 2,617<br />

Coffee 3,216 2,005 3,674 Candy bar 3,504 4,174 4,055<br />

Meal salad 2,146 1,167 0,973 Vanilla dessert 2,122 1,822 2,122<br />

Water 2,34 1,276 1,826 Milk drink 1,902 1,572 1,843<br />

Perfume 3,309 1,32 2,163 Yoghurt 1 1,804 4,073 2,91<br />

Rye bread 6,26 2,894 1,014 Yoghurt 2 2,085 2,301 2,183<br />

Cream yoghurt 1 4,757 3,146 1,234 Organic yoghurt 1,55 2,873 1,13<br />

Table 2.3: Ratio between the variability of the ideal products projections and<br />

the variability of tested products projections on the first three dimensions of the ideal space.<br />

<strong>The</strong> typology of the consumers (through their ideal products) can be extended to a typology of the ideal<br />

attributes. To do so, the variability of the ideal profiles is compared to the variability of the sensory profiles of<br />

the tested products, for each attribute taken individually. In this case, the variability of the corrected averaged<br />

ideal ratings is compared to the variability of the perceived intensity ratings, for each attribute via the ratio of<br />

standard deviations (Eq. 2.5). For similar reasons as the one mentioned earlier, a threshold value of 1 is<br />

considered here.<br />

..<br />

(2.5)<br />

.. <br />

Three types of attributes can be observed (Figure 2.12):<br />

- the ideal ratings are more variable than the perceived intensity ratings (ratio larger than 1);<br />

- the ideal ratings are as variable as the perceived intensity ratings (ratio equal to 1);<br />

- the ideal ratings are less variable than the perceived intensity ratings (ratio smaller than 1).<br />

59


Complementary Studies<br />

perceived intensity for the attribute a<br />

ideal intensity for the attribute a<br />

1 j J<br />

1 j J<br />

1 j J<br />

attr. a<br />

attr. a<br />

attr. a<br />

delta>1<br />

delta=1<br />

delta


2. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong> Method in Practice<br />

Figure 2.14: Typology of the attributes for the perfume (left) and soup2 (right) projects.<br />

For all the projects, the variability of the ideal products provided <strong>by</strong> the consumers is larger than the<br />

variability of the tested products. In other words, the consumers’ expectation is larger than what the product<br />

market offers. In terms of product development, this means that it might be interesting to focus on segments<br />

of consumers and to create a consensual ideal product for each segment. Hence, diversifying the product<br />

market <strong>by</strong> creating many products (corresponding to the ideal of the different segments of consumers) might<br />

be a better solution than proposing one ideal that would try to satisfy a maximum of consumers.<br />

61


2.3. Conclusion


2. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong> Method in Practice<br />

<strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong> Method is a descriptive analysis performed <strong>by</strong> consumers who are asked to rate products<br />

on both their perceived and ideal intensity. At the end of the test, each consumer provides as much ideal<br />

ratings as perceived intensities. <strong>The</strong> differences between the ideal ratings obtained are due to several sources<br />

of variability, and the study of this variability across the 24 projects considered helps understanding the<br />

consumers and how they define their ideals. Since this particular information is consumer related (as opposed<br />

to the classical sensory information which is product related), it is important to correct the ideal ratings from<br />

the consumers’ differences in their use of the scale. To do so, several corrections have been proposed and<br />

justified through examples.<br />

Moreover, the study of the variability between products showed that the ideal ratings were positively<br />

influenced <strong>by</strong> the products. In other words, the more intense a product p on an attribute a, the more intense<br />

the ideal intensity for a. This is true for many attributes across projects. However, it has to be said that<br />

although this influence is observed, it is not very large.<br />

By studying the variability of the ideal ratings within consumers, we can see whether consumers rated an<br />

unique or multiple ideals. To do so, the variability of the ideal ratings is compared to the variability of the<br />

tested products. Additionally, the existence of an unique ideal for the product set studied can be extended at<br />

the panel level. This is done <strong>by</strong> measuring the stability of the averaged ideal ratings for each product tested.<br />

This information is particularly important for product optimization (see §4.1.2.). <strong>The</strong> application of this<br />

methodology to the 24 projects showed that in most cases, consumers provides close ideal ratings. However, in<br />

some cases, it can happen that consumers split the set of products in different sub‐categories, each subcategory<br />

being associated to a different ideal product. In this case, it is important to optimize the product<br />

according to the corresponding ideal. An example is given in the paper <strong>by</strong> <strong>Worch</strong> and Ennis entitled “A<br />

Complementary Approach to Product Optimization using Two <strong>Ideal</strong> Point Methods” presented §4.3.3.<br />

Finally, the study of the variability of the ideal ratings between consumers helps understanding the panel<br />

of consumers and eventually helps defining (and understanding) segments of consumers. <strong>The</strong> typology of<br />

consumers thus obtained can be enriched <strong>by</strong> the projection of the products tested on the ideal product space.<br />

This variability can also be evaluated more precisely <strong>by</strong> looking at each attribute separately. In every projects, it<br />

appears that the consumers differ strongly in their representation of the ideals. This suggests that<br />

segmentation might exist in the different projects<br />

In the following sections, the impact of the ideal profiles provided from consumers is evaluated. This<br />

impact is measured first through the consistency of the ideal profiles according to both the sensory and<br />

hedonic descriptions of the products (§3.), and second through the procedure used to guide products on<br />

improvement (§4.). This complete block of analyses (including checking for the consistency and the<br />

optimization procedure) for the ideal data that we propose is referred as the <strong>Ideal</strong> <strong>Profile</strong> Analysis (API).<br />

65


3. Consistency of the<br />

<strong>Ideal</strong> <strong>Profile</strong>s


3. Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

By definition, an ideal is a conception of something in its absolute perfection. It is regarded as a standard<br />

or model of perfection, or an ultimate object of endeavor. It is considered as the best of its kind. By extension<br />

to sensory analysis, an ideal product can be defined as product with a particular sensory profile which would<br />

maximize liking. In other words, the ideal product is defined <strong>by</strong> two main characteristics: its sensory profile and<br />

its liking.<br />

During a test performed according to the IPM, consumers are asked to rate their ideal intensities, this<br />

information being used for the procedure of optimization. Since this information is obtained from consumers<br />

who are rating fictive products, its value is questionable. For that reason, it seems important checking for the<br />

consistency of the ideal profiles before use. This procedure is done in two independent steps, 1) checking for<br />

the consistency in terms of perception and 2) checking for the consistency in terms of liking. <strong>The</strong> following<br />

section is articulated around these two concepts: the consistency of the sensory part referred as the sensory<br />

consistency of the ideal profile and the consistency of the liking ratings referred as the hedonic consistency of<br />

the ideal profile.<br />

<strong>The</strong> sensory consistency of the ideal profiles is defined according to both the sensory and hedonic<br />

descriptions: the sensory profile of an ideal product is considered (sensory) consistent if it goes in the same<br />

sensory direction as the profile of the most liked product. At the attribute level, this means that consumers<br />

who gave a higher liking rating to the products they perceived as sweeter also described their ideal as rather<br />

sweet. <strong>The</strong> hedonic consistency of the ideal profiles is defined according to the hedonic description. An ideal<br />

profile is (hedonic) consistent if it would get a higher liking rating than the tested products, if it happens to<br />

exist. Indeed, the ideal profile provided <strong>by</strong> a consumer should correspond to a product that is more liked than<br />

the tested products.<br />

69


3.1. Sensory Consistency of<br />

the <strong>Ideal</strong> <strong>Profile</strong>s


3. Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

<strong>The</strong> methodology checking for the sensory consistency is presented in the paper from <strong>Worch</strong>, Lê,<br />

Punter, and Pagès (2012) entitled “Assessment of the consistency of the ideal profiles according to nonideal<br />

data for IPM” and published in Food Quality and Preference. <strong>The</strong> methodology developed in this<br />

paper is extended to the use of L‐PLS presented in the second part of the next section.<br />

3.1.1. Assessment of the consistency of the ideal profiles<br />

Journal:<br />

Title:<br />

Food Quality and Preference<br />

Assessment of the consistency of ideal profiles according to non‐ideal data for IPM.<br />

Authors: <strong>Worch</strong>, T., Lê, S., Punter, P., & Pagès, J.<br />

Abstract:<br />

Keywords:<br />

Reference:<br />

<strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong> Method is a sensory method, in which consumers are asked to<br />

describe both the perceived and the ideal intensities on a list of attributes, as well as<br />

answering acceptance questions for each product tested. At the end of test, one gets<br />

from each consumer three blocks of data: the product profiles, their ideal profile and the<br />

acceptance scores of the products.<br />

<strong>The</strong> ideal profiles can be used to help improving the existing products. But before<br />

using the ideals, one has to assess the consistency of such data <strong>by</strong> comparing them to the<br />

other descriptions provided (sensory and hedonic). This consistency is defined <strong>by</strong><br />

answering two major questions: 1) Are the ideal descriptions in agreement with the<br />

other descriptions? 2) Would the ideal products obtained be more appreciated than the<br />

products tested?<br />

<strong>The</strong> assessment for consistency of the ideals is performed at both the panel and the<br />

consumer level. In the perfume example used for illustration, it appears that the panel is<br />

globally consistent, although individual consumers show more variability.<br />

Consumer, <strong>Ideal</strong> <strong>Profile</strong> Method, Consistency, <strong>Ideal</strong>s, Sensory profiles, Hedonic scores,<br />

Multivariate analysis<br />

<strong>Worch</strong>, T., Lê, S., Punter, P., & Pagès, J. (2012). Assessment of the consistency of ideal<br />

profiles according to non‐ideal data for IPM. Food Quality and Preference, 24, 99‐110.<br />

73


3.1. Sensory Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

1. Introduction<br />

For food companies, sensory analysis is an important stage in product development. It provides a better<br />

understanding of how products are perceived and appreciated <strong>by</strong> consumers. With this information the sensory<br />

drivers of liking can be defined and existing products can be improved. <strong>The</strong> final aim is to estimate the profile of the<br />

ideal<br />

product<br />

1 for a target group of consumers. Because the notion of an ideal product is important for the food industry,<br />

many statistical methodologies have been developed in order to link sensory to hedonic data. Examples are external<br />

preference mapping (PrefMap, Carroll, 1972; Greenhof & MacFie, 1994), Landscape Segmentation Analysis (LSA,<br />

Ennis & Anderson, 2003; Ennis, 2004), Euclidean Distance <strong>Ideal</strong> Point Mapping (EDIPM, Meullenet, Lovely, Threlfall,<br />

Morris & Striegler, 2008) and Unfolding (Coombs, 1964). Through the years, these methodologies have been used<br />

for a large number of projects, dealing with any kind of product.<br />

Gradually, the use of these methodologies became routine: sensory information from trained panels or experts<br />

is linked to consumer liking, and ideals are estimated statistically thanks to the above mentioned models. However,<br />

sensory and ideal profiles can also be asked directly from the target consumers and we have seen an increase in the<br />

use of methodologies which integrate the measurements of the ideal intensity within the data collection.<br />

In the case of Just About Right scaling (JAR, Rothman & Parker, 2009), consumers rate the perceived intensities<br />

for a product relative to their ideal. <strong>The</strong>y indicate whether the perceived intensity is ideal (or JAR), too intense (too<br />

much) or not intense enough (too little) for a number of sensory attributes.<br />

Alternatively, the ideal intensity can be rated explicitly, as in the case of the <strong>Ideal</strong> <strong>Profile</strong> Method (IPM). Here,<br />

the consumers rate both their perceived and ideal intensities for each product and each attribute. This results in a<br />

perceived profile as well as an ideal profile for each product tested.<br />

<strong>The</strong> ideals obtained from the different methodologies have been compared on several occasions. Van Trijp,<br />

Punter, Mickartz & Kruithof (2007) gave positive arguments concerning the stability of the description of the ideal<br />

product obtained <strong>by</strong> different methodologies (PrefMap, JAR and IPM [presented as the variant method]). Lovely &<br />

Meullenet (2009) have shown that yoghurts synthesized on the bases of ideals obtained <strong>by</strong> JAR or estimated<br />

through PrefMap, EDIPM or LSA are similar, especially on attributes that drive liking. Moreover, the synthesized<br />

products were not significantly differently liked. <strong>The</strong>refore, the stability of the ideal products highlighted through<br />

these studies seems to validate the use of such methodologies to obtain a direct or indirect description of the ideal<br />

product from consumers.<br />

Because of its simplicity, the JAR scale has been more frequently used than the IPM. But although practitioners<br />

apply this methodology, it has been criticized for the following reasons: (1) the uncertainty that consumers<br />

understand the attributes correctly (Stone & Sidel, 1985), (2) the risk that the descriptions of the ideal products are<br />

too far from the actual products since consumers always want more (Issanchou, 2009), (3) the risk of influencing the<br />

liking description of the products <strong>by</strong> adding JAR questions (Popper, Rosenstock, Schraidt & Kroll, 2004). Epler,<br />

Chambers IV & Kemp (1998) have shown that the ideal sugar content of lemonade is better estimated from the<br />

hedonic judgments alone than in combination with the JAR scale.<br />

As it is more frequently used in practice, the above mentioned criticisms concern primarily the JAR scale. But<br />

since the IPM also use consumers to measure ideal intensities, those criticisms can be extended to this<br />

methodology.<br />

Despite the criticisms, the use of the JAR scale intensified over time. Several more or less complex statistical<br />

methodologies have been developed to analyze JAR data (from the simple counting table through Penalty Analysis<br />

to Multivariate analysis, Meullenet, Xiong & Findlay, 2007). During the 5th Pangborn meeting (Boston, Ma, USA, July<br />

2003), an entire workshop has been dedicated to the analysis of JAR data (Workshop summary, 2004). Lesniauskas<br />

& Carr (2004) concluded that an analysis of JAR data should answer the three key questions: (1) Are some products<br />

more JAR than others? (2) If the product is not JAR, in which direction should it be moved? (3) How much is<br />

acceptance affected when a product is not JAR?<br />

For the IPM, one can fear that describing their ideals on a large set of attributes is a difficult task for consumers.<br />

Hence, the ideal profiles obtained with IPM will contain noise, as the consumers might answer randomly to the<br />

questions about their ideal, with the consequences that these ideal profiles could be in disagreement with the<br />

sensory/hedonic descriptions of the products which the consumers provided.<br />

Since the ideal descriptions play an important role in the process of product improvement, one has to be sure<br />

that they are reliable and valid. Hence, in order to avoid any misinterpretation, it is important to ensure a priori the<br />

quality of the ideal data. Although this verification step seems important, in practice it has often been forgotten.<br />

Gacula, Rutenbeck, Pollack, Resurreccion & Moskowitz (2007) have tried to better understand whether consumers<br />

consider the JAR level as related to acceptance or preference for the products. In their paper, Van Trijp & al. (2007)<br />

1 <strong>The</strong> ideal product is defined as being a product with particular sensory characteristics, which would maximize<br />

liking for the group of consumers considered.<br />

74


3. Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

proposed a quick validation of the ideal descriptions obtained with IPM. But since the validation step is not the main<br />

purpose of those papers, it is often either absent, or incomplete.<br />

<strong>The</strong>refore, the authors want to propose a methodology to check for the reliability of the ideal descriptions<br />

obtained from consumers <strong>by</strong> IPM. This check is done in two steps: (1) <strong>by</strong> checking the consistency of the ideal<br />

descriptions provided <strong>by</strong> consumers with the sensory profiles and hedonic judgments they also provided and (2) <strong>by</strong><br />

verifying that the ideal products described <strong>by</strong> consumers would be more appreciated than the tested products<br />

actually are.<br />

<strong>The</strong>se checks are necessary if we want to use the ideal descriptions as guidance for improvement.<br />

2. Notation<br />

Let P denotes the number of products tested, A the number of attributes used to describe the products and J<br />

the number of consumers used for the test.<br />

Let’s recall that in the IPM, each consumer rates each product tested on both perceived and ideal intensity for a<br />

set of attributes. In practice, for the attribute sweetness, if the first question asked is “how sweet is this product?”<br />

the second would be “what would be your ideal sweetness for this product?” At the end of the test, one will get as<br />

many ideal profiles as sensory profiles from each consumer.<br />

In this paper, the following notation will be used to describe the data obtained from IPM (the vectors are in<br />

bold):<br />

: intensity perceived <strong>by</strong> the consumer j for the product p and the attribute a;<br />

. ; 1: : vector or intensities perceived <strong>by</strong> the consumer j for the P products and the attribute a;<br />

. : average over the index p; average intensity perceived <strong>by</strong> the consumer j on attribute a over the P products.<br />

(Table 1)<br />

.<br />

Consumer j Attribute 1 … Attribute a … Attribute A<br />

Product 1<br />

…<br />

Product p <br />

…<br />

Product P<br />

.<br />

Table 1: Organization and illustration of the notation for the sensory data.<br />

: ideal intensity of the attribute a provided <strong>by</strong> the consumer j after testing the product p;<br />

. ; 1: : vector of ideal intensities of the attribute a provided <strong>by</strong> the consumer j for the P<br />

products;<br />

.: average over the index p; average ideal intensity of the attribute a provided <strong>by</strong> the consumer j over the P<br />

products.<br />

: hedonic judgment provided <strong>by</strong> the consumer j for the product p;<br />

. ; 1: : vector of hedonic judgments provided <strong>by</strong> the consumer j for the P products.<br />

In practice, although we have P descriptions of the ideal profiles per consumer, we only are interested in the<br />

averaged ideal profile per attribute . for each consumer.<br />

This averaged ideal profile is corrected for the different use of the scale <strong>by</strong> centering the consumers’ ideal<br />

profile according to their averaged perceived intensities. In practice, this is done <strong>by</strong> subtracting the averaged<br />

perceived intensities over the P products for each consumer and each attribute from his averaged ideal profile<br />

(Equation 1). This implies that the corrected ideal descriptions given <strong>by</strong> consumers correspond to their ideal<br />

descriptions relatively to their averaged perception of the products. Hence, each consumer is associated with an<br />

ideal profile rated in function of his/her averaged perceived intensity.<br />

This ideal profile corrected is noted ̃...<br />

̃. . . (1)<br />

75


3.1. Sensory Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

3. Material and Methods<br />

3.1. Material:<br />

In order to illustrate the methodology presented below, the dataset presented <strong>by</strong> <strong>Worch</strong>, Lê & Punter (2010) is<br />

used. It concerns 12+2 luxurious women perfumes (Table 2). Each product has been rated on 21 attributes (listed in<br />

Table 2) <strong>by</strong> 103 Dutch consumers. For each perfume and each attribute, both the perceived and ideal intensities<br />

have been rated on 100mm line scales. After rating each product on perceived and ideal intensity, they rated their<br />

overall liking on a structured 9 point category scale.<br />

<strong>The</strong> 14 samples were presented in a sequential monadic order, taking care of order and carry over effects<br />

(MacFie, Bratchell, Greenhoff & Vallis, 1989) in two 1 hour sessions (7 products being presented in each session).<br />

Products Type Attributes<br />

Angel Eau de Parfum Intensity Spicy<br />

Cinema Eau de Parfum Freshness Woody<br />

Pleasures Eau de Parfum Jasmine Leather<br />

Aromatics Elixir Eau de Parfum Rose Nutty<br />

Lolita Lempicka Eau de Parfum Chamomile Musk<br />

Chanel N⁰5 Eau de Parfum Fresh lemon Animal<br />

L’Instant Eau de Parfum Vanilla Earthy<br />

J’Adore (EP) Eau de Parfum Citrus Incense<br />

J’Adore (ET) Eau de Toilette Anis Green<br />

Pure Poison Eau de Parfum Sweet fruit<br />

Shalimar Eau de Toilette Honey<br />

Coco Mademoiselle Eau de Parfum Caramel<br />

Table 2: List of products and attributes.<br />

Note: during the test, the products Pure Poison and Shalimar were duplicated.<br />

3.2. Methods: consistency of the ideal data<br />

<strong>The</strong> consistency of the ideal data is checked according to two questions:<br />

1) Are the ideal descriptions provided <strong>by</strong> a consumer consistent with his perception and appreciation of the<br />

products?<br />

2) Is the ideal description obtained from a consumer potentially an ideal product? In other words, would it<br />

be more appreciated than the products, if it would exist?<br />

Because the consistency can be separated into two points, the checking process should also be done in two<br />

steps: first <strong>by</strong> checking the consistency of the ideal profiles according to the descriptions of the products, and<br />

second <strong>by</strong> comparing the estimated liking scores for the ideal products to the actual liking scores given to the<br />

products.<br />

In both cases, the checking process is done at the global level (panel) and at the individual level (consumer).<br />

3.2.1. <strong>Ideal</strong> descriptions vs. Sensory and Hedonic descriptions<br />

In this part, we define the consistency with respect to the sensory and hedonic descriptions. <strong>The</strong> sensory profile<br />

of an ideal product is considered consistent if it shares the same characteristics as the profile of the most<br />

appreciated product. If we consider it at the attribute level, this means that consumers who prefer the products<br />

they perceived as sweeter also describe their ideal as rather sweet. If, for a given consumer, the hedonic scores<br />

given to the products are represented in function of the perceived intensity for each attribute, the ideal description<br />

is consistent if it is given in the area of maximum acceptance of the product. In order to validate the ideal data, this<br />

relationship between hedonic, sensory and ideal descriptions should be observed on all attributes.<br />

3.2.1.1. Consistency at the panel level<br />

In the relationship between hedonic, sensory and ideal, the link is made through the ideal. Indeed, the ideal<br />

product can be defined as a product with particular sensory characteristics which maximize the hedonic judgment.<br />

In order to analyze the relationship between hedonic, sensory and ideal, we first put our attention on the<br />

consumers through their ideal descriptions. To do so, the consumers are represented together in the same space<br />

according to their ideal profiles. In this ideal space, one might be interested in defining groups of consumers sharing<br />

similar ideals, each group being characterized <strong>by</strong> using simultaneously the sensory and the hedonic descriptions of<br />

the products. To do so, each group is associated on one hand to the products with the closest profiles (sensory) and<br />

on the other hand to the most appreciated products (hedonic). Finally, the ideal descriptions are consistent if a<br />

group with similar ideals is associated to the same products seen through sensory and hedonic.<br />

76


3. Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

In practice, the ideal data are aggregated to the two other blocks of data (hedonic on one hand, sensory on the<br />

other hand, see Table 3), and the tables (ideal, sensory and acceptance) are analyzed 2 <strong>by</strong> 2. First, the ideal product<br />

space is created. Next, the link between ideal profiles and hedonic judgments is studied. In this case, each group of<br />

consumers sharing a similar ideal is linked to the products they prefer. Next, the link between ideal descriptions and<br />

the sensory profiles of the products is studied. <strong>The</strong> consumers are then linked to the products for which their<br />

sensory profiles are similar to their average ideal profile. Finally, the link between hedonic judgment and sensory<br />

profile, within the ideal product space, is measured. This link is strong if consumers, whose ideal profiles are close to<br />

the sensory profile of a product p, are also the consumers who prefer p. It can be measured through the relative<br />

position of the corresponding product obtained from the different blocks of data (sensory or hedonic), within the<br />

ideal product space.<br />

Attr. 1 … Attr. a … Attr. A Product 1 h … Product p h … Product P h<br />

Consumer 1<br />

…<br />

Consumer j ̃. .<br />

…<br />

Consumer J (a) (b)<br />

Product 1 d<br />

…<br />

Product p d<br />

. ..<br />

…<br />

Product P d<br />

(c)<br />

Table 3: Consistency between ideal, sensory and hedonic data.<br />

a represents the corrected average ideal profiles provided <strong>by</strong> consumers (active).<br />

b represents the hedonic judgments of the actual products (supplementary variables).<br />

c represents the sensory profile of the actual products (supplementary entities).<br />

In practice, the ideal product space is obtained <strong>by</strong> performing a Principal Components Analysis on the table of<br />

corrected average ideal profiles (Table 3a). In this analysis, one statistical entity represents the corrected average<br />

ideal profile from a consumer.<br />

In this ideal product space, the hedonic judgments of the products are projected as supplementary variables.<br />

This vector of hedonic judgments (noted p h ) is centered <strong>by</strong> consumer. Hence, each supplementary variable<br />

represents the preference for one product (Table 3b). In this analysis, the link between ideal and hedonic data is<br />

measured through the correlation coefficient between the ideal intensities of each attribute and the preference for<br />

each product. If the supplementary variable p h (i.e. corresponding to the preference for the product p) is highly<br />

correlated with the ideal attribute a, the more the ideal profile has a high score for the attribute a, the more the<br />

consumer prefers p compared to the other products.<br />

Simultaneously, the sensory profiles of the products (noted p d ) are projected as supplementary entities in the<br />

ideal product space (Table 3c). In this case, each product is considered as a particular consumer who would have<br />

the product under consideration as ideal. <strong>The</strong> link between the ideal profiles and the products is measured <strong>by</strong> the<br />

distance in the space: a consumer, whose ideal is close to a product p d in the ideal product space, described an ideal<br />

profile which is close to the sensory profile of the product p d .<br />

Finally, from the panel point of view, the consistency of the ideal data is measured through the direct<br />

correspondence between identical entities (i.e. the products) described according to their liking or sensory aspects<br />

within the ideal product space. If the relationships between ideal data and hedonic judgments (Table 3a and 3b), or<br />

ideal data and sensory descriptions (Table 3a and 3c) are evident, there is no formal link between hedonic<br />

judgments and sensory descriptions of the products (Table 3b and 3c). However, empirically, one can expect that<br />

consumers who said to appreciate a product p h more should also describe their ideal profile as closer to the sensory<br />

profile of p d then to any other product. Similarly, from the sensory point of view, if the preference of a product p h is<br />

strongly correlated to the description of the ideal attribute a, one can expect that the product p h should be<br />

described as more intense on that attribute a than the other products. In both cases, if the different descriptions<br />

are consistent with each other, the projection in the ideal product space of the product p d will be closer to the ideal<br />

of consumers who preferred p h to the other products.<br />

An illustration based on a simple example is given in Appendix.<br />

Remark: Only linear relationships between ideal data and the other descriptions (sensory and hedonic) are<br />

computed: the quadratic relationships are not taken into consideration here.<br />

3.2.1.2 Consistency at the consumers’ level<br />

In order to check the consistency at the consumers’ level, we will check that, for each consumer, his drivers of<br />

liking (resp. disliking) correspond to the attributes for which his expectations in terms of ideal intensities are high<br />

(resp. low).<br />

77


3.1. Sensory Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

To do so, a table with of drivers of liking/disliking is calculated and will be compared to ideal profiles. For this<br />

<br />

comparison, the correlation coefficient ,,<br />

between the averaged corrected ideal profile and the vector of drivers<br />

of liking/disliking is calculated for each consumer (Equation 2).<br />

In practice, the table of drivers of liking/disliking is obtained <strong>by</strong> measuring for each consumer and each attribute<br />

the correlation coefficient . ; between his perceived intensities and his appreciation of the product. This<br />

coefficient is high and positive if the consumer in question has a higher appreciation for the products with a high<br />

intensity for the attribute considered as a driver of liking. Inversely, it is high and negative if the consumer in<br />

question has a lower appreciation for the products with a strong intensity for that attribute, considered then as a<br />

driver of disliking. Likewise, it is close to 0 if that attribute doesn’t influence his appreciation of the products.<br />

Remark: If for an attribute a, some products are considered as not intense enough while some others are too<br />

intense on a, a saturation effect is observed. In this case, our methodology will show some limitation. In the<br />

empirical situation where all the products tested are defined on one side only of the saturation curves, the<br />

methodology proposed is suitable.<br />

<br />

,,<br />

. ; ; . (2)<br />

with . ; the vector of drivers of liking/disliking associated to the consumer j and . his average<br />

corrected ideal profile.<br />

As the ideal description is making the link between sensory and hedonic, one can expect that a consumer<br />

associates a strong ideal intensity (resp. weak) to the drivers of liking (resp. drivers of disliking). Hence, the<br />

<br />

consumers are consistent if they are associated to a coefficient ,,<br />

close to 1.<br />

For simplicity, only linear relationships are considered at first in this methodology. This is in agreement with the<br />

consistency at the panel level which only uses linear combination via PCA. But if necessary, this methodology can be<br />

extended <strong>by</strong> considering quadratic relationships as well. To do so, the use of dummy variables is proposed (see<br />

Xiong & Meullenet, 2006).<br />

3.2.2. <strong>Ideal</strong> liking scores vs. Hedonic scores<br />

In this part, we define the consistency of the ideal data in relation to liking scores. By definition, ideal data<br />

obtained from IPM are consistent with respect to hedonic scores if the hedonic scores given to the ideal products<br />

are higher than the hedonic scores given to the products themselves.<br />

In practice, the liking scores assigned to the ideal products are unknown. Hence, they must be estimated.<br />

<strong>The</strong>refore, for each consumer, a model expressing his liking in function of his perception of the products is<br />

estimated. In <strong>Worch</strong> & al. (2010), many types of models have been compared. In this paper, to be consistent with<br />

the previous analyses, we limit ourselves to the particular case of PLS regression, where only linear effects are<br />

considered (Equation 3).<br />

(3)<br />

In this model which is associated to the consumer j, µ represents the constant, the residual and the<br />

weight of the attribute a on overall liking for j. Three cases occur:<br />

‐ 0, attribute a is considered as a driver of liking for j;<br />

‐ 0, attribute a is considered as a driver of disliking for j;<br />

‐ 0, attribute a is not considered as driving of liking/disliking for j.<br />

Because the ideal profiles are described with the same attributes as the products, one can apply for each<br />

consumer his description of the average ideal product to his corresponding individual model. This allows the<br />

estimation of the liking score |.. of the ideal profile provided <strong>by</strong> the consumer considered. This estimated liking<br />

score |.. is then compared to the liking scores given to the products <strong>by</strong> the same consumer. One can expect<br />

to have an estimated liking score |.. which is higher than the liking scores given to the products.<br />

3.2.2.1. Consistency at the panel level<br />

Globally, the distribution of the hedonic scores assigned to the products is compared to the estimated hedonic<br />

scores associated to the ideal products. This comparison gives an overall idea whether the panel is consistent or<br />

not. Here, one can expect that the estimated hedonic scores are globally distributed on a higher part of the scale<br />

than the hedonic scores given to the products.<br />

3.2.2.2 Consistency at the consumers’ level<br />

<strong>The</strong> comparison can also be done individually. In that case, we check whether or not the estimation of the<br />

hedonic score related to the ideal profile from a consumer is higher than the hedonic scores he assigned to the<br />

products.<br />

78


3. Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

In practice, in order to simplify the presentation of the results, the estimated liking scores associated to the<br />

ideal profiles are centered and standardized according to the mean and standard deviation of the liking scores given<br />

to the products. For each consumer, the mean . and standard deviation of the liking scores are calculated<br />

over the set of products. <strong>The</strong> mean . is then subtracted from the estimated liking score |.. for the average ideal<br />

profile. This difference is divided <strong>by</strong> the standard deviation (Equation 4).<br />

.. |.. . <br />

(4)<br />

<br />

In this analysis, the quality (in terms of fit) of the individual model is important. Hence it must be taken into<br />

account while measuring the hedonic scores of the ideal profiles. Here, the goodness of fit is measured through the<br />

R² coefficient associated with the individual models. <strong>The</strong>refore, the standardized estimations |.. of the ideal<br />

profiles are graphically represented in function of the R² of the individual models. For consumers who have a low R²<br />

(R² < 0.5), no conclusion can be drawn concerning their ideal profiles. This low R² can either be explained <strong>by</strong> the lack<br />

of variability in the liking scores, or <strong>by</strong> the incompleteness of the model which doesn’t consider non‐linear<br />

relationship between sensory and hedonic for the consumer considered. However, for consumers with good fitting<br />

models (R²≥0.5), two scenarios can be observed: (1) the standardized estimation is low and the ideal profile<br />

provided from that consumer cannot be considered as consistent; (2) the standardized estimation is high and the<br />

ideal profile provided from that consumer can be considered as consistent.<br />

In addition, since the consumers describe their ideal profiles equally often as they test products, one can<br />

estimate the liking score for each ideal description provided. <strong>The</strong> liking score given to each product can be then<br />

compared to the estimated liking score |.. of the ideal profile described after testing the product considered. For<br />

each consumer, the number of times the estimated liking score for the ideal product related to a product p is<br />

greater than the actual liking score of that product p is counted.<br />

4. Results<br />

4.1. Consistency of the ideal data:<br />

4.1.1. <strong>Ideal</strong> descriptions vs. Sensory and Hedonic descriptions<br />

As mentioned earlier, the consistency of the ideal data is measured <strong>by</strong> the link between the ideal, the sensory<br />

and the hedonic descriptions.<br />

4.1.1.1. Consistency at the panel level<br />

To do so, first the ideal product space is created <strong>by</strong> PCA performed on the table of corrected average ideal<br />

profiles (Table 3a). <strong>The</strong> Figure 1a shows that most of the ideal profiles are projected in the center of the graphic.<br />

Due to the transformation considered, the center of the graphic corresponds to the average perception of the<br />

products for every consumer. Hence, most consumers share a common ideal, which is close to the products tested<br />

as their ideal descriptions are close to their averaged perceived intensities. Still, some ideal profiles are specific for<br />

the first or second dimension. This means that some consumers have a different ideal from the others (for example<br />

consumers 13645 and 8588).<br />

Figure 1: <strong>Ideal</strong> product space (left, a) and correlation circle associated (right, b) obtained <strong>by</strong> PCA.<br />

79


3.1. Sensory Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

<strong>The</strong> correlation circle associated to this ideal product space (Figure 1b) highlights that all attributes are highly<br />

positively correlated with the first dimension. This means that the first dimension opposes consumers who have an<br />

ideal which is more intense for all attributes (positive side of the first dimension) while some others have an ideal<br />

which is less intense on all attributes (negative side of the first dimension). This is also called size effect along the<br />

first dimension of the PCA. Because the ideal profiles have been corrected for the difference in use of the scales,<br />

this size effect is only related to the consumers’ expectations. Thus, the first dimension opposes consumers (i.e.<br />

13645) with an ideal more intense on all attributes and consumers (i.e. 2909) having as ideal a discrete perfume (i.e.<br />

a perfume less intense on all attributes) (Table 4).<br />

<strong>The</strong> second dimension opposes the attributes with fresh and fruity connotations to attributes with oriental<br />

connotations. Hence, the second dimension of the PCA opposes consumers (i.e. 8588) with an ideal with strong<br />

fresh and fruity notes to consumers (i.e. 13618) with an ideal with strong oriental notes (incense, leather, earthy).<br />

2909 13645 8588 3541 13618 Angel J'Adore (EP)<br />

Intensity ‐3,46 15,93 3,58 ‐3,97 ‐6,24 7,60 ‐1,28<br />

Freshness ‐17,79 11,96 22,37 8,63 ‐12,30 ‐8,69 9,09<br />

Jasmin ‐7,93 21,12 18,98 ‐6,18 9,54 ‐3,73 0,93<br />

Rose ‐10,93 29,34 ‐5,61 5,63 ‐12,60 ‐5,04 4,03<br />

Camomille ‐7,71 25,21 9,26 ‐4,71 2,25 0,42 ‐1,00<br />

Fresh lemon ‐10,76 34,65 37,13 18,23 ‐5,79 ‐6,40 5,50<br />

Vanilla ‐5,87 23,95 18,73 8,43 5,70 4,95 ‐1,51<br />

Citrus ‐9,25 27,10 26,21 4,43 ‐4,01 ‐1,55 4,68<br />

Anis ‐19,33 34,50 ‐13,58 ‐2,01 4,99 4,42 ‐1,06<br />

Sweet Fruit ‐9,13 24,73 36,55 ‐6,18 4,95 ‐2,13 7,60<br />

Honey ‐17,84 34,63 ‐5,86 ‐1,56 11,37 8,39 ‐0,23<br />

Caramel ‐6,67 28,03 14,30 7,81 5,20 8,20 ‐0,99<br />

Spicy ‐14,77 26,71 ‐12,69 ‐2,72 2,06 5,22 ‐5,63<br />

Woody ‐7,56 16,95 ‐38,42 2,59 15,15 8,90 ‐4,80<br />

Leather ‐12,13 12,03 ‐22,71 0,53 15,26 8,03 ‐4,06<br />

Nutty ‐6,62 28,57 17,97 3,67 10,85 6,32 ‐3,56<br />

Musk ‐15,67 31,71 ‐40,13 ‐1,01 8,30 6,17 ‐6,02<br />

Animal ‐6,90 7,62 ‐9,41 ‐8,33 12,48 6,90 ‐3,60<br />

Earthy ‐11,59 9,59 ‐21,91 2,42 15,01 7,59 ‐3,69<br />

Incense ‐11,81 33,80 ‐34,61 ‐4,64 5,60 5,53 ‐5,22<br />

Green ‐23,92 32,14 8,55 ‐4,60 ‐7,40 ‐4,11 5,43<br />

Table 4: Corrected average ideal profiles provided from consumers 2909, 13645, 8588, 354, and 13618 and<br />

centered profiles from the actual products Angel and J’Adore (EP).<br />

<strong>The</strong> liking ratings (Table 3b) of the products are not well projected as supplementary variable on the first<br />

dimension. <strong>The</strong> squared correlation coefficients associated with these projections on the first dimension are low<br />

(between 0 and 0.06) showing a poor quality of representation. This means that there is no linear link between<br />

preferences and the ideal descriptions along the first dimension. Thus, no particular preference pattern can be<br />

observed for consumers who described their ideal with stronger/weaker notes for all attributes.<br />

On the second dimension, the projection of these liking ratings is much better (Figure 2): for that dimension, the<br />

squared correlation coefficients are between 0 and 0.3 showing a linear relationship between the ideal descriptions<br />

and the preferences of the products.<br />

80


3. Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

Figure 2: Projection as supplementary variables of the hedonic judgments (set as preference)<br />

given to the actual products.<br />

Similarly, the sensory profiles of the products (Table 3c) are projected as supplementary entities onto the ideal<br />

product space (Figure 3). Here, each product p is considered as a particular consumer, who would have p as an<br />

ideal. Again, the projection of the product only occurs along the second dimension. Indeed, the consumers who<br />

describe their ideal with stronger/weaker intensities on all attributes cannot be characterized <strong>by</strong> any particular<br />

product as none of them is stronger/weaker than all the other products on all attributes. Hence, the products are<br />

associated with a low quality of representation of the products along the first dimension (cos² is between 0 and<br />

0.36). <strong>The</strong> ideal profiles described <strong>by</strong> these consumers have different characteristics than the products.<br />

Figure 3: Projection as supplementary entities of the actual product profiles.<br />

Because the first dimension is not linearly related to hedonic, it will be discarded from the analysis. Hence, the<br />

second and third dimension of the PCA are considered (Figure 4).<br />

81


3.1. Sensory Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

Figure 4a (left): Correlation circle associated to the 2 nd and 3 rd dimensions of the ideal space.<br />

Figure 4b (right): 2 nd and 3 rd dimensions of the ideal space<br />

Note: in blue are represented the projections as supplementary of the sensory profiles of the products.<br />

On the second dimension (Figure 4a), the projection of the hedonic ratings shows some preference patterns.<br />

<strong>The</strong> consumers who described their ideal with strong fresh and fruity notes prefer the products J’Adore and Pure<br />

Poison while the consumers who described their ideal with stronger oriental notes prefer the products Shalimar and<br />

Angel (Table 5). On the negative side of the third dimension, we can see that the consumers who described their<br />

ideal with strong vanilla, honey and caramel notes also prefer the products Lolita Lempicka and Cinema.<br />

<strong>The</strong> projection of the sensory profiles of the products as supplementary entities on the space (Figure 4b) locate<br />

the products Shalimar, Angel and Aromatics Elixir on the negative side of the second dimension. <strong>The</strong>y are opposed<br />

to the products J’Adore, Pleasures and Coco M elle . On the third dimension, the projections locate the products Lolita<br />

Lempicka, Angel and Cinema on the negative side of the third dimension; they are opposed to Aromatic Elixir, Coco<br />

M elle and Chanel N°5.<br />

8588 13618<br />

Angel<br />

2<br />

7<br />

Aromatics Elixir<br />

1<br />

7<br />

Chanel N°5<br />

1<br />

2<br />

Cinema<br />

7<br />

8<br />

Coco M elle 9 3<br />

J'Adore (EP)<br />

9<br />

3<br />

J'Adore (ET)<br />

9<br />

6<br />

L'Instant<br />

2<br />

8<br />

Lolita Lempicka<br />

4<br />

7<br />

Pleasures<br />

6<br />

6<br />

Pure Poison<br />

7<br />

6<br />

Pure Poison 2<br />

7<br />

4<br />

Shalimar<br />

1<br />

7<br />

Shalimar 2<br />

1<br />

7<br />

Table 5: Hedonic scores given <strong>by</strong> the consumers 8588 and 13618 to the actual products.<br />

Please note that no products are projected on the positive extremity of the second and third dimensions: this<br />

can be explained <strong>by</strong> the fact that some ideal profiles are described with much stronger fresh and fruity (second<br />

dimension) or caramel, vanilla and honey (third dimension) notes than the products actually are.<br />

82


3. Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

<strong>The</strong> projections of the ideal products from the consumers 13618 and 13073 are close to the products Shalimar<br />

and Angel: the ideal profiles from these consumers are close to the sensory profile of Shalimar and Angel. Similarly,<br />

the projections of the ideal products from the consumers 8840 and 3541 are close to the products J’Adore (ET and<br />

EP): the ideal profiles from these consumers are close to the sensory profile of J’Adore (ET and EP) (Table 4).<br />

Finally, the consistency of the ideal data according to the other descriptions (sensory and hedonic) is measured<br />

through the link between the preferences (Figure 4a) and the position of the products (Figure 4b) within the ideal<br />

product space.<br />

On the second dimension, the consumers who described their ideal with strong oriental notes have an ideal<br />

profile close to the profiles from the products Angel or Shalimar. <strong>The</strong> projection of their centered liking scores as<br />

supplementary variables also shows that the consumers who have an ideal with strong oriental notes prefer<br />

Shalimar and Angel to the other products. Thus, the consumers (as for instance 13618) whose ideal profiles are<br />

close to the sensory profile of Shalimar or Angel also prefer Shalimar and Angel. Inversely, the consumers who<br />

described their ideal with strong fresh and fruity notes have an ideal profile far from Shalimar’s. Thus, the products<br />

J’Adore (EP and ET) have the closest profiles to these ideals. <strong>The</strong> projection as supplementary variable of the<br />

centered liking scores also shows that consumers with a fresher and fruitier ideal prefer J’Adore and Pure Poison<br />

over the other products. Thus, the consumers (for instance 8588) whose ideal profiles are closer to J’Adore (EP and<br />

ET) than to any other product also prefer J’Adore (EP and ET).<br />

Similarly, on the third dimension, the consumers who described their ideal with strong caramel, honey and<br />

vanilla notes have an ideal profile close to the profiles of the products Lolita Lempicka and Cinema (for instance<br />

12535). <strong>The</strong> projection of their hedonic score as supplementary variables also shows that the consumers who have<br />

an ideal with strong caramel, honey and vanilla notes also like Lolita Lempicka and Cinema more. Thus, the<br />

consumers whose ideal descriptions share the same characteristics as Lolita Lempicka and Cinema also prefer Lolita<br />

Lempicka and Cinema.<br />

Overall, the ideal descriptions are consistent with the sensory and hedonic descriptions of the products. Indeed,<br />

the consumers say they prefer the products which are close (in terms of sensory) to their ideal. In terms of<br />

consistency according to the other descriptions given <strong>by</strong> the consumers, this study provides an argument for the<br />

consistency of the ideal data.<br />

4.1.1.2. Consistency at the consumers’ level<br />

At the consumer level, the consistency between ideal, sensory and hedonic descriptions is measured through<br />

the correlation coefficients between drivers of liking/disliking and the corrected ideal data. <strong>The</strong> distribution of these<br />

<br />

individual correlation coefficients ,,<br />

is given Figure 5.<br />

<br />

Figure 5: Distribution of the individual correlation coefficient ,,<br />

measured for each consumer between the<br />

corrected ideal data and the drivers of liking. Note: at 5%, the one‐tailed test with 19 degrees of freedom returns a<br />

critical value of 0.37 for the correlation coefficient.<br />

83


3.1. Sensory Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

According to the significance table for the one sided test with 19 degrees of freedom, the correlation coefficient<br />

is significant at 5% when it is greater than 0.37. Hence, 80 out of 103 consumers show a significant correlation<br />

coefficient at 5%. This amount of consumers drops to 67 out of 103 (65%) if we increase the correlation coefficient<br />

threshold at 0.50 and to 40 out of 103 (39%) for a correlation coefficient threshold of 0.70.<br />

We can conclude that for most of the consumers, linear relationships are sufficient to define drivers of<br />

liking/disliking. Hence, the quadratic relationships are not considered.<br />

<strong>The</strong> majority of consumers is consistent in their ideal description according to the sensory and hedonic<br />

descriptions it also provides.<br />

4.1.2. <strong>Ideal</strong> descriptions vs. Hedonic scores<br />

<strong>The</strong> consistency of the ideal data with respect to hedonic data is measured <strong>by</strong> comparing the hedonic score of<br />

the ideal profiles with the hedonic scores assigned to the products. Because the hedonic scores for the ideal profiles<br />

are unknown, they are estimated thanks to individual models expressing the liking scores in function of the<br />

perception of the products for each consumer. For each consumer, the liking score estimated for each individual<br />

ideal profile is compared to the liking scores the individual assigned to the products.<br />

4.1.2.1. Consistency at the panel level<br />

In order to give an overall assessment of the liking scores, box plots showing the distribution of the liking scores<br />

assigned to the products and estimated for the ideals are compared Figure 6.<br />

Figure 6: Distributions of the hedonic scores provided (actual products) or estimated (ideal products) <strong>by</strong> PLS<br />

regression<br />

<strong>The</strong> distribution of the liking scores for the products show that the entire range of the scale has been used<br />

(scores going from 1 to 9). However, the estimated liking scores for the ideal profiles only use the top of the scale<br />

(scores going from 4 to 9, with few outliers). Thus, the ideal products have higher liking ratings than the products.<br />

This is confirmed <strong>by</strong> the averaged liking score for the products and the estimated liking score for the ideal products:<br />

the average liking score is 5.64 for the products versus 6.60 for the ideal products. <strong>The</strong> ideal products are more<br />

appreciated than the products.<br />

4.1.2.2. Consistency at the consumers’ level<br />

In order to simplify the presentation of the results, the estimated liking scores for the ideal profiles are<br />

standardized relative to the mean and standard deviation of the liking scores given to the products. In the<br />

interpretation of the results, the quality of the individual models is also taken into account through the R²<br />

coefficient (Figure 7).This allows us to remove consumers for whom the model doesn’t fit the data sufficiently (and<br />

thus for whom it is impossible to draw conclusions about the hedonic power of the ideal product).<br />

84


3. Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

Figure 7: Standardized liking scores of the ideal products estimated <strong>by</strong> PLS regression represented in function of the<br />

quality of the individual model (R² coefficient).<br />

It appears here that 20% of consumers have an individual model which doesn’t fit the data (R² < 0.5). Although<br />

this proportion is not negligible, the results are comforting since for the majority of the consumers, we can draw<br />

conclusions about the hedonic power of the ideal product. Moreover, the proportion of non‐fitting consumers<br />

might be decreased <strong>by</strong> using quadratic effects as well. But here again, it seems not to be of high necessity. Among<br />

the consumers with a model considered as sufficiently good (R² ≥ 0.5), only 8% has (e.g. 11169) a standardized<br />

estimate which is negative. Hence, for the vast majority of consumers (72% of consumers, 11174 and 13048 can be<br />

cited as example), the stated ideal product can be considered as a potential ideal. And for 46% of consumers, the<br />

standardized estimate is even greater than 0.5.<br />

Since each consumer described equally often his ideal profile as he tested products, one can estimate the liking<br />

score of each ideal profile. Hence, for each consumer, 14 liking scores for his ideal product can be estimated. <strong>The</strong>se<br />

estimates can be compared to the liking scores given to the corresponding products. One can count how many<br />

times the ideal profile has an estimated liking score greater than the actual liking score for product p. This count is<br />

equal to 14 (resp. 0) if for each product, the liking score estimated for the ideal product is greater (resp. lower) than<br />

the actual liking score provided to the corresponding product.<br />

For the majority of the consumers, this count is higher or equal to 7 (Figure 8). On average, 9.2 ideal products<br />

have an estimated liking score higher than the liking score of the corresponding product. Still, for some consumers,<br />

it can happen that this count is low. In these particular cases, it seems that the ideal description doesn’t coincide<br />

with a potential ideal product. However, for the majority of consumers, the ideal descriptions can be “assimilated”<br />

to potential ideals. <strong>The</strong>se consumers are consistent in their ideal description.<br />

85


3.1. Sensory Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

Figure 8: Distribution of the number of ideal products for which the estimation of the liking score is greater than the<br />

liking score provided to the corresponding actual product.<br />

5. Conclusions and discussions<br />

Despite the objections, sensory methodologies which measure directly the ideal intensities (JAR, IPM) are<br />

widely used <strong>by</strong> practitioners to guide food companies in their product optimization process. <strong>The</strong> study presented<br />

here provides arguments for the use of such methodologies. Indeed, it gives a way to “validate” the consistency of<br />

the ideal data obtained from consumers using the IPM. This validation process checks for consistency of the ideal in<br />

relation to the sensory and hedonic data in two steps: (1) <strong>by</strong> studying the relationship between ideal, sensory and<br />

hedonic descriptions; (2) <strong>by</strong> comparing the hedonic scores estimated for the ideal products with the liking scores<br />

given to the products. <strong>The</strong>se two steps are done at both the panel and the consumers’ level.<br />

In the example used for illustration, the results are in favor of the use of IPM. <strong>The</strong> ideal data are consistent from<br />

the panel point of view. From the consumer point of view, the results are more variable: although the majority of<br />

consumers provide consistent ideals, this is not the case for all of them. <strong>The</strong> methodology of IPM does not work for<br />

a minority of consumers. Several explanations for this lack of fit are possible: (1) the individual model doesn’t fit the<br />

data; (2) the ideal product has a low hedonic power compared to the products; (3) the ideal descriptions disagree<br />

with the other descriptions of the products; (4) quadratic effects should be considered, as here we limited ourselves<br />

to linear relationships. <strong>The</strong>refore, it seems important to quantify the number of consumers who are actually able to<br />

describe correctly their ideal before using these data to improve the products. In order to minimize the random<br />

error associated to ideal descriptions, a possible selection a priori of the “good consumers” can be considered.<br />

Although this consistency check seems to be essential for the good understanding of ideal data, it can only be<br />

applied to data collected <strong>by</strong> IPM. Indeed, as mentioned <strong>by</strong> Van Trijp & al. (2007), the use of JAR scales doesn’t<br />

provide all the information required for the consistency check (i.e. sensory profiles of the products and of the ideal<br />

products). Hence, another methodology should be considered for JAR data.<br />

Once checked, the data can be used to guide improvement of the products (<strong>Worch</strong>, Dooley, Meullenet &<br />

Punter, 2010). As the ideal is related to the notion of liking, these data could also be used in order to cluster<br />

consumers with similar or common ideal patterns.<br />

Please note that during the collection of ideal data using the IPM, each consumer describes his ideal profile<br />

equally often as he describes the products. For simplification, in order to provide to the users a methodology which<br />

is not too complex, the variability of the ideal profiles within consumer has not been taken into account. Each<br />

consumer has been associated to his average ideal profile .. Nevertheless, a more detailed study of this variability<br />

remains a direction of research, which could help in the better understanding on how consumers define their ideal.<br />

Acknowledgments<br />

<strong>The</strong> authors would like to thank the reviewers for their interesting and valuable comments.<br />

86


3. Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

Appendix A: Demonstration through a simple example<br />

Let’s consider the example illustrated Table A1. This fake example is constructed as following: 5 consumers<br />

tested 3 products which they described on 5 attributes <strong>by</strong> using IPM. Hence, each consumer also described 3 times<br />

his ideal profile on the same attributes. Finally, he scored his appreciation of the products.<br />

<strong>The</strong> product 1 is described as intense on attributes 1 and 2, averaged on attribute 3 and not intense on<br />

attributes 4 and 5. It is opposed to the product 3, which is not intense on attribute 1 and 2, averaged intense on<br />

attribute 3 and intense on attributes 4 and 5. <strong>The</strong> product 3 is a particular case on the attribute 3 (particularly<br />

intense), and is averaged intense for the 4 other attributes.<br />

<strong>The</strong> consumers 1 and 2 both described their ideal with similar profiles as the product 1 (intense on attribute 1<br />

and 2, averaged intense for attribute 3, not intense for attributes 4 and 5). Hence, they preferred the product 1 and<br />

rejected the product 3. Inversely, the consumers 4 and 5 described their ideal with similar profiles as the product 3<br />

(not intense on attributes 1 and 2, averaged intense on attribute 3, and intense on attributes 4 and 5). Thus, these<br />

consumers preferred the product 3 and rejected the product 1. Finally, the consumer 3 described his ideal with<br />

similar profile as the product 2 (particular on attribute 3). Hence, this consumer prefers the product 2 than the two<br />

other products.<br />

Attr. 1 Attr. 2 Attr. 3 Attr. 4 Attr. 5 Product 1 Product 2 Product 3<br />

consumer 1 76 72 41 24 22 8 4 2<br />

consumer 2 73 74 42 23 24 8 4 2<br />

consumer 3 50 50 75 50 50 5 8 5<br />

consumer 4 23 26 41 75 72 2 4 8<br />

consumer 5 24 23 42 74 74 2 4 8<br />

product 1 74 73 41,5 23,5 23<br />

product 2 51 49 75 51 49<br />

product 3 23,5 24,5 41,5 74,5 73<br />

Table A1: Illustration based on a small faked example.<br />

<strong>The</strong> Principal Component Analysis returns the results presented Figure A.1. <strong>The</strong> first dimension of the PCA<br />

performed on the ideal profiles separate the ideal products from consumers 1 and 2 with the ideal products from<br />

the consumers 4 and 5 (Figure A.1a). <strong>The</strong> second dimension of the PCA is related to the particular case of the<br />

consumer 3. <strong>The</strong> correlation circle (Figure A.1b) associated shows that the ideal profiles from consumers 1 and 2 are<br />

intense on attributes 1 and 2, and not intense on attributes 4 and 5. Inversely, the ideal profiles from the consumers<br />

4 and 5 are not intense on attributes 1 and 2, but are intense on attributes 4 and 5. <strong>The</strong> second dimension is only<br />

due to the attribute 3, which is particularly intense for the ideal profile provided from consumer 3.<br />

Figure A1: <strong>Ideal</strong> product space (left, a) and correlation circle (right, b) obtained for the small example.<br />

87


3.1. Sensory Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

<strong>The</strong> projection as supplementary variables of the hedonic judgments (set as preference, Figure A.2a) shows that<br />

the preference of the product 1 is highly positively correlated with the attributes 1 and 2. In other words, the<br />

consumers who described their ideal profiles with strong intensity on the attributes 1 and 2 prefer the product 1. In<br />

the same way, the preference of the product 2 is highly correlated with the attribute 3 and the preference of the<br />

product 3 is highly correlated with the attributes 4 and 5.<br />

In the same time, the products are projected as supplementary entities into the product space (Figure A.2b). In<br />

this case, each product is considered as a particular consumer, who would have the product considered as ideal.<br />

<strong>The</strong> projection shows that on the first dimension, the consumers 1 and 2 have an ideal which is really close to<br />

product 1. <strong>The</strong> consumers 4 and 5 have an ideal which is close to product 3. On the second dimension, the<br />

consumer 3 has an ideal similar to product 2.<br />

Figure A2: Projection of the preference data as supplementary variables (left, a) and of the sensory profiles as<br />

supplementary entities (right, b) into the ideal product space.<br />

By reading simultaneously the two graphics presented Figure A.2, one can see whether the data are consistent<br />

or not. If the ideal data are consistent, they should make the link between sensory and hedonic; hence, the<br />

preference of the product p (an arrow in the variable representation) should point in the direction of the projection<br />

of the sensory profile of the product p.<br />

This example shows that the consumers 1 and 2 have an ideal profile close to the one of product 1. Indeed,<br />

these profiles are intense for the attributes 1 and 2, averaged for the attribute 3 and not intense for the attributes 4<br />

and 5. <strong>The</strong> projection of the preference data also shows that the product 1 is preferred when the consumers also<br />

described their ideal with strong intensities for the attributes 1 and 2. This makes sense compared to what was<br />

stated before. Hence, if the data are consistent as it is the case in this simple example, the consumers who<br />

described their ideals with similar sensory characteristics than a product p should also appreciate this product p<br />

more than the other products.<br />

References<br />

Carroll, J.D. (1972). Individual differences and<br />

multidimensional scaling. In Shepard, R.N., Romney, A.K.,<br />

& Nerloves, S. Multidimensional scaling: theory and<br />

applications in the behavioral sciences. Academic Press,<br />

New York.<br />

Coombs, C.H. (1964). Preference choice data. A theory of<br />

data. Wiley.<br />

Ennis, D.M. (2004). Statistical and psychological aspects<br />

of Thurstonian modeling. In 7th Sensometrics Meeting,<br />

Davis, CA, USA, August 2004<br />

Ennis, D.M., & Anderson, J.L. (2003). Identifying Latent<br />

Segments. IFPress, 6(1), 2‐3.<br />

88


3. Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

Epler, S., Chambers IV, E., & Kemp, K.E. (1998). Hedonic<br />

scales are a better predictor than Just About Right scales<br />

of optimal sweetness in lemonade. Journal of Sensory<br />

Studies, 13, 191‐197.<br />

Gacula, M., Rutenbeck, S., Pollack, L., Resurreccion,<br />

A.V.A., & Moskowitz, H.R. (2007). <strong>The</strong> Just About Right<br />

intensity scale: functional analyses and relation to<br />

hedonics. Journal of Sensory Studies, 22, 194‐211.<br />

Greenhoff, K., & MacFie, H.J.H. (1994). Preference<br />

Mapping in Practice. In MacFie, H.J.H. & Thomson,<br />

D.M.H. Measurement of food preferences (pp.137‐166).<br />

Glasgow: Blackie Academic & Professional.<br />

Issanchou, S (2009). Détermination directe d’un idéal<br />

sensoriel. Evaluation sensorielle, manuel méthodologique<br />

(3ème éd.). Paris: Lavoisier.<br />

Lesniauskas, R.O., & Carr, T. (2004). Basic analyses of JAR<br />

scale data in Workshop Summary: Data analysis<br />

workshop: getting the most out of just about right data.<br />

Food Quality and Preference, 15, 895‐897.<br />

Lovely, C., & Meullenet, J.F. (2009). Comparison of<br />

preference mapping techniques for the optimization of<br />

strawberry yogurt. Journal of Sensory Studies, 24, 457‐<br />

478.<br />

MacFie, H.J., Bratchell, N., Greenhoff, K., & Vallis, L.V.<br />

(1989). Designs to balance the effect of order of<br />

presentation and first order carry over effects in hall<br />

tests. Journal of Sensory Studies, 4, 129‐148.<br />

Meullenet, J.F., Lovely, C., Threlfall, R., Morris, J.R., &<br />

Striegler, R.K. (2008). An ideal point density plot method<br />

for determining an optimal sensory profile for<br />

Muscadine grape juice. Food Quality and Preference, 19,<br />

210‐219.<br />

Meullenet, J.F., Xiong, R., & Findlay, C.J. (2007). Analysis<br />

of Just About Right Data. Multivariate and Probabilistic<br />

Analyses of Sensory Science Problems. IFT Press,<br />

Blackwell Publishing.<br />

Popper, R., Rosenstock, W., Schraidt, M., Kroll, B.J.<br />

(2004). <strong>The</strong> effect of attribute questions on overall liking<br />

ratings. Food Quality and Preference, 15, 853‐858.<br />

Rothman, L., & Parker, M. (2009). Just About Right (JAR)<br />

Scales: Design, Usage, Benefits, and Risks. ASTM Manual<br />

63.<br />

Stone, H., & Sidel, J.L. (1985). Measurement. Sensory<br />

Evaluation Practices. Academic Press.<br />

Van Trijp, H.C.M., Punter, P.H., Mickartz, F., & Kruithof,<br />

L. (2007). <strong>The</strong> quest for the ideal product: Comparing<br />

different methods and approaches. Food Quality and<br />

Preference, 18, 729‐740.<br />

<strong>Worch</strong>, T., Lê, S., & Punter, P. (2010). How reliable are<br />

the consumers? Comparison of sensory profiles from<br />

consumers and experts. Food Quality and Preference, 21,<br />

309‐318.<br />

<strong>Worch</strong>, T., Dooley, L., Meullenet, J.F., & Punter, P.H.<br />

(2010). Comparison of PLS dummy variables and<br />

Fishbone method to determine optimal product<br />

characteristics from ideal profiles. Food Quality and<br />

Preference. 21, 1077‐1087.<br />

<strong>Worch</strong>, T., Lê, S., Punter, P.H. & Pagès, J. (2010). Can we<br />

trust consumers’ ideal? Study of the relationship<br />

between the consumer’s preference and their ideal. 10th<br />

Sensometrics meeting, Rotterdam, the Netherlands, July<br />

25‐28.<br />

Workshop Summary: Data analysis workshop: getting<br />

the most out of just about right data. Food Quality and<br />

Preference, 15, 891‐899.<br />

Xiong, R, & Meullenet, J.F. (2006). A PLS dummy variable<br />

approach to assess the impact of jar attributes on liking.<br />

Food Quality and Preference, 17, 188‐198.<br />

<strong>The</strong> methodology which allows checking for the sensory consistency of the ideal profiles at the panel level<br />

involves a combination of tables forming an L‐shape. This particular structure is a typical format to use in L‐PLS.<br />

In the following section, the results obtained with L‐PLS are presented as a complement to this article.<br />

3.1.2. Extension to L‐PLS, presentation of the methodology<br />

In sensory analysis, it is common usage to link datasets obtained from different sources. In consumer<br />

analysis, the search of drivers of liking can involve multivariate models relating an independent set of variable X<br />

(sensory or physical descriptions of the products) to a dependent set Y (consumer’s liking of the product).<br />

When X and Y have strong inter‐correlated columns, the use of a multiple regression is not possible and<br />

methods like Partial Least Squares Regression (PLS‐R) or Regression on Principal Components (PCR) are<br />

89


3.1. Sensory Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

required. But it can happen that the number of sets to link increases, and model building requires extension of<br />

these classical methodologies.<br />

L‐PLS modeling allows building relationships between datasets from multiple sources of variation<br />

(Martens, Anderssen, Flatberg, Gidskehaug, Hoy, Westad, Thybo, & Martens, 2005). An example of L‐PLS is<br />

given <strong>by</strong> Lengard, and Kermit (2006) or Lengard, Mage, and Kermit (2008): segments of consumers, which differ<br />

in product liking, can be explained <strong>by</strong> the differences in sensory characteristics of the products (sweet, salty,<br />

etc.) and in consumers’ characteristics (age, gender, etc.). In this example, the three datasets form an L‐shape<br />

(Table 3.1), thus the name L‐PLS.<br />

Consumer 1 … Consumer J<br />

Age<br />

Gender Z’<br />

…<br />

Background K<br />

Consumer 1 … Consumer J Attribute 1 … Attribute A<br />

Product 1 Product 1<br />

… Y … X<br />

Product P<br />

Product P<br />

Table 3.1: L‐shape structure of the data submitted to L‐PLS analysis.<br />

<strong>The</strong> three blocks of data in L‐PLS relate dependent variables Y (P x J, consumer liking data) to matrices X (P<br />

x A, sensory and /or physical product properties) and Z (J x K, consumer background). <strong>The</strong> model requires Y to<br />

be related to structures in both X and Z, the goal being to find relevant patterns in Y among the sensory<br />

descriptions X and among the consumer descriptors Z. If such X/Y/Z relationships do exist, the method should<br />

be able to reveal consumer segments with different product liking patterns, and indicate which product<br />

properties and which consumer descriptors explain these differences.<br />

Note: To describe the different algorithms, the notation proposed <strong>by</strong> Lengard, and Kermit (2006) is used.<br />

3.1.2.1. Algorithms<br />

Let’s consider a matrix X with P samples described on A attributes (regressor), and the matrix Y with J<br />

predicted variables (response) for the same number of samples as X. A multiple regression can be defined <strong>by</strong><br />

(Eq. 3.1):<br />

(3.1)<br />

where B is a matrix of regression coefficients and F a matrix of residuals.<br />

<strong>The</strong> PLS regression is based on the loadings (P and Q) and scores (T and U) resulting from the PCA with I<br />

remaining factors of X and Y, respectively (Eq. 3.2).<br />

<br />

<br />

(3.2a)<br />

(3.2b)<br />

Here, and are the residuals for X and Y after I factors are considered. PLS regression maximizes the<br />

explained covariance between X and Y <strong>by</strong> , derived from (Eq. 3.3):<br />

<br />

(3.3)<br />

90


3. Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

where w represents the loading weights for X and is obtained <strong>by</strong> singular value decomposition (SVD) of<br />

(i going from 1 to I). <strong>The</strong> regression coefficients are given <strong>by</strong> (Eq. 3.4):<br />

(3.4)<br />

In the L‐PLS, the regression model presented in Eq. 3.2 also depends on a third matrix Z. <strong>The</strong> regression<br />

model becomes (Eq. 3.5):<br />

<br />

(3.5a)<br />

<br />

(3.5b)<br />

<br />

(3.5c)<br />

Here, C is obtained <strong>by</strong> projecting Y on and . Components can be extracted in an extended version of the<br />

eigenvalue found in PLS regression (Eq. 3.6).<br />

<br />

<br />

<br />

<br />

(3.6)<br />

<br />

where w are the loading weights for X and may be calculated <strong>by</strong> SVD on <br />

(i going from 1 to I).<br />

An alternative of the L‐PLS algorithm can be obtained <strong>by</strong> a stepwise procedure using only 2‐block PLS<br />

regression. First, the correlation matrix G (P x K) measured between Z and Y is calculated. A new matrix <br />

combining Y and G is created ( |). Finally, a PLS II regression using X as predictors and as data<br />

to be predicted is performed. To add the products on the map of loadings, the matrix Id (P x P) of dummy<br />

variables is also added to the data table X. <strong>The</strong> final datasets used in the 2‐block PLS regression are given in<br />

Table 3.2 and Table 3.3.<br />

X=<br />

1<br />

…<br />

p<br />

…<br />

P<br />

1 … p … P Att. 1 … Att. a … Att. A<br />

1<br />

0<br />

0<br />

0<br />

…<br />

1<br />

…<br />

0<br />

Table 3.2: X matrix used in the two‐block PLS‐regression.<br />

It is the concatenation of the sensory descriptions of the products and the dummy variables matrix Id.<br />

0<br />

0<br />

1<br />

Dummy variables<br />

ypa<br />

Sensory characteristics<br />

Y=<br />

1<br />

…<br />

p<br />

…<br />

P<br />

1 … k … K Cons. 1 … Cons. j … Cons. J<br />

cor(yp. ; zk.)<br />

Correlation coefficients<br />

Table 3.3: Y matrix to be explained in the two‐block PLS‐regression.<br />

It is the concatenation of the G matrix of correlations and the matrix of hedonic judgments given <strong>by</strong> the consumers.<br />

To perform the L‐PLS, the matrixes need to be centered and/or scaled:<br />

ypj<br />

Consumer liking<br />

91


3.1. Sensory Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

- in the X matrix, the dummy variables are kept unchanged, while the intensities (sensory<br />

descriptors or physical variables) are centered and scaled <strong>by</strong> column;<br />

- in the Y matrix, the correlations are centered and scaled <strong>by</strong> column while the matrix of liking<br />

scores is centered <strong>by</strong> rows (to avoid differences due to the use of the scale) and columns (similar<br />

to PCA).<br />

For our study, some adaptations need to be done since the objectives differ.<br />

3.1.2.2. Adaptations to our study<br />

In the article presented in §3.2.1, the sensory consistency of the ideal profiles is evaluated <strong>by</strong> looking at<br />

the relationship between the ideal, sensory and liking data. More precisely, the ideal profiles are considered<br />

consistent if they make the link between the sensory and hedonic descriptions of the products. In other words,<br />

the sensory consistency is checked <strong>by</strong> projecting the sensory profiles and the hedonic ratings on the ideal space<br />

and <strong>by</strong> looking at the correspondence between the products’ configurations (obtained from the sensory and<br />

the hedonic descriptions).<br />

<strong>The</strong> procedure to analyze this L‐shaped dataset (a PCA with double projections as illustrative) can be<br />

replaced <strong>by</strong> L‐PLS regression. <strong>The</strong> previous Y matrix corresponds here to the averaged ideal profiles defined <strong>by</strong><br />

the different consumers (<strong>Ideal</strong>, Z, J rows and A columns), the previous X matrix corresponds to the matrix of<br />

overall liking scores (Hedonic, H, J rows and P columns) while the previous Z matrix corresponds to the sensory<br />

profiles of the products (Sensory, Y, P rows and A columns) (Table 3.4).<br />

Product 1<br />

…<br />

Product p<br />

…<br />

Product P<br />

Attribute 1 … Attribute a … Attribute A<br />

.<br />

Y<br />

(Sensory)<br />

Attribute 1 … Attribute a … Attribute A Product 1 … Product p … Product P<br />

Consumer 1 Consumer 1<br />

…<br />

…<br />

Consumer j ̃. Consumer j .<br />

… Z … H<br />

Consumer J (<strong>Ideal</strong>) Consumer J (Hedonic)<br />

Table 3.4: L‐shape structure of the ideal data submitted to L‐PLS regression.<br />

Here, the aim of the L‐PLS regression is not to explain the ideal profiles from the consumers based on the<br />

hedonic and sensory descriptions of the products, but in using the ideal profiles as a potential link between the<br />

sensory profiles of the products and their liking ratings. This is possible as the L‐PLS regression allows looking at<br />

the common part in H and Z that would explain Y. To keep continuity with the article presented §3.2.1, the<br />

corrected averaged ideal profiles are considered for each consumer. <strong>The</strong> hedonic ratings are also centered <strong>by</strong><br />

consumer.<br />

For programming reasons, the alternative algorithm of the L‐PLS regression is used. It needs the<br />

computation of the correlation matrix G measured between the <strong>Ideal</strong> and the Sensory matrix. This matrix G (J<br />

rows and P columns) highlights the relationship between each consumer’s averaged ideal profile and the<br />

sensory profiles of the products. Hence, at the intersection between the row j and the column p, one has:<br />

92


3. Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

- a strong and positive correlation cor( .. ; .. ): the consumer j describes his ideal with similar<br />

characteristics as the product p;<br />

- a strong and negative correlation cor( .. ; .. ): the consumer j describes his ideal with opposite<br />

characteristics than the product p;<br />

- a correlation cor( .. ; .. ) close to 0: there is no relation between the ideal and the product p for<br />

the consumer j.<br />

By definition, consumers describe consistent ideals if they describe their ideals with similar characteristics<br />

as the product they like the most. In mathematical terms, this means that when the ideal profile of a consumer<br />

j is highly positively correlated to the profile of a product p (i.e. the ideal profile of the consumer considered<br />

shares similar characteristics as the product p), j should like p more than the other products. By applying this to<br />

the entire set of samples, a consistent ideal would lead to a high and positive correlation coefficient between<br />

the vector of correlations measured between the averaged ideal profiles from a consumer and the different<br />

product profiles on one hand and the liking scores given <strong>by</strong> that consumer to the products on the other hand.<br />

To check that, a two‐block PLS‐II regression is performed. It aims at estimating the global Y matrix (Table 3.6) in<br />

function of the global X matrix (Table 3.5).<br />

Table 3.5: X matrix used in the two‐block PLS‐regression.<br />

It is the concatenation of the hedonic descriptions of the products and the dummy variables matrix Id.<br />

Table 3.6: Y matrix to be explained in the two‐block PLS‐regression.<br />

It is the concatenation of the G matrix of correlations and the matrix of ideal profiles given <strong>by</strong> the consumers.<br />

3.1.2.3. Results and discussion (perfume project)<br />

<strong>The</strong> L‐PLS regression was performed on three components. <strong>The</strong> Figure 3.1a shows the ideal product space,<br />

each point representing the corrected averaged ideal profile from one consumer. Variability in the ideal<br />

descriptions provided <strong>by</strong> the consumers is observed. On the first dimension, the ideal profile from the<br />

consumer 8588 is opposed to the ideal profiles from the consumers 13618 and 6889. <strong>The</strong> second dimension<br />

opposes the ideal profile from the consumer 13645 and the ideal profiles from the consumers 12471 and 2909.<br />

93


3.1. Sensory Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

<strong>The</strong> correlation circle (Figure 3.1b) helps describing the differences in the ideal profiles. <strong>The</strong> first dimension<br />

opposes consumers who described their ideals with strong fresh and fruity notes to consumers who described<br />

their ideals with strong oriental notes. <strong>The</strong> second dimension shows a “size effect”, as it opposes the<br />

consumers who described their ideal as stronger for all attributes to consumers who describe their ideal as less<br />

intense on all attributes.<br />

Consumer 8588 described a rather fresh and fruity ideal product compared to 6889 and 13618 who<br />

described their ideals with strong oriental notes. Consumer 13645 has an ideal product which should be<br />

intense on all attributes while consumers 12471 and 2909 described their ideal as less intense on all attributes.<br />

Figure 3.1: <strong>Ideal</strong> product space (a, left) and variable representation (b, right) obtained from the L‐PLS.<br />

In the process of checking for the consistency of the ideal data, the relationship between the hedonic and<br />

sensory descriptions of the products within this ideal space is of first interest. To do so, the liking of the<br />

products and the correlation between ideal profiles on one hand and the sensory profiles on the other hand<br />

are represented simultaneously (Figure 3.2). On the first dimension, similar products are projected close to<br />

each other on the map. This means that consumers who described their ideal profiles with similar<br />

characteristics as p also liked more p. Hence, the liking ratings of each product p match with the correlation<br />

between the averaged ideal profiles and the sensory profile of p. More precisely, the consumers who described<br />

their ideal as similar to Pure Poison or J’Adore (strong fresh and fruity notes) also liked more Pure Poison and<br />

J’Adore. On the other side of the first dimension, the consumers who described their ideal with similar<br />

characteristics than Shalimar and Aromatics Elixir (strong oriental notes) also liked more Shalimar and Aromatic<br />

Elixir.<br />

<strong>The</strong> second dimension does not separate the products according to the liking ratings, but only to the<br />

differences between the ideal profiles from consumers. It opposes consumers with weaker intensities for all<br />

attributes to consumers with strong ideals (stronger intensities for all attributes). Hence, there is a discrepancy<br />

between likings and correlations on the second dimension.<br />

94


3. Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

Figure 3.2: Representation of the liking of the products and the correlation<br />

between the ideal profiles from consumers and the sensory profiles of the products.<br />

Figure 3.3 shows the first and third dimensions. <strong>The</strong> third dimension opposes the consumers 11215 and<br />

13645 (Figure 3.3a). On this dimension, the distinction between consumers is related to the attributes vanilla,<br />

caramel and honey. Hence, the consumer 13645 described his ideal with strong vanilla, caramel and honey<br />

notes while 11215 did not (Figure 3.3b).<br />

Figure 3.3: <strong>Ideal</strong> space (a, left) and variable representation (b, right) obtained <strong>by</strong> L‐PLS (1 st and 3 rd dimensions).<br />

On the third dimension, a good correspondence between products is again observed (Figure 3.4). For both<br />

the correlation and liking, the third dimension opposes Aromatic Elixir, Chanel N˚5 and Shalimar (not intense<br />

95


3.1. Sensory Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

for vanilla, caramel and honey) to Cinema, L’Instant and Lolita Lempicka (intense for vanilla, caramel and<br />

honey).<br />

Figure 3.4: Representation (1 st and 3 rd dimensions) of the products’ liking and the correlation<br />

between the ideal profiles from consumers and the sensory profiles of the products.<br />

<strong>The</strong> products are more separated <strong>by</strong> the correlations then <strong>by</strong> the liking ratings. <strong>The</strong> differences in the<br />

consumers’ ideals are larger for these products then the liking ratings would suggest.<br />

3.1.2.4. Conclusions concerning the L‐PLS procedure<br />

<strong>The</strong> methodology presented for the assessment of the consistency of ideal data is a multi‐block study,<br />

where the global dataset forms a L‐shape. Hence, as an alternative for the PCA with double projection as<br />

illustrative proposed in the article §3.2.1, L‐PLS regression can be used.<br />

Both analyses show similar results and allow the user to see the relationship between the sensory and the<br />

hedonic descriptions of the products, within the ideal product space. But since the analyses differ in their<br />

properties, some differences were observed. <strong>The</strong> main difference between the two studies is related to the<br />

importance given to the dimensions. In the article, a PCA was performed and the sensory and hedonic<br />

descriptions of the products were projected as illustrative. In that case, the dimensions only takes into<br />

consideration the variability of the ideal profiles without taking the relationship between sensory and hedonic<br />

data in consideration. <strong>The</strong>refore, the first dimension of the PCA opposes consumers who described their ideals<br />

as less intense on all attributes to consumers who described their ideals as intense on all attributes. <strong>The</strong> second<br />

dimension opposes consumers who described their ideal with strong fresh and fruity notes to consumers who<br />

described their ideal with strong oriental notes. It appears that only the second dimension is related to<br />

consumers’ liking ratings, as consumers with ideals described as not‐intense at all or as intense on all attributes<br />

didn’t show any particular liking pattern. <strong>The</strong> third dimension opposes consumers describing their ideal with<br />

strong vanilla, caramel and honey notes to consumers who don’t. In the L‐PLS analysis, the relationship<br />

96


3. Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

between sensory and hedonic descriptions is taken into consideration in the construction of the dimensions. In<br />

that case, the first dimension opposes directly consumers who described their ideal with fresh and fruity notes<br />

to consumers who described their ideal with strong oriental notes. <strong>The</strong> second dimension opposes the<br />

consumers who described their ideals as less intense on all attributes to the consumers who described their<br />

ideals as intense on all attributes. Here, it appears that only the first dimension is related to liking. <strong>The</strong> third<br />

dimension is similar to the third dimension obtained in the PCA.<br />

Although the two analyses returned similar results, a rotation is observed between the two techniques.<br />

Depending on the point of view adopted, the decision whether to use PCA with double projection as illustrative<br />

or L‐PLS regression has to be made. This decision depends whether the user wants to focus on the variability of<br />

the ideal profiles (PCA) or on the relationship between sensory and hedonic descriptions, within the ideal space<br />

(L‐PLS).<br />

3.1.3. Conclusions on the sensory consistency of the ideal data<br />

<strong>The</strong> methodology developed in the article §3.2.1 for checking the sensory consistency of the ideal profiles<br />

is applied to the 24 projects and general conclusions are drawn.<br />

3.1.3.1. At the panel level<br />

<strong>The</strong> sensory consistency is measured <strong>by</strong> the relationship between the corresponding products obtained<br />

through the sensory and hedonic descriptions, within the ideal space. This relationship is either measured <strong>by</strong><br />

PCA with double projection as illustrative (as proposed §3.2.1), or <strong>by</strong> L‐PLS regression (§3.2.2). To facilitate the<br />

interpretation of the results, an indicator measuring the sensory consistency is proposed. As the consistency is<br />

evaluated <strong>by</strong> the relationship between the sensory and the hedonic configurations within the ideal space, the<br />

correlation coefficient between these two configurations calculated for each dimension is used (3 dimensions<br />

are considered here).<br />

In practice, the correlation coefficients are measured between the supplementary scores (sensory) and the<br />

supplementary loadings (hedonic) in the PCA. In the L‐PLS regression, the correlation coefficients are measured<br />

between the loadings of the X matrix (hedonic) and the loadings of the Y matrix (correlation between sensory<br />

and ideal descriptions). This is possible as the configurations involve the same elements (i.e. the products).<br />

Figure 3.5 shows the results of this indicator obtained from the PCA (a) and the L‐PLS regression (b). For<br />

most of the projects the correlation coefficients are high, at least for the two first dimensions. This shows a<br />

high correspondence between the sensory and hedonic configurations within the ideal space. <strong>The</strong> ideal<br />

descriptions are (sensory) consistent. Still, for some projects (e.g. cream yoghurt 1 and candy bar with the PCA,<br />

coffee with L‐PLS), it is not the case. For these projects, the consistency of the ideal descriptions is<br />

questionable: either the consumers were not able to describe a consistent ideal according to the sensory and<br />

hedonic descriptions of the products, or the linear relationship was not sufficient to explain this consistency.<br />

97


3.1. Sensory Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

Figure 3.5: Correlation coefficients measured between the different projections of similar products<br />

in the PCA (a) and in L‐PLS regression (b) on the three first dimensions.<br />

Between the PCA and the L‐PLS approaches, similar results were observed. <strong>The</strong> projects showing<br />

consistent ideal profiles with the PCA approach also show consistent ideal profiles with the L‐PLS approach.<br />

Likewise, the projects showing inconsistent ideal profiles with the PCA also show inconsistency with the L‐PLS<br />

approach (except for candy bar). A deeper look at the results shows that the L‐PLS regression returns slightly<br />

higher correlations on the first dimension than the PCA. This is due to the differences in the approaches: in the<br />

PCA, the first dimension explains the most variability in X (without taking Y into consideration) while in the L‐<br />

PLS, the first dimension maximizes the relationship between X and Y. <strong>The</strong>refore, a difference in favor of L‐PLS<br />

was expected (as it has been seen with the perfume example). When higher dimensions are considered, the<br />

PCA shows globally higher correlation coefficients than the L‐PLS.<br />

Note: Instead of using the correlation coefficient, one could consider taking the RV coefficient between the<br />

configurations. However, this solution seems not appropriate as the RV coefficient performs “rotations” to find<br />

the best link between configurations. Hence highly inconsistent consumers (i.e. consumers who said they liked<br />

98


3. Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

the products described with opposite characteristics to their ideals more) will also be associated to high RV<br />

coefficients.<br />

3.1.3.2. At the consumer level<br />

In the article presented in §3.1.1, the sensory consistency of the ideal profiles was measured through the<br />

<br />

indicator ,,<br />

. This indicator measures the linear relationship between the corrected averaged ideal profile<br />

and the vector of linear drivers of liking/disliking for the same consumer. This methodology shows limitations<br />

since it only considers linear relationships between the perception of the attributes and the appreciation of the<br />

products for each consumer while attributes have a level of saturation. However, in practice, we are often<br />

working with products in which the saturation level of the attributes is not reached. In this case we are located<br />

in a direction where the more (or the less) the better. In this case, a consumer j is providing a consistent ideal<br />

<br />

profile if he/she is associated to a coefficient ,,<br />

close to 1. This methodology is applied to the 24 projects<br />

and the distributions of the individual indicators are represented in Figure 3.6.<br />

<br />

Figure 3.6: Distribution of the ,,<br />

coefficients showing the (sensory) consistency of the consumers for each project.<br />

<br />

For most of the projects, the distribution shows high ,,<br />

coefficients. <strong>The</strong> majority of consumers are<br />

<br />

consistent. Nevertheless, in each project, some consumers are associated to low ,,<br />

coefficient. This is either<br />

due to an inconsistency of these consumers, or to the limitation of the methodology. Indeed, here, only the<br />

linear relationship is measured, but for these consumers, it might not be sufficient to describe the relationship<br />

between sensory, ideal and hedonic.<br />

For most of the projects, the ideal profiles are (sensory) consistent with sensory and hedonic descriptions<br />

of the products, both at the panel and consumer levels. Still, there are some projects in which this consistency<br />

is questionable. This inconsistency can either be due to an inconsistency of the ideal profiles, or to a limit in the<br />

methodology as only linear relationships between sensory and hedonic are used while quadratic effects might<br />

need to be considered as well. At the panel level, the results obtained with the PCA approach were very similar<br />

99


3.1. Sensory Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

to the ones obtained with the L‐PLS approach. Although the L‐PLS seems to give higher correlation on the first<br />

dimension, this difference is not strictly significant at 5% (p‐value of the paired t‐test is equal to 0.07). For the<br />

second dimension, the PCA approach gives significantly higher correlation coefficients (p‐value=0.04). For the<br />

third dimension, no significant differences are observed. <strong>The</strong>se results can be explained <strong>by</strong> the eventual<br />

rotations observed between dimensions (e.g. the perfume project) due to the different approaches.<br />

At the consumer level, the majority of consumers are consistent for almost every project, although this is<br />

not the case for all of them. This inconsistency can either be due to inconsistent ideal profiles or to the<br />

limitation of the methodology which only considers linear relationship between sensory and hedonic ratings.<br />

As it only concerns a minority of consumers, the quadratic relationship was not considered. It has to be said<br />

that all the consumer are not good subjects for sensory test, and the bad consumers only generate random<br />

noise. Depending on the point of view adopted, the inconsistent consumers can either be kept or discarded<br />

from further analyses. When the inconsistency is caused <strong>by</strong> random factors, they can be kept as the effects will<br />

average out. Since consumers are not trained and only selected on product use or demographics, a certain<br />

percentage will be unable to perform the requested task. For the rest of the document, these consumers will<br />

be kept in the analyses.<br />

100


3.2. Hedonic Consistency of<br />

the <strong>Ideal</strong> <strong>Profile</strong>s


3. Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

<strong>The</strong> methodology checking for the hedonic consistency is presented in the paper from <strong>Worch</strong> et al. entitled<br />

“Extension of the consistency of the data obtained with the <strong>Ideal</strong> <strong>Profile</strong> Method: Would the ideal products be<br />

more liked than the tested products?”. Additional results on the simulations and the comparison of the models<br />

and are given in the second section as a complement.<br />

3.2.1. Extension of the consistency of the ideal data<br />

Journal:<br />

Title:<br />

Food Quality and Preference<br />

Extension of the consistency of the data obtained with the <strong>Ideal</strong> <strong>Profile</strong> Method:<br />

Would the ideal products be more liked than the tested products?<br />

Authors: <strong>Worch</strong>, T., Lê, S., Punter, P., & Pagès, J.<br />

Abstract:<br />

Keywords:<br />

Reference:<br />

<strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong> Method is a sensory method in which, for each product tested,<br />

consumers are asked to rate both the perceived and ideal intensities of a list of attributes. In<br />

addition, they are also required to indicate how much they like each product. At the end of the<br />

task, three blocks of data are collected from each consumer: the product profiles, their ideal<br />

profile and the liking ratings.<br />

<strong>The</strong> ideal profiles can be used to help improving the existing products. However, this<br />

information should be carefully managed since (1) it is obtained from consumers, and (2) it<br />

describes a virtual product. In order to use the full potential of the ideal profiles, and to avoid a<br />

possible misinterpretation of the data, one has to ensure that the information collected is<br />

consistent.<br />

<strong>The</strong> process checking for the consistency of the ideal profiles proposed here is based on<br />

the liking ratings: an ideal product should achieve higher hedonic ratings than the tested<br />

products, if it would be tested. But since the liking scores of the ideal products are unknown,<br />

they are estimated first. However, the comparison between liking scores (estimated for the<br />

ideals, measured for the tested products) would only make sense if the ideal descriptions have<br />

not been randomly given. For that matter, a hypothesis test checking for the significance of the<br />

ideal profiles is defined.<br />

In the perfume example provided, it appears that most of the consumers did not describe<br />

their ideals randomly. In addition, the estimations of the ideals liking scores are high compared<br />

to those given to the tested products. Hence, for most of the consumers, the ideal profiles are<br />

considered as consistent according to the potential liking of their ideal profiles.<br />

Consumer, <strong>Ideal</strong> <strong>Profile</strong> Method, liking, consistency, permutation test, PLS, PCR.<br />

<strong>Worch</strong>, T., Lê, S., Punter, P., & Pagès, J. (2012). Extension of the consistency of the data<br />

obtained with the <strong>Ideal</strong> <strong>Profile</strong> Method: Would the ideal product be more liked than the tested<br />

products? Food Quality and Preference, 26, 74‐80.<br />

103


3.2. Hedonic Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

1. Introduction<br />

<strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong> Method (IPM) is a method which aims at acquiring sensory data from consumers. During this test,<br />

products are presented in a sequential monadic order taking care of order and carry over effects (MacFie, Bratchell,<br />

Greenhoff & Vallis, 1989) to consumers, who are asked to describe them on a set of given attributes for both perceived and<br />

ideal intensities. During the task, the same consumers are also asked to provide hedonic ratings of the products.<br />

In this sense, the IPM can be seen as a combination of QDA® (profiling products, Stone, Sidel, Oliver, Woosley &<br />

Singleton, 1974) and JAR scaling (providing ideal profiles).<br />

<strong>The</strong> application potential of the data provided from the IPM is large as three types of information are obtained from<br />

each consumer: the sensory profiles of the products (i.e. how consumers perceive the products), the vector of hedonic<br />

scores (i.e. how much consumers like the products) as well as the ideal profiles (i.e. what are the consumers’ expectations)<br />

(Van Trijp, Punter, Mickartz & Kruithof, 2007).<br />

Gathering this diverse information, and more specifically the ideal profiles, is crucial as it can help manufacturers to<br />

improve existing products (<strong>Worch</strong>, Dooley, Meullenet & Punter, 2010). In this sense, the IPM can also be seen as an<br />

alternative to statistical methods such as the external preference mapping (PrefMap, Carroll, 1972) or the Landscape<br />

Segmentation Analysis (LSA, Ennis, 2005) which aims at estimating global or individual ideal profiles from sensory profiles<br />

(usually provided from experts or trained panels) and consumers’ liking scores. However, this information (the ideal<br />

descriptions) is delicate as (1) it comes directly from consumers and (2) it describes virtual products.<br />

In order to use the full potential of the ideal descriptions, and to avoid any possible misinterpretation of this data<br />

which could lead to an incorrect reformulation of the tested products, one has to be sure that the information collected is<br />

relevant. Hence, it is important to check the consistency the ideal data before use. <strong>The</strong> procedure proposed here is<br />

performed in two steps.<br />

<strong>The</strong> first part consists in checking the sensory consistency of the ideal profiles. In this case, the consistency of the ideal<br />

data is defined according to both the sensory and hedonic descriptions: the sensory profile of an ideal product is considered<br />

consistent if it goes in the same sensory direction as the profile of the most liked product. At the attribute level, this means<br />

that consumers who gave a higher liking rating to the products they perceived as sweeter also described their ideal as<br />

rather sweet.<br />

<strong>The</strong> second part consists in checking the hedonic consistency of the ideal profile provided <strong>by</strong> a given consumer. In<br />

theory, the ideal descriptions should correspond to a product that is more liked than the tested products, if it happens to<br />

exist. As the liking of the ideal profile (also called liking potential of the ideal product) is unknown, it has to be estimated.<br />

For that reason, a model explaining the liking scores in function of the way products are perceived is constructed for each<br />

consumer. <strong>The</strong> model is then applied to the ideal descriptions, and the liking potential of the ideal product is estimated.<br />

This estimated liking potential is compared to the liking scores given to the products. Finally an ideal profile is considered<br />

consistent (in terms of the liking potential of the ideal profile) if the estimation of its liking potential is superior to the liking<br />

scores given to the products.<br />

As a methodology checking for the sensory consistency of the ideal profiles has already been proposed <strong>by</strong> <strong>Worch</strong>, Lê,<br />

Punter & Pagès (2012), this paper focuses on the procedure checking for the hedonic consistency of the ideal profile.<br />

Henceforth, when we mention consistency it will refer to that of the liking potential.<br />

Although the principle of the procedure checking for the consistency is rather simple, it is based on a strong hypothesis<br />

that has to be checked beforehand. This hypothesis assumes that consumers do not describe their ideal in a random way.<br />

For that reason, a hypothesis test checking for the significance of the estimated liking potential of the ideal products is set<br />

up. In practice, this test compares the real estimation of the liking potentials of the ideal products measured (i.e. in the real<br />

situation) to the estimates of liking potentials obtained in random situations. As one can expect, not random ideal<br />

description should yield a higher estimation than the ones obtained in random situations.<br />

This procedure is also based on a more technical choice related to the selection of the individual models to use for the<br />

estimation of the liking potentials of the ideal products.<br />

<strong>The</strong>se two last aspects (significance of the estimated liking potential and the selection of the individual models to use)<br />

will be developed in this article, and the methodology developed here will be illustrated with a real IPM example.<br />

2. Notation<br />

Let P denote the number of products tested, A the number of attributes used to describe the products and J the<br />

number of consumers used for the test.<br />

Let’s recall that in the IPM, each consumer rates each tested product on both perceived and ideal intensity for a set of<br />

attributes. In practice, for the attribute sweetness, if the first question asked is “how sweet is this product?” the second<br />

would be “what would be your ideal sweetness for this product?” At the end of the test, one will get as many ideal profiles<br />

as sensory profiles from each consumer. During the test, the consumers also score the products on overall liking.<br />

In this paper, the following notation will be used to describe the data obtained from IPM (the vectors are in bold):<br />

: intensity perceived <strong>by</strong> the consumer j for the product p and the attribute a;<br />

. ; 1: : vector of intensities perceived <strong>by</strong> the consumer j for the P products and the attribute a;<br />

104


3. Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

1)<br />

. : average over the index p; average intensity perceived <strong>by</strong> the consumer j on attribute a over the P products. (Table<br />

.<br />

Consumer j Attribute 1 … Attribute a … Attribute A<br />

Product 1<br />

…<br />

Product p <br />

…<br />

Product P<br />

.<br />

Table 1: Organization and illustration of the notation for the sensory data<br />

: ideal intensity of the attribute a provided <strong>by</strong> the consumer j after testing the product p;<br />

. ; 1: : vector of ideal intensities of the attribute a provided <strong>by</strong> the consumer j for the P products;<br />

.: average over the index p; average ideal intensity of the attribute a provided <strong>by</strong> the consumer j over the P<br />

products.<br />

: hedonic judgment provided <strong>by</strong> the consumer j for the product p;<br />

. ; 1: : vector of hedonic judgments provided <strong>by</strong> the consumer j for the P products.<br />

<strong>The</strong> ideal profile is always taken relative to the products tested, for each attribute. Given the data collection<br />

methodology, an ideal intensity is therefore subject to (at least) two sources of noise: residual inherent in all measurements<br />

and the influence of the product tested.<br />

In order to reduce this noise, only the averaged ideal profile per attribute . for each consumer is considered in<br />

practice, although each consumer provides P descriptions of his/her ideal profiles.<br />

3. Material and methods<br />

3.1. Material<br />

In order to illustrate the methodology presented below, the dataset presented <strong>by</strong> <strong>Worch</strong>, Lê & Punter (2010) is used. It<br />

concerns 12 luxurious women perfumes among which two were duplicated (Table 2). Each product has been rated on 21<br />

attributes (listed in Table 2) <strong>by</strong> 103 Dutch consumers (44 men and 59 women). <strong>The</strong> women selected all used luxurious<br />

perfume daily while the men had a girlfriend or wife who used perfume regularly. Additionally, the men had to name at<br />

least two luxurious women perfumes. In this way, the consumers selected were (directly or indirectly) users of this type of<br />

products.<br />

Products Type Attributes<br />

Angel Eau de Parfum Intensity Spicy<br />

Cinema Eau de Parfum Freshness Woody<br />

Pleasures Eau de Parfum Jasmine Leather<br />

Aromatics Elixir Eau de Parfum Rose Nutty<br />

Lolita Lempicka Eau de Parfum Chamomile Musk<br />

Chanel N⁰5 Eau de Parfum Fresh lemon Animal<br />

L’Instant Eau de Parfum Vanilla Earthy<br />

J’Adore (EP) Eau de Parfum Citrus Incense<br />

J’Adore (ET) Eau de Toilette Anis Green<br />

Pure Poison Eau de Parfum Sweet fruit<br />

Shalimar Eau de Toilette Honey<br />

Coco Mademoiselle Eau de Parfum Caramel<br />

Table 2: List of products and attributes.<br />

Note: the products Pure Poison and Shalimar have been duplicated<br />

For each perfume and each attribute, both the perceived and ideal intensities have been rated on 100mm line scales.<br />

After rating each product on perceived and ideal intensity, overall liking was rated on a structured 9‐point category scale.<br />

<strong>The</strong> 14 samples were presented in a sequential monadic order, taking care of order and carry‐over effects (MacFie et<br />

al., 1989) in two 1‐hour sessions (7 products being presented in each session).<br />

105


3.2. Hedonic Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

3.2. Methods<br />

In the ideal situation, when consumers describe their ideal profiles, they describe fictive products which they should<br />

like more than the products tested, if they would physically exist. In other words, the ideal products provided <strong>by</strong> consumers<br />

should have a higher liking potential than the products themselves. This property has to be checked at the individual level,<br />

i.e. for each consumer separately. Unfortunately, the liking potentials of the individual ideal products are unknown, as they<br />

cannot be measured directly. So they have to be estimated.<br />

To do so, individual models expressing the consumers’ appreciations in function of their perception of the products are<br />

constructed. <strong>The</strong>se individual models are then applied to the ideal descriptions the consumers provided, and the liking<br />

potentials of the ideal products are estimated.<br />

Remark: Consumers provide p descriptions of their ideal profiles. In this study, the ideals’ variability within a consumer<br />

is not taken into consideration. Indeed, for simplification purposes, the averaged ideal profiles are used. However the<br />

methodology developed here can be applied to the individual ideal profiles provided <strong>by</strong> each consumer separately, the<br />

variability of the ideal profiles provided <strong>by</strong> each consumer being taken into consideration.<br />

<strong>The</strong> procedure checking for the hedonic consistency of the ideal profiles is summarized Figure 1. In this procedure, the<br />

ideal profile described <strong>by</strong> each consumer is consistent if the estimated liking potential (noted . | .. ) of the ideal product is<br />

higher than the likings scores given to the actual products <strong>by</strong> the consumer considered.<br />

But this comparison (estimated liking potential of the ideal product vs. liking scores given to the products) is only<br />

meaningful if we are sure that the ideal description provided <strong>by</strong> a consumer is not given randomly. In order to check this,<br />

the significance of the estimated liking potential of the ideal product has to be tested first.<br />

Figure 1: Procedure used to estimate the liking potential of the averaged ideal profile from a consumer.<br />

3.2.1. Significance test of the liking potential of the ideal profiles<br />

Here, the focus is on the procedure of significance testing associated with the estimated liking potential of the ideal<br />

profile, as it seems less straightforward than the one checking for the consistency of the ideal profiles presented above.<br />

According to <strong>Worch</strong> et al. (2012), an ideal profile is consistent if: 1) Its sensory profile agrees with both the sensory and<br />

hedonic ratings provided of the tested products, and 2) its estimated liking potential is high. On the contrary, an ideal<br />

profile is non‐consistent if: (1) Its sensory profile does not match the given sensory and hedonic profiles of the tested<br />

products, and/or (2) its estimated liking potential is low. In this latter case, obtaining a low liking potential implies,<br />

obviously, a mismatch between all the ratings (those of the tested products and ideal ones). This could be due to many<br />

factors, for instance, not including a relevant attribute in the list for that consumer, or that his/her performance was poor<br />

(he/she gave random ideal ratings).<br />

For that reason, testing the significance of the ideal product is done <strong>by</strong> comparing the estimated liking potential<br />

( | .. ) obtained in the real situation (denoted as the real estimated liking potential) to estimated liking potential (noted<br />

| .. ) obtained in random situations. As the difference between the real and the random situations is the consistency of<br />

the ideal data with the other descriptions, one can expect that in the real situation, the ideal description fits the individual<br />

models constructed and hence is associated to a large estimated liking potential while in the random situations, this would<br />

not be the case. <strong>The</strong> estimated liking potential is expected to be larger in the real than in the random situations.<br />

So the test performed is a one‐tailed test, and the null and alternative hypotheses are defined <strong>by</strong>:<br />

H 0 : “the ideal profile is associated to a low liking potential.”<br />

H 1 : “the ideal profile is associated to a high liking potential.”<br />

Another definition of these hypotheses can be:<br />

H 0 : “the ideal profile is defined randomly: no structure is observed in the ideal profile”<br />

H 1 : “the ideal profile is not defined randomly: a structure is observed in the ideal profile”<br />

To perform the test, the distribution under H 0 of the liking potential related to the averaged ideal product is estimated<br />

for each consumer. <strong>The</strong> procedure used here to obtain this distribution under H 0 consists in simulating many random<br />

situations (in practice 500) and to compute | .. every time. <strong>The</strong> real estimated liking potential is then positioned on this<br />

distribution according to the usual approach of hypothesis testing in statistics. Specifically, we count (in percentage) how<br />

many times the liking potential obtained in random situation is higher than the real estimated liking potential ( | .. <br />

| .. ), this percentage being used as a p‐value.<br />

<br />

106


3. Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

In practice, the random situations are obtained <strong>by</strong> random permutation of the individual hedonic judgments. This<br />

permutation procedure aims at putting consumers in situations where they would score their liking randomly without<br />

generating new liking scores.<br />

So for each consumer taken separately, random functions maintaining the marginal distributions of the liking scores<br />

are modeled based on the perceived intensities. <strong>The</strong>se individual models have no particular reason to generate high liking<br />

potentials when averaged ideal profiles are applied. In other words, the procedure proposed here measures the consistency<br />

of the hedonic judgments with the averaged ideal profile of each consumer.<br />

A summary of the simulation procedure is given Figure 2.<br />

Figure 2: Procedure used to estimate the distribution of the liking potential under H 0 .<br />

A high observed liking potential | .. is simple to interpret as it shows agreement between all types of data at once. In<br />

the opposite case, one can wonder whether the low estimation is caused <strong>by</strong> wrong hedonic judgments or incorrect ideal<br />

profiles. Obviously, this cannot be formally answered. However, it is hard to imagine a consumer providing a "good" ideal<br />

profile on one hand, and hedonic judgments which are not related to the sensory descriptions on the other hand (unless<br />

important attributes are not asked: in such situation (incomplete description), this particular case could be observed). Thus,<br />

for abusive but pragmatic reasons, the inconsistency between ideal profiles and hedonic judgments is interpreted as nonconsistent<br />

ideal profiles.<br />

3.2.2. Models<br />

In order to estimate the liking potential of the ideal products, various families of models are considered and compared.<br />

Because each family of models is applied to each consumer, as many individual models as there are consumers are<br />

estimated for each family.<br />

3.2.2.1. PLS‐regression:<br />

<strong>The</strong> first family of models considered is based on a PLS‐regression. Hence, it is denoted as . For each consumer,<br />

the liking scores are expressed in function of the perception of the products (Equation 1). <strong>The</strong> PLS‐regression is performed<br />

on one component only: for that reason, the regression weights associated with the predictors (i.e. the perceived<br />

intensities . ) are, to a multiplicative factor, the correlation coefficients between the liking scores . and the perceived<br />

intensities . (Husson & Pagès, 2003). In this regression, only the complete model is considered; no selection of significant<br />

attributes is performed.<br />

<br />

:<br />

(1)<br />

With<br />

: the constant<br />

: the regression weight associated to the attribute a on overall liking for the consumer j<br />

: the residual<br />

3.2.2.2. Danzart:<br />

<strong>The</strong> second family of models considered is based on Principal Component Regression (PCR). For each consumer, a PCA<br />

is performed on the product profile .. provided. <strong>The</strong> liking scores are then regressed on the first two dimensions of that<br />

PCA. In the regression, the linear effects, the quadratic effects and the interaction between the two first dimensions are<br />

considered in the model (Equation 2). This model corresponds to the quadratic model used in PrefMap <strong>by</strong> Danzart (1998). It<br />

is hence denoted .<br />

In the regression on principal components, a descending selection of the best model is performed.<br />

<br />

<br />

<br />

: (2)<br />

With<br />

: the constant<br />

<br />

: the regression weight associated to the dimension i on overall liking for the consumer j<br />

: the regression weight associated to the squared dimension i on overall liking for j<br />

<br />

107


3.2. Hedonic Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

<br />

: the regression weight associated to the interaction between dimensions 1 and 2 on overall liking for j<br />

: the residual<br />

3.2.2.3. PCR:<br />

<strong>The</strong> last family of models considered is also based on PCR. However, as opposed to , the liking scores are<br />

regressed on the first five principal components (as it uses the same amount of degrees of freedom as ), and only<br />

linear effects are considered here (Equation 3). This model is denoted as .<br />

Here again, a selection of the best model is performed (following the same procedure as ).<br />

<br />

:<br />

(3)<br />

With<br />

: the constant<br />

<br />

: the regression weight associated to the dimension i on overall liking for the consumer j<br />

: the residual<br />

For each family of models, the liking potential | .. of each averaged ideal product is estimated. But in that process, it<br />

is important to look at the quality of the individual models. <strong>The</strong> quality can be evaluated through the goodness of fit (R², or<br />

eventually the adjusted R² when possible) and through the significance of the individual models (p‐value) within each<br />

family. Because the degrees of freedom can differ from one consumer to another, both criteria are used. <strong>The</strong>se criteria are<br />

also used to compare the different families of models together. To do so, the distributions of the R² and of the p‐values are<br />

graphically represented and compared. In practice, an (adjusted) R² coefficient, which is higher than 0.5, is considered as<br />

acceptable.<br />

Note: the consumers for whom the model doesn’t fit the data (for instance because they have no variability in their<br />

liking scores) have to be identified. In practice, these consumers will be dismissed before any simulation and will be<br />

counted separately. This elimination is done based on a α‐risk of 10% due to the low number of degrees of freedom.<br />

4. Results<br />

4.1. Foreword: quick comparison of the models<br />

For the assessment of the reliability of the ideal descriptions, the liking potentials of the ideal products have to be<br />

estimated. Three families of models ( , and ) are used for that matter.<br />

<strong>The</strong> families of models and include in their methodology a selection of the best individual models. In<br />

some cases, this selection leads to the "elimination" of certain consumers as it is not always possible to explain the<br />

appreciation with the sensory dimensions selected, no dimension being significant. For the perfume, it is the case for 17<br />

consumers with and for 18 consumers with (with an overlap of 10 consumers). Hence, 86 models are<br />

retained for vs. 85 for .<br />

In , no global test assessing the significance of the individual models exist. Hence all individual models are<br />

retained unless the consumer gives the same hedonic score to all the products. This particular situation is not observed<br />

here.<br />

However, the assessment of the reliability is only relevant if the different individual models fit the data well. This can<br />

be checked <strong>by</strong> looking at the goodness of fit ((adjusted) R²) associated to the different families of models.<br />

4.1.1. Goodness of fit of the individual models for the different families<br />

<strong>The</strong> goodness of fit of the individual models is given <strong>by</strong> the R² coefficient. As the R² coefficient depends on the number<br />

of degrees of freedom, which varies here from one consumer to another, the adjusted R² is preferred for and<br />

. Since the notion of degrees of freedom is ambiguous in PLS regression, no adjusted R² can be calculated for .<br />

<strong>The</strong> R² coefficient is considered here.<br />

<strong>The</strong> distribution of the (adjusted) R² associated to the different families is represented Figure 3. It seems here that for<br />

all the three families of models, the (adjusted) R² coefficients are globally high (i.e. higher than 0.5). So for most consumers,<br />

the liking scores are well predicted, as the individual models fit the data. Hence, these individual models are reliable and<br />

can be used to estimate the liking potential of the different averaged ideal products.<br />

108


3. Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

Density<br />

0.0 0.5 1.0 1.5 2.0 2.5 3.0 3.5<br />

Danzart<br />

PCR<br />

PLS<br />

0.0 0.2 0.4 0.6 0.8 1.0<br />

(adjusted) R²<br />

Figure 3: Distribution of the (adjusted) R² associated to the individual models for the different families<br />

Figure 3 suggests that the best predictive family of models is . But this might be an artifact due to the use of the<br />

R² instead of the adjusted R² which is used for the other families. Figure 3 also suggests that defines individual<br />

models better than . Hence, adding more linear effects in the model seems to add more relevant information<br />

than quadratic effects and interaction.<br />

4.1.2. Significance of the estimated liking potential of the individual averaged ideal products<br />

<strong>The</strong> next step in the procedure checking for the hedonic consistency consists in checking whether the ideal<br />

descriptions are obtained randomly or not. To do so, the significance of the liking potential of the averaged ideal products is<br />

tested. This test is done based on simulations.<br />

Some individual distributions under H 0 of the liking potential of the averaged ideal products are given Figure 4. <strong>The</strong>se<br />

distributions are obtained with the . Because similar distributions are obtained with and , they are<br />

not shown here.<br />

13090<br />

12872<br />

13538<br />

Density<br />

0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7<br />

(1) pvalue= 0.002<br />

Density<br />

0.00 0.05 0.10 0.15 0.20<br />

(2) pvalue= 0<br />

Density<br />

0.0 0.5 1.0 1.5<br />

(3) pvalue= 0.022<br />

0 2 4 6 8<br />

0 2 4 6 8<br />

0 2 4 6 8<br />

ideal product likig score<br />

ideal product likig score<br />

ideal product likig score<br />

13073<br />

10147<br />

8118<br />

Density<br />

0.0 0.2 0.4 0.6 0.8 1.0 1.2<br />

(4) pvalue= 0.743<br />

Density<br />

0.0 0.2 0.4 0.6 0.8 1.0 1.2<br />

(5) pvalue= 0.453<br />

Density<br />

0 2 4 6 8<br />

(6) pvalue= 0.725<br />

0 2 4 6 8<br />

0 2 4 6 8<br />

0 2 4 6 8<br />

ideal product likig score<br />

ideal product likig score<br />

ideal product likig score<br />

Figure 4: Individual distributions of liking potentials under H 0 for averaged ideal profiles obtained with .<br />

<strong>The</strong> vertical line corresponds to the observed liking potential.<br />

109


3.2. Hedonic Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

For most of the consumers, the distribution curves are similar to the one presented in the plots (1), (2) or (3). This is<br />

confirmed <strong>by</strong> the distribution of the p‐values associated to the real estimated liking potential of the averaged ideal products<br />

(Figure 5).<br />

Please note that for some consumers, the distributions of the liking potential obtained in random situations are<br />

bimodal (i.e. plots (2) and (5)). For those consumers, two types of individual models are estimated returning respectively<br />

low or high liking potentials, intermediate values are not often found. This particular phenomenon can be explained <strong>by</strong> the<br />

also bimodal distribution of the liking scores given <strong>by</strong> these consumers to the products: these consumers tend to separate<br />

the products into two groups, one associated to low and one associated to high liking scores. For the other consumers, the<br />

distribution of the liking potential obtained in random situations is unimodal (i.e. plots (1), (3) and (4)) akin a normal<br />

distribution. For one consumer (plot (6)), the estimated liking potential is (almost) constant. This consumer didn’t<br />

discriminate the products in terms of liking. This is a particular case of as for and , the model<br />

selection procedure tends to remove these consumers, because no model can be found.<br />

For most of the consumers, the observed liking potential is significant at the 5% threshold (Figure 5). It is the case for<br />

50% of the consumers with , 40% of the consumers with and 75% of the consumers with . <strong>The</strong>se<br />

percentage increase respectively at 63%, 64% and 84% when the 10% threshold is considered.<br />

In other words, the null hypothesis is rejected for most of the consumers for the three families of models. Hence, the<br />

ideal products are associated with a high estimated liking potential that couldn’t be obtained randomly, showing that the<br />

ideal descriptions are consistent with the other descriptions (sensory and hedonic) and showing that the ideal profiles are<br />

not random descriptions.<br />

Density<br />

0.00 0.05 0.10 0.15 0.20<br />

PCR<br />

PLS<br />

5% 10%<br />

Danzart<br />

0 20 40 60 80 100<br />

P-value (%)<br />

Figure 5: Distributions of the p‐values of the observed liking potentials obtained with the different families of models.<br />

Still, differences between families of models are observed. <strong>The</strong>y can be explained <strong>by</strong> the differences between the<br />

models: the addition of extra linear effects instead of quadratic effects and interaction ( ) as well as the<br />

selection of the best models improve the quality of the adjustment, and hence the results ( ).<br />

In the rest of the document, checking for the hedonic consistency of the ideal profiles is done <strong>by</strong> using only, as it<br />

seems to be the most adequate family of models.<br />

4.2. Liking potential of the averaged ideal profiles vs. liking scores of the products<br />

Besides the significance of the estimated liking potential of the averaged ideal products, one still needs to check<br />

whether the ideal description provided <strong>by</strong> a consumer is consistent. To do so, the estimated liking potential of the averaged<br />

ideal products is compared to the liking scores given to the products, for each consumer.<br />

<strong>The</strong> liking potential of an averaged ideal profile has no value on its own. Indeed, it only makes sense when it is<br />

compared to the liking scores given to the products. Hence estimated liking potentials of the averaged ideal products are<br />

made relative to the liking scores of the products. <strong>The</strong>refore, the estimated liking potential of each averaged ideal product<br />

is standardized according to the liking scores given to the products <strong>by</strong> the consumer considered. For each consumer, the<br />

averaged liking score given to the products is subtracted from the estimated liking potential of his/her averaged ideal<br />

product. <strong>The</strong> difference is then standardized <strong>by</strong> dividing it <strong>by</strong> the standard deviation of the liking scores given to the<br />

products (Equation 4).<br />

110


3. Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

| .. .<br />

.<br />

(4)<br />

with<br />

| .. : the liking potential of the averaged ideal profile provided <strong>by</strong> the consumer j<br />

. : the averaged liking score given to the products <strong>by</strong> the consumer j<br />

. : the standard deviation of the liking scores given to the products <strong>by</strong> the consumer j<br />

By definition, this standardized liking potential is high for consumers who described consistent ideal profiles. As the<br />

quality of the individual models is of main interest for the good estimation of the liking potentials of the ideal products,<br />

these standardized liking potentials are represented in function of the adjusted R² of the corresponding individual models<br />

(Figure 6).<br />

Standardized Liking Potential<br />

-1.0 -0.5 0.0 0.5 1.0 1.5 2.0 2.5<br />

3763 171<br />

13048<br />

12574<br />

11174<br />

2936<br />

13292 9589<br />

8588<br />

8840 12872<br />

3670 11350<br />

9872<br />

13428<br />

11947 3541 6889 7622<br />

13648<br />

12291 3371<br />

1361810967 11074 12924<br />

11536 5582<br />

7679 5014<br />

13311<br />

12292<br />

11215<br />

12471 13090 12280 1761 6584<br />

553<br />

11381 1661 8096<br />

2996<br />

12706 12656 12774<br />

13617 9775<br />

991 2909<br />

7797<br />

4238 9492 3242<br />

10147 11677 12547 11776<br />

12535 9623 2119 12742 2529 10815 9373<br />

6940<br />

11574 6695<br />

13121<br />

1679<br />

1801<br />

6667<br />

9821 10639<br />

12138 3764<br />

11811<br />

1755<br />

12072 4640 9651<br />

6931<br />

13073<br />

11169<br />

9772<br />

Significance:<br />

p


3.2. Hedonic Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

<strong>The</strong> liking potential of the averaged ideal product from each consumer is estimated and compared to the liking scores they<br />

gave to the products. <strong>The</strong> significance of these estimated liking potentials has also been tested <strong>by</strong> comparing them to<br />

situations where consumers would rate their liking scores randomly.<br />

In the perfume example, the results support the use of IPM. Indeed, for most of the consumers, the ideal descriptions<br />

are reliable: the ideal descriptions are not obtained randomly (i.e. the real estimated liking potentials are significant) and<br />

the estimated liking potentials of the averaged ideal products are higher than the liking scores provided for the products<br />

themselves. This is especially true when the relationship between the hedonic judgments and the sensory descriptions is<br />

strong (i.e. individual models with a high goodness of fit). However, when this relationship is weak, it is difficult to draw<br />

conclusions about the reliability of the ideal descriptions. Indeed, in that case, the estimated liking potentials are usually<br />

not significant, and it is unclear whether it is due to the lower quality of the predictive model, or to unreliable ideal<br />

descriptions.<br />

In addition, the liking potentials of the averaged ideal profiles have been estimated according to different families of<br />

models ( , and ). In our example, seems to be the best family of models to use. Compared to<br />

, the advantage of lies in adding more linear effects at the expense of quadratic effects and interaction in<br />

the individual models. However, in our study, the comparison between and is more limited as the criteria used<br />

are not equivalent from one family of models to another.<br />

For the good understanding and the good use of ideal descriptions provided <strong>by</strong> consumers, this step checking for<br />

consistency seems essential, but it can only be applied to data collected according to the IPM. Indeed, for JAR data,<br />

important information such as the sensory profiles of the products and the individual ideal profiles is missing. It is also a<br />

good complement to the assessment of the consistency of the ideal descriptions proposed <strong>by</strong> <strong>Worch</strong> et al. (2012), which<br />

aims at studying the sensory consistency of the ideal profiles <strong>by</strong> measuring the relationship between the ideal descriptions<br />

and the sensory and hedonic ratings of the products. <strong>The</strong> consistent ideal profiles can then be used to improve the<br />

products.<br />

According to the IPM, each consumer describes as many times his/her ideal profile as he/she describes products. In<br />

order to provide a simplified methodology, the variability within consumers of the ideal descriptions has not been<br />

considered in this paper, each consumer being associated to his/her averaged ideal profile .. .<br />

References<br />

Carroll, J.D. (1972). Individual differences and<br />

multidimensional scaling. In Shepard, R.N.,<br />

Romney, A.K., & Nerloves, S. Multidimensional<br />

scaling: theory and applications in the behavioral<br />

sciences. Academic Press, New York.<br />

Danzart, M. (1998). Quadratic model in preference<br />

mapping. 4 th Sensometric Meeting, Copenhagen,<br />

Denmark, August 1998.<br />

Ennis, D.M. (2005). Analytic approaches to accounting<br />

for individual ideal points. IFPress, 8(2), 2, 3.<br />

Husson, F., & Pagès, J (2003). Nuage plan d’individus et<br />

de variables supplémentaires. Revue de statistique<br />

appliquée, 51(4), 83‐93.<br />

MacFie, H.J., Bratchell, N., Greenhoff, K., & Vallis, L.V.<br />

(1989). Designs to balance the effect of order of<br />

presentation and first‐order carry‐over effects in<br />

hall tests. Journal of Sensory Studies, 4, 129‐148.<br />

Van Trijp, H.C.M., Punter, P.H., Mickartz, F., & Kruithof,<br />

L. (2007). <strong>The</strong> quest for the ideal product:<br />

Comparing different methods and approaches.<br />

Food Quality and Preference, 18, 729‐740.<br />

<strong>Worch</strong>, T., Dooley, L., Meullenet, J.F., & Punter, P.H.<br />

(2010). Comparison of PLS dummy variables and<br />

Fishbone method to determine optimal product<br />

characteristics from ideal profiles. Food Quality and<br />

Preference, 21, 1077‐1087.<br />

<strong>Worch</strong>, T., Lê, S., & Punter, P. (2010). How reliable are<br />

the consumers? Comparison of sensory profiles<br />

from consumers and experts. Food Quality and<br />

Preference, 21, 309‐318.<br />

<strong>Worch</strong>, T., Lê, S., Punter, P.H., & Pagès, J. (2012).<br />

Assessment of the consistency of ideal profiles<br />

according to non‐ideal data for the <strong>Ideal</strong> <strong>Profile</strong><br />

Method. Food Quality and Preference, 24, 99‐110.<br />

Stone, H., Sidel, J., Oliver, S., Woosley, A., & Singleton,<br />

R.C. (1974). Sensory evaluation <strong>by</strong> quantitative<br />

descriptive analysis. Food Technology, 28, 24‐34.<br />

112


3. Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

In this article, three models are used to estimate the liking potential of the ideal profiles provided from the<br />

consumers. Simulations are also performed in order to check whether the ideals are meaningful or obtained<br />

randomly. A more detailed comparison of the models, and more precisely of and will be<br />

presented in the next section.<br />

3.2.2. Complementary results on the simulations<br />

<strong>The</strong> (hedonic) consistency of the ideal profile provided <strong>by</strong> a consumer is based on liking and checks<br />

whether this ideal product would be potentially more liked than the actual products. As the liking potential of<br />

the ideal product cannot be measured, it was estimated and compared to the liking scores provided <strong>by</strong> this<br />

consumer for the actual products. An ideal profile is consistent if the estimated liking potential is larger than<br />

the liking scores given to the products. This methodology makes sense if the ideal profile provided <strong>by</strong> a<br />

consumer was not given randomly. This can be checked with the significance test proposed in the article<br />

presented in §3.3.1. This significance test was performed <strong>by</strong> comparing the estimated liking potential obtained<br />

in the real situation (denoted as real estimated liking potential) with the estimated liking potential obtained in<br />

random situations. <strong>The</strong> distribution under H 0 (i.e. ideal data are given randomly) of the liking potential related<br />

to the averaged ideal product was estimated for each consumer, and the real estimated liking potential was<br />

positioned on this distribution according to the usual approach of hypothesis testing in statistics.<br />

In principle, these random situations could be obtained <strong>by</strong> randomly generating all data (sensory profiles,<br />

ideal profiles and hedonic scores), but this procedure is not accurate enough to allow for precise conclusions<br />

about the (hedonic) consistency of the ideal profiles. Another solution is to permute the data in the different<br />

tables separately, while maintaining the marginal distributions. Since the ideal profile should be associated (1)<br />

to a model which gives a good estimate of the hedonic judgment and (2) to a strong hedonic potential, the<br />

sensory descriptions are kept unchanged (i.e. not permuting the sensory profiles) as their consistency is not<br />

challenged here. Another option would be to randomly simulate the averaged ideal profiles. Despite the<br />

realness of that procedure, such simulations do not take into account the relative position of the averaged<br />

ideal profiles compared to the products’ profiles. And <strong>by</strong> destroying this relationship, an important part of the<br />

realism of the simulated data is lost as the relationship between ideal and perceived intensities no longer<br />

matches. Hence the best solution seems to randomly permute the hedonic judgments only: this corresponds to<br />

situations where consumers would rate the products on liking randomly, while keeping the same hedonic<br />

scores. For each consumer, random functions which maintain the marginal distributions of the liking scores are<br />

modeled based on the perceived intensities. <strong>The</strong>se individual models have no particular reason to generate<br />

high liking potentials when averaged ideal profiles are applied, as no particular link between the liking scores<br />

and the sensory descriptions is expected. In other words, the procedure proposed here measures the<br />

consistency of the hedonic judgments and the sensory description with the averaged ideal profile of each<br />

consumer.<br />

3.2.2.1. Comparison of and <br />

PrefMap users tend to consider a complex quadratic model (including quadratic effects and interaction as<br />

proposed <strong>by</strong> Danzart) over a simpler linear model including more dimensions. Do the quadratic effects and<br />

interactions bring more information than additional dimensions?<br />

113


3.2. Hedonic Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

In this study, two families of models which only differ in the dimensions considered are compared:<br />

considers the dimension 1 and 2 as well as their quadratic effects and interactions while only<br />

considers the linear effect of the 5 first dimensions. <strong>The</strong>se models were considered since they require the same<br />

amount of degrees of freedom (before any selection).<br />

<strong>The</strong> comparison of the individual models obtained with and is done <strong>by</strong> looking at the<br />

relevance of the effects considered. To do so, a procedure testing the significant effects in both families of<br />

models is set up. This procedure is applied for all individuals in each project.<br />

In this procedure, a relevant effect is defined as being an effect that would bring important information to<br />

explain liking. On the contrary, a non‐relevant effect is defined as an effect that would bring information that<br />

could be obtained randomly. In that sense, checking for the relevance of an effect is done <strong>by</strong> comparing its<br />

relevance at the panel level in real and random situations. For each consumer, a backward selection of the best<br />

model is performed, non‐relevant effects being discarded from the final model. Finally, for each effect, the<br />

amount of consumers for whom this information is relevant to explain liking (i.e. it is kept in the final model<br />

after backward selection) is counted. In practice, the random situations were obtained <strong>by</strong> permutation of the<br />

individual liking ratings. This permutation procedure aims at putting consumers in situations where they would<br />

rate their liking randomly but without generating new liking scores. In this case, one cannot expect any<br />

particular reason why a sensory dimension (or its quadratic version) could be relevant for the prediction of the<br />

liking ratings. <strong>The</strong> test performed set up here is a one‐tailed test. <strong>The</strong> null and alternative hypotheses are<br />

defined <strong>by</strong>:<br />

H 0 : “the effect is not relevant to explain liking.”<br />

H 1 : “the effect is relevant to explain liking.”<br />

To perform the test, the distribution under H 0 of the relevance of each effect is estimated. This distribution<br />

is obtained <strong>by</strong> simulating many random situations (in practice 500) and <strong>by</strong> counting for each simulation the<br />

amount of consumers for whom this effect would be relevant (i.e. the effect is maintained in the final model<br />

after selection). <strong>The</strong> real amount of consumers having this effect as relevant is then positioned on this<br />

distribution according to the usual approach of hypothesis testing in statistics. Specifically, we count (in<br />

percentage) how many times the number of consumers obtained in random situation is higher than the real<br />

amount of consumers, this percentage being used as a p‐value. A summary of the simulation procedure is given<br />

Figure 3.7.<br />

Figure 3.7: Summary of the simulation procedure used to check the significance of the effects<br />

Finally, and are compared <strong>by</strong> looking at the relative relevance of each of their effects<br />

tested in the models. If the quadratic effects and interaction are more relevant than the dimensions 3 and<br />

114


3. Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

higher, the use of instead of is justified. In the opposite case, using is more accurate for<br />

predicting the liking ratings based on the sensory dimensions.<br />

For the perfume project, the distributions under H 0 for and are shown Figure 3.8:<br />

Figure 3.8: Distribution under H 0 of the amount of consumers for whom each effect appears to be relevant on liking.<br />

<strong>The</strong> distributions under H 0 for each effect of the amount of consumers for whom it is relevant show similar<br />

results within the family of model and differ between families. <strong>The</strong> thresholds at 5% and 10% can be<br />

considered as fixed for the five effects within a family, but are different from one family to another. In this<br />

example, is associated with a larger 95%‐quartile than . In other words, the test associated to<br />

seems stricter.<br />

For the 24 projects, the real amount of consumers is positioned on these distributions. <strong>The</strong> 95‐quantile is<br />

given for each effect in Table 3.7. <strong>The</strong> results show that the 95%‐quartiles are always higher for than<br />

for . In other words, the test associated with is always stricter than the one associated with<br />

. And these amounts are always larger than 5% of the total number of consumers present in the panel.<br />

Considering 5% of the consumers as a threshold leads to a wrong approximation. More explanations<br />

concerning this remark are given in §3.2.2.2.<br />

115


3.2. Hedonic Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

<br />

<br />

Dim1 Dim2 Dim1² Dim2² Dim1*Dim2 Dim1 Dim2 Dim3 Dim4 Dim5 5% #cons.<br />

Applesauce 40 38 45 40 39 39 33 32 31 31 9<br />

Beer 20 20 20 20 21 17 17 16 16 16 4<br />

Croissants 31 29 31 29 30 27 25 23 23 23 8<br />

Donuts1 30 27 33 28 31 29 25 24 24 23 6<br />

Donuts2 41 37 39 36 37 38 31 29 29 30 8<br />

Licorice 19 17 20 16 18 21 13 13 14 13 4<br />

Coffee 18 19 19 19 19 17 15 14 15 16 4<br />

Salad 16 16 17 16 18 14 13 12 12 13 4<br />

Water 36 36 36 36 37 30 29 29 28 29 8<br />

Perfume 18 16 16 16 17 13 12 12 11 12 5<br />

Rye bread 36 34 35 33 35 35 28 27 28 29 8<br />

Cream yoghurt1 35 34 38 35 35 34 31 30 30 30 6<br />

Cream yoghurt2 23 23 25 23 26 22 18 18 18 18 6<br />

Ice cream 15 15 15 14 15 11 12 11 11 12 4<br />

Soup1 23 22 22 23 23 19 18 17 17 16 5<br />

Soup2 23 21 22 21 23 21 18 17 17 17 5<br />

Flavour wat. 16 15 16 15 17 13 12 12 12 12 4<br />

Lemon wat. 22 21 24 20 22 22 17 17 16 16 5<br />

Candy bar 23 24 23 22 23 22 21 20 20 20 4<br />

Vanilla des. 18 18 18 18 18 18 15 16 14 15 4<br />

Milk drink 25 25 26 25 26 23 22 21 22 21 4<br />

Yoghurt1 20 20 20 20 20 17 17 16 16 16 4<br />

Yoghurt2 24 22 24 24 23 20 18 18 18 18 6<br />

Org. yoghurt 29 28 30 28 30 30 24 23 24 23 6<br />

Table 3.7: 95% quartile associated with the different effects for and .<br />

From these quartiles, the corresponding p‐values associated with the relevance of the different effects are<br />

computed (Table 3.8).<br />

116


3. Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

<br />

<br />

Dim1 Dim2 Dim1² Dim2² Dim1*Dim2 Dim1 Dim2 Dim3 Dim4 Dim5<br />

Applesauce 0,000 0,000 0,123 0,006 0,173 0,000 0,000 0,022 0,821 0,402<br />

Beer 0,000 0,651 0,325 0,506 0,422 0,000 0,012 0,084 0,217 0,831<br />

Croissants 0,000 0,000 0,020 0,227 0,933 0,000 0,000 0,027 0,480 0,193<br />

Donuts1 0,000 0,016 0,000 0,208 0,696 0,000 0,000 0,000 0,000 0,392<br />

Donuts2 0,000 0,054 0,723 0,488 0,873 0,000 0,000 0,199 0,753 0,319<br />

Licorice 0,000 0,000 0,076 0,873 0,101 0,000 0,000 0,025 0,443 0,633<br />

Coffee 0,000 0,000 0,053 0,263 0,211 0,000 0,000 0,092 0,118 0,947<br />

Salad 0,000 0,000 0,284 0,247 0,198 0,000 0,000 0,000 0,272 0,049<br />

Water 0,000 0,000 0,000 0,062 0,037 0,000 0,000 0,000 0,191 0,531<br />

Perfume 0,000 0,000 0,020 0,461 0,373 0,000 0,000 0,000 0,000 0,000<br />

Rye bread 0,000 0,000 0,269 0,827 0,936 0,000 0,000 0,000 0,160 0,160<br />

Cream yoghurt1 0,000 0,102 0,449 0,843 0,551 0,000 0,000 0,354 0,189 0,252<br />

Cream yoghurt2 0,000 0,000 0,031 0,520 0,803 0,000 0,000 0,000 0,087 0,118<br />

Ice cream 0,000 0,000 0,000 0,012 0,711 0,000 0,000 0,000 0,072 0,024<br />

Soup1 0,000 0,000 0,065 0,509 0,370 0,000 0,000 0,000 0,231 0,250<br />

Soup2 0,000 0,000 0,019 0,039 0,019 0,000 0,000 0,000 0,534 0,854<br />

Flavour wat. 0,000 0,000 0,073 0,220 0,646 0,000 0,000 0,000 0,305 0,573<br />

Lemon wat. 0,000 0,000 0,101 0,556 0,010 0,000 0,000 0,000 0,364 0,636<br />

Candy bar 0,000 0,088 0,362 0,038 0,425 0,000 0,000 0,150 0,488 0,950<br />

Vanilla des. 0,000 0,000 0,040 0,520 0,400 0,000 0,000 0,520 0,533 1,000<br />

Milk drink 0,000 0,011 0,736 0,034 0,115 0,000 0,000 0,092 0,690 0,885<br />

Yoghurt1 0,000 0,060 0,229 0,398 0,024 0,000 0,000 0,205 0,012 0,060<br />

Yoghurt2 0,000 0,000 0,078 0,483 0,991 0,000 0,000 0,000 0,017 0,112<br />

Org. yoghurt 0,000 0,000 0,500 0,413 0,452 0,000 0,000 0,016 0,048 0,937<br />

Table 3.8. P‐value associated with the different effects for and .<br />

<strong>The</strong> first dimension is always highly significant for both families of models. Hence, the first dimension of<br />

the PCA contains always relevant information to describe the liking scores. <strong>The</strong> second dimension is always<br />

significant for , but not for . Indeed, for 5 out of 24 projects, the second dimension is not<br />

significant at 5% (2 of them also being not significant at 10%). For , Dim1² is significant for 8 projects<br />

(vs. 13) at 5% (vs. 10%) while Dim2² is significant for 5 projects (vs. 6) at 5% (vs. 10%) and the interaction<br />

Dim1:Dim2 for 4 projects at both 5% and 10%. For , Dim3 is significant for 16 projects (vs. 19) while Dim4<br />

is significant for 5 projects (vs. 7) and Dim5 for 3 (vs. 4) projects at 5% (vs. 10%).<br />

From these results, it appears that is associated with more relevant effects than , Dim 3<br />

being more often significant than Dim1², Dim2² or Dim1:Dim2, which only seems to bring relevant information<br />

in few cases. However, it seems like Dim4 and Dim5 do not bring much relevant information since it is rarely<br />

significant. Hence, the most important effects for describing the liking scores are the dimensions 1 and 2,<br />

eventually followed <strong>by</strong> the dimension 3 and the squared dimension 1 (Dim1²). <strong>The</strong> dimensions 4 and 5, the<br />

squared dimension 2 (Dim2²) and the interaction between the two first dimensions (Dim1:Dim2) seem to be<br />

less relevant and can be discarded from the analysis.<br />

<strong>The</strong> quadratic model proposed <strong>by</strong> Danzart and extensively used in external Preference Mapping seems<br />

sometimes less adequate than a linear model which considers more dimensions. More specifically, the most<br />

relevant effects (ordered according to their importance on explaining the liking scores) are Dim1, Dim2, Dim3<br />

and Dim1², the other effects being less relevant. To improve the methodology, a new family of individual<br />

117


3.2. Hedonic Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

models could be considered. It would be a mix between and , the following effects would be<br />

considered (Equation 3.7):<br />

<br />

: <br />

<br />

<br />

<br />

<br />

<br />

<br />

<br />

<br />

(3.7)<br />

With<br />

: the constant<br />

<br />

: the regression weight associated to the dimension i on overall liking for the consumer j<br />

<br />

: the regression weight associated to the squared dimension i on overall liking for j<br />

: the residual<br />

3.2.2.2. Error α in the selection of models<br />

In the previous section, it has been shown that the 95% quartile is always higher than 5% of the total<br />

amount of consumers. This is a side effect of the procedure of selecting the adequate model <strong>by</strong> removing the<br />

non‐significant effect. Explanations concerning this side effect will be given through simulations.<br />

Both D and PCR are based on Principal Components Regressions. In practice, a PCA per consumer<br />

was performed on the sensory profile he/she provided. <strong>The</strong> adequate dimensions of interest (i.e. 2 for<br />

D and 5 for PCR ) were extracted and the vector of liking ratings was regressed on these dimensions<br />

(permuted in random situations). <strong>The</strong> number of times each effect was significant (at 5%) in the final model<br />

was counted in real and random situations. Before any counts, backward selection of the best model and/or<br />

filter based on the global F‐test of the model can be used. Finally, the distribution under H 0 associated to each<br />

effect was obtained based on the simulation of the random situations, and the real count obtained was<br />

positioned on that distribution. According to this procedure, one might expect that the significance threshold<br />

obtained is set at 5% of the panel size, but the results obtained previously showed that the threshold was<br />

higher for each project.<br />

Here, different types of simulations depending on the two parameters (selection and filter) are performed.<br />

In this case, the selection consists in keeping only the significant effect while the filter considers only the<br />

significant effects for the models associated with a significant global F‐test. In practice, three different<br />

simulations were used:<br />

- no selection and no filter;<br />

- no selection and filter;<br />

- selection of the best model (filter is useless in that case).<br />

<strong>The</strong> use of a filter was not necessary when a backward selection of the best model is performed. In the<br />

contrary, when no selection was performed, the full model was considered and the dimensions that were<br />

significant in that model were counted. In this case, an extra filter through the global F‐test was used. In this<br />

case, only the significant effects of the significant models (global F test) were counted.<br />

No selection and no filter<br />

When no selection of the best model was performed, taking 1, 2, 5 or 10 dimensions does not make a<br />

difference as the effects (i.e. dimensions of the PCA) are orthogonal <strong>by</strong> construction (Figure 3.9). Under H 0 ,<br />

each effect is significant at around 5% of the cases.<br />

118


3. Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

Figure 3.9: Significance of the effects (no filters and no selection performed) with .<br />

No selection and filter<br />

<strong>The</strong> addition of the filter changes the results. And taking 1, 2, 5 or 10 dimensions into consideration makes<br />

a difference, as it changes the results of the global test (Figure 3.10). In the case where only one dimension was<br />

considered (Figure 3.10a), we were in the previous situation where the global F‐test corresponds to the t‐test<br />

of the first dimension. In that case, adding an extra filter does not change the results, and the 5% threshold is<br />

obtained. When the number of dimension increases (Figure 3.10b, c and d), the F‐test was different from the t‐<br />

test of one particular effect, and the significance threshold was lower than 5%. As we can see, it drops to<br />

around 2.5%. This drop is explained <strong>by</strong> the addition of the filter: when no filter was applied, all the significant<br />

effects were considered. In the contrary, when a filter was applied, only the significant effects within the<br />

significant models were considered. Hence, this test was stricter.<br />

Figure 3.10: Significance of the effects (no selection; filter) with PCR<br />

when 1 (a), 2 (b), 5 (c) or 10 (d) dimensions are considered.<br />

119


3.2. Hedonic Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

Selection of the best model<br />

When one dimension was considered, we were still in the first situation where the significance threshold<br />

was at 5% (Figure 3.11a). But as soon as more than one dimension was considered, the threshold increased to<br />

5.4% with 2 dimensions (Figure 3.11b), to 7.2% with 5 dimensions (Figure 3.11c) and to 16% with 10<br />

dimensions (Figure 3.11d) in this example.<br />

Figure 3.11: Significance of the effects after selection of the best model with PCR<br />

when 1 (a), 2 (b), 5 (c) or 10 (d) dimensions are considered.<br />

This increase is related to the addition of dimensions in the model. Indeed, when only one dimension was<br />

considered, the significance threshold was at 5% <strong>by</strong> construction. When a second dimension was added, the<br />

significance threshold increased, each dimension being significant in at least 5% of the cases (which<br />

corresponds to the situations where that dimension was significant on its own) to which was added the cases<br />

where the model was only significant when both dimensions were significant. When a third dimension was<br />

added, a dimension was significant on its own in 5% of the cases to which should be added the situations<br />

where it was significant with one of the two (or the two) others dimensions. At the end, the significant<br />

threshold increased every time a dimension was added to the model, this threshold being minimized <strong>by</strong> 5%<br />

when one unique dimension was considered.<br />

As soon as a selection of the best model was performed, the significant threshold used in the analysis was<br />

unknown as we were not under H 0 anymore. Indeed, with five dimensions, considering here a threshold at 5%<br />

would be wrong as it corresponds to an alpha error of 7.2%. And unfortunately, no rules determining this<br />

threshold can be formulated. This is why the distribution under H 0 has to be estimated every time. <strong>The</strong><br />

variation of the threshold with the projects is shown in Table 3.7.<br />

Still, a tendency is observed: for , the threshold is always lower than for . This might be due<br />

to the independence of all the effects in the case of which is not verified in the case of , where<br />

dependence between the effects can be observed.<br />

120


3. Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

3.2.3. General conclusions on the hedonic consistency of the ideal data<br />

In the article presented in §3.3.1, a methodology for checking the (hedonic) consistency of the ideal<br />

profiles is proposed. <strong>The</strong> application of this methodology on the 24 projects are presented in here.<br />

In this methodology, the liking potential of the individual averaged ideal profiles is estimated based on 3<br />

types of individual models: , and . In the case of and , a selection of the<br />

best model is performed. This selection can conduct to the elimination of consumers for whom the liking<br />

ratings cannot be explained <strong>by</strong> the sensory description. Since no selection is performed in the case of ,<br />

only the consumers showing no variability in their liking ratings are discarded in that case. Overall, about 15%‐<br />

25% of consumers were "discarded" for and (Table 3.9), half of them being removed in both<br />

cases. For the other half, the elimination in one case and not the other can be explained <strong>by</strong> the different nature<br />

of the models. In other words, for 75%‐85% of the consumers, the liking ratings provided can be explained <strong>by</strong><br />

at least one of the dimension of the PCA performed on the sensory profiles they provided.<br />

Project # cons. family<br />

# indiv.<br />

models<br />

# common<br />

elimination<br />

signif. at<br />

5%<br />

pct. at<br />

5%<br />

signif. at<br />

10%<br />

Applesauce 180 PLS 178 57 0,320 96 0,539<br />

Danzart 151 36 0,238 71 0,470<br />

PCR 147<br />

17<br />

75 0,510 112 0,762<br />

Beer 84 PLS 82 32 0,390 52 0,634<br />

Danzart 59 14 0,237 31 0,525<br />

PCR 62<br />

14<br />

39 0,629 56 0,903<br />

Croissants 151 PLS 151 69 0,457 97 0,642<br />

Danzart 118 41 0,347 71 0,602<br />

PCR 116<br />

18<br />

79 0,681 100 0,862<br />

Donuts 1 126 PLS 126 41 0,325 56 0,444<br />

Danzart 101 20 0,198 39 0,386<br />

PCR 106<br />

13<br />

41 0,387 70 0,660<br />

Donuts 2 167 PLS 167 82 0,491 106 0,635<br />

Danzart 138 29 0,210 72 0,522<br />

PCR 139<br />

16<br />

84 0,604 111 0,799<br />

Licorice 80 PLS 80 13 0,163 20 0,250<br />

Danzart 64 11 0,172 20 0,313<br />

PCR 60<br />

7<br />

26 0,433 42 0,700<br />

Coffee 77 PLS 75 46 0,613 60 0,800<br />

Danzart 69 19 0,275 36 0,522<br />

PCR 66<br />

7<br />

41 0,621 57 0,864<br />

Meal salad 82 PLS 82 42 0,512 59 0,720<br />

Danzart 64 21 0,328 45 0,703<br />

PCR 70<br />

7<br />

46 0,657 62 0,886<br />

Water 163 PLS 162 51 0,315 69 0,426<br />

Danzart 124 25 0,202 50 0,403<br />

PCR 110<br />

22<br />

55 0,500 72 0,655<br />

Perfume 103 PLS 103 51 0,495 65 0,631<br />

Danzart 86 34 0,395 55 0,640<br />

PCR 85<br />

9<br />

64 0,753 71 0,835<br />

Rye bread 157 PLS 156 84 0,538 114 0,731<br />

pct. at<br />

10%<br />

121


3.2. Hedonic Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

Danzart 132 36 0,273 75 0,568<br />

PCR 139<br />

11<br />

108 0,777 124 0,892<br />

Cream yoghurt 1 128 PLS 128 35 0,273 61 0,477<br />

Danzart 94 14 0,149 28 0,298<br />

PCR 93<br />

19<br />

37 0,398 52 0,559<br />

Cream yoghurt 2 128 PLS 128 35 0,273 57 0,445<br />

Danzart 93 24 0,258 46 0,495<br />

PCR 100<br />

13<br />

47 0,470 75 0,750<br />

Ice cream 84 PLS 84 46 0,548 60 0,714<br />

Danzart 78 32 0,410 51 0,654<br />

PCR 74<br />

3<br />

62 0,838 70 0,946<br />

Soup 1 109 PLS 109 42 0,385 64 0,587<br />

Danzart 78 20 0,256 41 0,526<br />

PCR 81 17 50 0,617 63 0,778<br />

Soup 2 104 PLS 104 43 0,413 63 0,606<br />

Danzart 82 21 0,256 39 0,476<br />

PCR 82<br />

13<br />

45 0,549 67 0,817<br />

Flavored water 83 PLS 81 47 0,580 62 0,765<br />

Danzart 60 30 0,500 41 0,683<br />

PCR 62<br />

15<br />

47 0,758 54 0,871<br />

Lemon water 100 PLS 99 33 0,333 53 0,535<br />

Danzart 80 18 0,225 40 0,500<br />

PCR 79<br />

7<br />

43 0,544 57 0,722<br />

Candy bar 81 PLS 80 29 0,363 40 0,500<br />

Danzart 64 14 0,219 28 0,438<br />

PCR 65<br />

8<br />

32 0,492 45 0,692<br />

Vanilla dessert 76 PLS 75 33 0,440 48 0,640<br />

Danzart 68 17 0,250 37 0,544<br />

PCR 63<br />

6<br />

43 0,683 53 0,841<br />

Milk drink 88 PLS 88 44 0,500 63 0,716<br />

Danzart 77 8 0,104 18 0,234<br />

PCR 73<br />

7<br />

49 0,671 59 0,808<br />

Yoghurt 1 84 PLS 82 24 0,293 46 0,561<br />

Danzart 66 16 0,242 28 0,424<br />

PCR 64<br />

6<br />

36 0,563 51 0,797<br />

Yoghurt 2 117 PLS 115 44 0,383 73 0,635<br />

Danzart 92 23 0,250 54 0,587<br />

PCR 96<br />

11<br />

61 0,635 79 0,823<br />

Organic yoghurt 127 PLS 127 53 0,417 83 0,654<br />

Danzart 104 22 0,212 46 0,442<br />

PCR 102<br />

16<br />

67 0,657 88 0,863<br />

Mean PLS 110,92 44,83 0,41 65,29 0,59<br />

Danzart 88,92 22,71 0,26 44,25 0,50<br />

PCR 89,25 53,21 0,60 70,42 0,80<br />

Std. deviation PLS 16,38 0,11 21,21 0,13<br />

Danzart 8,64 0,09 16,02 0,12<br />

PCR 18,90 0,12 21,98 0,09<br />

Table 3.9: Overview of the results obtained with the different families of models for the different projects.<br />

122


3. Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

<strong>The</strong> procedure checking for the hedonic consistency of the ideal data is based on individual models<br />

explaining one consumer liking scores in function of his/her perception of the products. Once estimated, the<br />

liking potential of the ideal product is compared to the liking scores given to the products tested. This<br />

procedure only makes sense if two main properties are accepted: (1) the individual models predict well the<br />

hedonic scores based on the sensory descriptions and (2) the consumers provide accurate ideal profiles.<br />

3.2.3.1. Quality of the individual models<br />

Before estimating the liking potentials of the ideal products, one has to be sure that the individual models<br />

used fit well the data. <strong>The</strong> quality of the individual models is evaluated according to the (adjusted) R².<br />

Figure 3.12 shows that for the 24 projects, the distributions of the (adjusted) R² obtained with the different<br />

families of model are almost always high. <strong>The</strong> median is always larger than 0.7, except for 5 projects with<br />

and 2 projects with .<br />

123


3.2. Hedonic Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

Figure 3.7: Distribution of the individual (adjusted) R² coefficients<br />

obtained with the different families of models for each project.<br />

<strong>The</strong> individual models defined according to the different families predict the liking ratings from the sensory<br />

description of the products well. Hence, the individual models obtained here can be used to estimate the liking<br />

potential of the ideal products. A closer look to the results seems to show that the individual models obtained<br />

with show slightly higher goodness of fit than . Hence it seems that adding extra linear effects<br />

brings more actionable information in terms of prediction than quadratic effects and interaction between<br />

dimensions. <strong>The</strong> comparison with is more difficult since R² coefficients are compared to adjusted R².<br />

124


3. Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

3.2.3.2. Significance of the liking potential<br />

To check the accuracy of the ideal profiles provided from consumers, the statistical test developed in the<br />

article presented in §3.2.1. is used. In this test, the real predicted liking potentials are compared to liking<br />

potentials obtained in random situations. <strong>The</strong> application to the 24 projects of this significance test shows the<br />

following results (Figure 3.13).<br />

125


3.2. Hedonic Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

Figure 3.13: Distribution of the p‐values showing the accuracy of the averaged ideal profiles.<br />

For most of the projects, the distributions show low p‐values expressing that the ideal ratings are not given<br />

randomly <strong>by</strong> the consumers. However, depending on the project and family of models considered, differences<br />

in the results are observed. For few projects (5 out of 24), returns p‐values for which the median is higher<br />

than 0.1. For these projects, the accuracy of the ideal profiles is questionable. In these cases, also<br />

returns high p‐values (median higher than 0.1) although they are globally smaller than for .This particular<br />

result was never observed with , the median being always lower than 0.1. For most of the projects (22<br />

out of 24 projects) it is even lower or equal to 0.05.<br />

seems more adequate to find a link between the hedonic and sensory descriptions of the products<br />

than . This confirms the results obtained §3.3.4.1 showing higher adjusted R² coefficient.<br />

3.2.3.3. (hedonic) consistency of the ideal profiles<br />

<strong>The</strong> two conditions of (1) having individual models predicting well the hedonic scores based on the sensory<br />

descriptions and of (2) having accurate ideal profiles from consumers being checked, the hedonic consistency<br />

of the ideal products can be verified. It is done <strong>by</strong> comparing the estimation of the liking potential of the ideal<br />

products with the liking scores given to the products. To simplify the results, the estimated liking potential of<br />

the averaged ideal profiles are standardized according to the liking scores provided to the actual products. <strong>The</strong><br />

results obtained for the 24 projects are presented in Figure 3.14.<br />

126


3. Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

127


3.2. Hedonic Consistency of the <strong>Ideal</strong> <strong>Profile</strong>s<br />

Figure 3.14: Standardized liking potentials of the averaged ideal profiles obtained for each project.<br />

High standardized liking potentials were observed for all the different projects. Indeed, the median is<br />

positive and higher than 0.5 for 20 projects. It is particularly the case for the flavored water project which<br />

shows almost only high and positive standardized liking potentials. However, in most projects, negative<br />

standardized liking potentials were observed. <strong>The</strong>se negative standardized liking potentials correspond to some<br />

consumers providing ideal profiles which cannot be considered consistent.<br />

From this meta‐analysis, the majority of individual ideal profiles obtained from consumers can be<br />

considered as consistent.<br />

128


4. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong>s as a<br />

Tool for Optimization


4.1. Pre‐Treatment<br />

of the Data


4. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong>s as a Tool for Optimization<br />

Although the ideal profiles are not estimated but measured directly from consumers, the IPM can be<br />

associated to the <strong>Ideal</strong> Point Methods, such as the Landscape Segmentation Analysis (LSA, Ennis,2005), the<br />

Euclidean Distance <strong>Ideal</strong> Point Mapping (EDIPM, Meullenet, Lovely, Threlfall, Morris, & Striegler, 2008), and at<br />

some extent the external Preference Mapping (PrefMap, Carroll, 1972, Danzart, 1998) since they are used for<br />

the portfolio optimization. Indeed, for each of these techniques, the ideal profiles obtained (directly or<br />

estimated) are used to guide product developers improving the products.<br />

<strong>The</strong> optimization part of the <strong>Ideal</strong> <strong>Profile</strong> Analysis (IPA) is presented here. After (1) checking for the<br />

consistency both at the sensory and hedonic points of view of the ideal data provided from consumer (see §3.1<br />

and §3.2 for more information), this procedure involves (2) defining homogeneous clusters of consumers<br />

showing similar liking patterns and homogeneous sub‐categories of products associated to an unique ideal<br />

(presented in §4.1), (3) the definition of an adequate ideal product used as a reference to match (presented in<br />

§4.2) and (4) the procedure guiding on improvement, which takes care of the weight of the attributes on the<br />

liking scores. This different point will be presented independently in the following sections (presented in §4.3).<br />

Here again, when applicable, the sections will be articulated around submitted or accepted articles to the<br />

journal Food Quality and Preference and their complementary studies. <strong>The</strong> methodology developed here is<br />

applied to the 24 previous projects presented in the introduction (see §1.) and general conclusions will be<br />

drawn when possible.<br />

4.1.1. Clustering<br />

For the optimization of the tested products, the ideal profiles provided <strong>by</strong> the consumers are playing an<br />

important role. But since the ideal information is strongly related to liking, one has to be sure that the<br />

optimization is performed on groups of consumers having the same liking patterns. <strong>The</strong> clusters can be defined<br />

following the classical methodologies in sensory studies. <strong>The</strong> different clusters of consumers are thus obtained<br />

based on the consumers´ liking patterns.<br />

For the croissant project, the PCA performed on the consumers preferences (Table 4.1) return the results<br />

presented in Figure 4.1. In this case, the data is centered and scaled <strong>by</strong> consumer, and the PCA is performed on<br />

the covariance matrix.<br />

Consumer 1<br />

…<br />

Consumer j<br />

Product 1 … Product p … Product P<br />

. <br />

.<br />

…<br />

Consumer J<br />

Table 4.1: Organization of the hedonic scores used to define clusters.<br />

133


4.1. Pre‐Treatment of the Data<br />

Figure 4.1: PCA on the covariance matrix performed on the consumers’ hedonic ratings for the croissant study.<br />

Based on this consumers’ configuration, clusters can be defined. <strong>The</strong> procedure used here is a hierarchical<br />

clustering on principal component (function HCPC in FactoMineR, Lê, Josse, & Husson, 2008; Husson, Lê, &<br />

Pagès, 2009). In this analysis, since all the dimensions of the PCA are used, using the PCA results or the raw<br />

dataset would return the exact same results. Nevertheless, since the PCA also return a convenient graphical<br />

representation of the consumer space, this procedure is preferred here.<br />

In this example, this procedure would propose to cut the panel of consumers into three classes (Figure<br />

4.2a and Figure 4.2b).<br />

Figure 4.2a: Clusters of consumers based on the hedonic ratings obtained for the croissant study.<br />

134


4. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong>s as a Tool for Optimization<br />

Figure 4.2b: Dendrogram associated with the cluster analysis based on hedonic ratings.<br />

Since the ideal ratings are involving liking information, one could consider performing the cluster analysis<br />

on the averaged ideal profiles instead of the liking scores. In this case, consumers belonging to the same cluster<br />

share similar ideal characteristics. To do so, the ideal space is created <strong>by</strong> PCA (Figure 4.3) on the corrected<br />

averaged ideal profiles .. . (Table 4.2).<br />

Attr. 1 … Attr. a … Attr. A<br />

Consumer 1<br />

…<br />

Consumer j ̃.<br />

…<br />

Consumer J<br />

Table 4.2: Organization of the corrected ideal profiles used to define clusters.<br />

Figure 4.3: PCA performed on the consumers’ corrected ideal profiles for the croissant study.<br />

135


4.1. Pre‐Treatment of the Data<br />

<strong>The</strong> same clustering methodology is applied to this configuration of consumers. Here again, the procedure<br />

proposes to segment the consumers in three groups (Figure 4.4a and Figure 4.4b).<br />

Figure 4.4a: Clusters of consumers based on the ideal profiles obtained for the croissant study.<br />

Figure 4.4b: Dendrogram associated with the cluster analysis based on the translated ideal ratings.<br />

In this case, the two classifications are independent (p‐value of the test of 0.856). It is actually the case<br />

in most of the projects (Table 4.3).<br />

136


4. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong>s as a Tool for Optimization<br />

df p‐value df p‐value<br />

Applesauce 13,75 8 0,09 Cream yoghurt 2 8,83 6 0,18<br />

Beer 4,83 9 0,85 Ice cream 7,22 6 0,30<br />

Croissant 1,33 4 0,86 Soup 1 6,75 9 0,66<br />

Donuts 1 10,11 4 0,04 Soup 2 11,32 6 0,08<br />

Donuts 2 9,86 6 0,13 Flavoured water 8,68 6 0,19<br />

Licorice 13,22 6 0,04 Lemon water 4,88 4 0,30<br />

Coffee 20,21 6 0,00 Candy bar 7,50 6 0,28<br />

Meal salad 2,09 6 0,91 Vanilla dessert 11,37 8 0,18<br />

Water 2,49 4 0,65 Milk drink 4,73 4 0,32<br />

Perfume 6,20 6 0,40 Yoghurt 1 4,52 4 0,34<br />

Rye bread 13,85 6 0,03 Yoghurt 2 4,15 6 0,66<br />

Cream yoghurt 1 4,36 4 0,36 Organic yoghurt 11,66 16 0,77<br />

Table 4.3: Results of the test comparing the cluster solutions obtained from the hedonic or ideal ratings.<br />

<strong>The</strong> strong independence observed across projects between the clusters obtained from the hedonic and<br />

ideal ratings can be explained <strong>by</strong> the fact that in the projects used, clear clusters cannot be observed. Indeed,<br />

in most cases, a strong agreement concerning the products can be found (in terms of liking). In other words,<br />

the procedure of clustering used separate consumers on details. In this case, from an ideal point of view,<br />

consumers are separated based on the extreme of their ideal ratings. Since such separation cannot be found in<br />

the hedonic scores, the results of the two cluster analyses can appear to be independent.<br />

Another explanation could be that the main differences in the averaged ideal profiles are related to<br />

attributes which are not driving liking. So depending on the point of view adopted, the use of the hedonic<br />

judgments or the ideal descriptions should be considered. In practice, we define the clusters based on the liking<br />

ratings. This procedure is the usual way to cluster do in sensory analysis. Moreover, for most of the projects<br />

used, no clear clusters can be found, the majority of consumers always agreeing in terms of their appreciation<br />

of the products. In such situation, the procedure force to find cluster and consumers<br />

In practice, when heterogeneous clusters of consumers are observed, we would advise to apply the<br />

following methodology for each cluster separately. By doing so, one would avoid misinterpreting the results<br />

(Cooper et al., 1989).<br />

4.1.2. Single vs. multiple ideals<br />

<strong>The</strong> procedure checking for single vs. multiple ideals has been introduced in the article entitled “<strong>Ideal</strong><br />

<strong>Profile</strong> Method: the ins and outs” <strong>by</strong> <strong>Worch</strong> et al. (§2.1). More details are given in the following paper<br />

submitted to Food Quality and Preference and entitled “Investigating the single ideal assumption using <strong>Ideal</strong><br />

<strong>Profile</strong> Method” from <strong>Worch</strong>, and Ennis.<br />

137


4.1. Pre‐Treatment of the Data<br />

Journal:<br />

Title:<br />

Authors:<br />

Abstract:<br />

Keywords:<br />

Reference:<br />

Food Quality and Preference<br />

Investigating the single ideal assumption using <strong>Ideal</strong> <strong>Profile</strong> Method.<br />

<strong>Worch</strong>, T., & Ennis, J.M.<br />

<strong>Ideal</strong> point modeling is a type of multivariate mapping in which consumers are assumed to<br />

use internal ideals in their hedonic evaluation of products. In their calculation processes, these<br />

techniques typically assume that consumers have a unique ideal for the product set tested.<br />

But this assumption is difficult to verify from the liking data alone, and may be violated if<br />

different subcategories of products, such as light and dark chocolate, are included in the same<br />

experiment. In this paper we propose the use of the <strong>Ideal</strong> <strong>Profile</strong> Method (IPM) to test this<br />

assumption. In IPM, consumers are asked to rate explicitly their ideals for each product<br />

tested. <strong>The</strong> variability between products of the averaged ideal ratings can then be used to<br />

check for the assumption of a single ideal. <strong>The</strong> procedure we describe involves ANOVA and<br />

confidence ellipses associated to the Hotelling T² test. We then consider three cases to<br />

illustrate the use of this methodology in practice.<br />

<strong>Ideal</strong> <strong>Profile</strong> Method, Product optimization, Portfolio optimization, <strong>Ideal</strong> point modeling<br />

<strong>Worch</strong>, T., & Ennis, J.M. (2013). Investigating the single ideal assumption using <strong>Ideal</strong> <strong>Profile</strong><br />

Method. Food Quality and Preference, submitted.<br />

1. Introduction<br />

A classic question in sensory science is how to best optimize the sensory experience that a single product provides<br />

(Beausire, Norback, & Maurer, 1988; Lagrange, & Norback, 1987; Mattes, & Lawless, 1985; Moskowitz, 1995; Moskowitz, &<br />

Krieger, 1998; Moskowitz, Stanley, & Chandler, 1977; Mullen, & Ennis, 1979; Mullen, & Ennis, 1985; Pangborn, & Pecore,<br />

1982; Vickers, 1988). More recently, as awareness of the importance of consumer segmentation has grown, the question as<br />

to how to best optimize a portfolio of products has become equally important (Ennis, 2003; Ennis, 2004; Ennis, Rousseau, &<br />

Ennis, 2011; Ennis, & Fayle, 2010; Meullenet, Xiong, & Findlay, 2007; Moskowitz, Jacobs, & Lazar, 1985; Teratanavat, Mwai,<br />

& Jeltema, 2012). Multivariate mapping techniques such as preference mapping (Carroll, 1972; Schiffman, Reynolds, &<br />

Young, 1981) have proven valuable in the pursuit of both of these goals and, among these techniques, ideal point modeling<br />

has shown itself to be especially suited to the problem of portfolio optimization. (Ash<strong>by</strong>, & Ennis, 2002; Busing, Groenen, &<br />

Heiser, 2005; Busing, Heiser, & Cleaver, 2010; Ennis, & Rousseau, 2004; MacKay, 2001; MacKay, Easley, & Zinnes, 1995;<br />

Meullenet, Lovely, Threlfall, Morris, & Striegler, 2008; Tubbs, Oupadissakoon, Lee, & Meullenet, 2010).<br />

<strong>Ideal</strong> point modeling relies on the assumption that respondents generate preferences and hedonic ratings for tested<br />

products <strong>by</strong> a (possibly subconscious) comparison of the product experiences with internal ideal experiences (Coombs,<br />

1964). <strong>Ideal</strong> point modeling seeks to uncover these internal ideals, either <strong>by</strong> linear algebra (Carroll, 1980; Carroll, & Chang,<br />

1970; Schiffman et al., 1981), or <strong>by</strong> an unfolding technique (Busing et al., 2005; Ennis, 1993; Ennis, & Johnson, 1994; van de<br />

Velden, Beuckelaer, Groenen, & Busing, 2013; MacKay 2001; Zinnes, & Griggs, 1974). <strong>The</strong> purpose of such methods is to<br />

estimate the locations of the ideal product for each consumer based on the liking information provided. An important<br />

assumption of these methods, though, is that each consumer has only one ideal product to which each of the testing<br />

products is compared. This assumption is not easily testable within the ideal point framework, and the main contribution of<br />

this paper is to propose a technique for testing this assumption.<br />

To this end we note that instead of inferring consumer ideal point information mathematically, internal ideal profiles<br />

can be sought directly (Moskowitz, 1972; Szczesniak, Loew, & Skinner, 1975). One such approach is JAR scaling: consumers<br />

rate the perceived intensity of each attribute for each product according to an internal reference, and provide the deviation<br />

from their ideal according to whether the product tested is too little, too much or just about right (Rothman, & Parker,<br />

2009). A good overview of this methodology and the data treatment is given in Meullenet et al. (2007). A second solution<br />

consists in asking consumers directly during the data collection procedure (<strong>Ideal</strong> <strong>Profile</strong> Method or IPM, Punter, & <strong>Worch</strong>,<br />

2009; <strong>Worch</strong>, Lê, Punter, & Pagès, 2012a): in this case, consumers are asked to rate both the perceived and ideal intensity<br />

of each attribute for each product.<br />

Once we uncover these internal ideals, as either ideal points or ideal profiles, we are in a strong position to investigate<br />

consumer segmentation. We can then optimize a portfolio <strong>by</strong> optimizing products for each of the segments found. See<br />

Ennis et al. (2011) for several examples illustrating this principle.<br />

Recent literature on the above topics has focused on differences between methods (Busing et al., 2010; Gonzàlez,<br />

Sifre, Benedito, & Noguès, 2002; Lovely, & Meullenet, 2009; Rousseau, Ennis, & Rossi, 2012) or on differences in the<br />

guidance for improvement provided (van Trijp, Punter, Mickartz, & Kruithof, 2007; <strong>Worch</strong>, Dooley, Meullenet, & Punter,<br />

138


4. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong>s as a Tool for Optimization<br />

2010). In this paper, we investigate how the <strong>Ideal</strong> <strong>Profile</strong> Method (IPM) can complement existing methodologies <strong>by</strong> testing<br />

the above‐mentioned assumption of one unique ideal per consumer. In the event that different products systematically<br />

trigger different internal ideals, IPM allows us to partition the data so that ideal point methodologies can still be used for<br />

portfolio optimization on subsets of the original set of products. In addition, IPM itself can be used for optimization for the<br />

remaining products. Examples from real case studies will be used to illustrate the proposed methodology.<br />

2. <strong>Ideal</strong> <strong>Profile</strong> Method<br />

2.1. Presentation of the method<br />

<strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong> Method is a methodology for sensory data acquisition. It is a descriptive analysis technique, like QDA®<br />

(Stone, Sidel, Oliver, Woosley, & Singleton, 1974), performed <strong>by</strong> consumers where additional questions about the ideal<br />

intensities and liking are asked.<br />

According to the IPM procedure, each consumer evaluates several products following a sequential monadic design<br />

which takes care of first‐order and carry‐over effects (MacFie, Bratchell, Greenhoff, & Vallis, 1989). <strong>The</strong> consumers are<br />

asked to rate the products on both perceived and ideal intensity for a list of attributes. Additional hedonic questions are<br />

also asked for each tested product.<br />

2.2. Consistency of the data<br />

In IPM, each consumer provides directly three types of information: the sensory profiles (i.e. how they perceive the<br />

products), the hedonic scores (i.e. how they like the products) and their ideal profiles (i.e. what their expectations are). This<br />

information is directly actionable to guide product improvement. Even so, it should be carefully managed since (1) it is<br />

obtained from consumers and (2) it describes a virtual product. Hence, the consistency of the ideal descriptions should be<br />

checked. With this in mind, <strong>Worch</strong>, Lê, Punter, and Pagès defined two types of consistency of the ideal data: the sensory<br />

consistency (2012b) and the hedonic consistency (2012c).<br />

2.3. Defining homogeneous subgroups using the ideal<br />

2.3.1. Subgroups of consumers<br />

Once the consistency of the data is checked, the ideal information provided <strong>by</strong> each consumer can be used for product<br />

improvement. However, in practice, product developers are not interested in improving the products for each consumer<br />

separately, and a common ideal is considered for a homogeneous (i.e. same liking behavior) group of consumers.<br />

With IPM, this ideal is often defined as the averaged ideal product over the entire panel (Cooper, Earle, & Triggs, 1989,<br />

Hoggan, 1975; Szczesniak et al., 1975). It can also be the solution obtained from the <strong>Ideal</strong> Mapping technique (<strong>Worch</strong>, Lê,<br />

Punter & Pagès, 2012d), i.e. the averaged ideal profile common to a maximum of consumers sharing a similar ideal.<br />

2.3.2. Single or multiple ideals?<br />

Solutions of considering one ideal product per homogeneous group of consumers only makes sense under the<br />

assumption that the consumers associate the product set tested to one unique ideal. This assumption seems to make sense<br />

when the products tested are close from a sensory point of view (e.g. natural chips from different brands). Although the<br />

assumption of a single ideal per consumer is made <strong>by</strong> ideal points modeling techniques, it could easily be violated when the<br />

products tested are different from a sensory point of view. For example, a consumer might have one ideal for dark<br />

chocolate candies but a different ideal for similar candies made with milk chocolate – within the context of dark chocolate,<br />

levels of bitterness that would be unacceptable for milk chocolate might even be desirable. In this case it would be useful to<br />

separate the products (i.e. chocolate candies) into different homogeneous subcategories (i.e. the milk subcategory on one<br />

hand and the dark subcategory on the other hand).<br />

Unfortunately, the a priori definition of subcategories is difficult and subjective. Since the line between subcategories<br />

can be very thin, we propose a functional definition of “product subcategory” using the concept of an ideal product.<br />

For this, we consider two products from the same category, (i.e. chocolate candies) to be from the same subcategory<br />

if, within each consumer, they are evaluated using the same ideal. Note that this definition does not imply that all<br />

consumers have the same ideal for the products from a subcategory.<br />

139


4.1. Pre‐Treatment of the Data<br />

3. Using IPM to test for multiple subcategories<br />

In practice, it is difficult to predict a priori whether or not different products cue different ideals and even more<br />

difficult to deduce such information solely from the liking information 1 .<br />

For these reasons, we propose the following alternate approach to investigate whether the products in the product set<br />

were all from the same product subcategory or not. In what follows, we explore whether some products tend to cue<br />

systematically different ideal products than other – in the case of the dark and milk chocolates we might find that the dark<br />

chocolates systematically cue more bitter ideal products, despite the differences that exist between individuals.<br />

For this reason, the procedure checking for single or multiple ideals is not applied at the consumer level, but at the<br />

panel level – for each product we test for a systematic shift in the ideal description across consumers.<br />

3.1. A systematic shift in averaged ideals<br />

In the IPM procedure, the consumers are asked to rate their ideal for each product tested. If the majority of consumers<br />

uses a single ideal to evaluate all of the products, then we would not expect a difference between the average of the ideals<br />

associated with one product and the average of the ideals associated with a second product. On the other hand, if a<br />

product belongs to a different subcategory from the other tested products, and hence cues systematically different ideals in<br />

the consumers, we would expect a systematic shift in the averaged ideal for that product and the average ideals for the<br />

other products. For example, if we average the ideals for a dark chocolate product across all consumers, we expect a more<br />

bitter result than when we average the ideals for a milk chocolate product across all consumers.<br />

By considering all the attributes simultaneously, this systematic shift is highlighted within the product space. When the<br />

attributes are considered separately, this shift is observed through the product effect in a two‐way ANOVA (considering the<br />

product and consumer effects) performed on the ideal attributes. Also, note that we assume that the attributes use in IPM<br />

include attributes that reflect the differences between the possible subcategories – if an incomplete set of attributes is<br />

used, even the approach we propose here will be insufficient.<br />

3.2. Multivariate analysis<br />

<strong>The</strong> sensory space of the products tested is created <strong>by</strong> performing a standardized PCA on the table crossing the<br />

products in rows and the sensory attributes in columns (Table 1a). To avoid giving importance to non‐discriminating<br />

attributes (Borgognone, Bussi, & Hough, 2001), a selection a priori of the attributes of interest can be done. This selection<br />

involves a two‐way ANOVA (i.e. including the product and consumer effects) performed on each sensory attribute (i.e.<br />

perceived intensity): all attributes with a product effect not significant at 20% are not included in the construction of the<br />

product space.<br />

Since we are interested in finding a systematic shift across consumers of the ideal ratings, the averaged ideal profiles<br />

are calculated for each product (i.e. averaged over the consumers). P products tested yield P averaged ideal products.<br />

<strong>The</strong>se P averaged ideal products are projected as supplementary entities on the sensory space. An important point is that<br />

the P averaged ideal products are only used to check for the possibility of multiple subcategories within the tested products<br />

– they should not be used for product or portfolio optimization purposes.<br />

If there is a systematic shift in the consumer ideals as we move from one product to another, this shift will be observed<br />

in the relative position of the projection of the averaged ideal products. When consumers associate all the products to one<br />

unique ideal, no systematic shift is observed and all the averaged ideal products are projected in a small area (ideally, all the<br />

projections would be overlapping). On the contrary, if consumers associate the products with multiple ideals, the<br />

projections of the averaged ideal products will be spread on the sensory space.<br />

1 Within the context of unfolding, it is conceivable that one could posit multiple ideal points per consumer and then<br />

attempt to deduce, through model fitting, which ideals points were used to evaluate which products. Given the<br />

mathematical hurdles that already need to be cleared for effective unfolding (e.g. van de Velden et al., 2013), such an<br />

approach would be very complex.<br />

140


4. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong>s as a Tool for Optimization<br />

Attribute 1 … Attribute a … Attribute A<br />

Product 1<br />

…<br />

Product p .<br />

…<br />

Product P<br />

(a)<br />

Product 1<br />

…<br />

Product p .<br />

…<br />

Product P<br />

(b)<br />

Cons.1 – Prod. 1<br />

…<br />

Cons.1 – Prod. p<br />

…<br />

Cons. j – Prod. p <br />

…<br />

Cons. J – Prod. P<br />

(c)<br />

Table 1: Organization of the data used for the creation of the confidence ellipses around the averaged ideal products.<br />

Table 1a contains the averaged perceived intensities y . per product which are used for the creation of the sensory space;<br />

Table 1b contains the averaged ideal intensities z . per product which project as supplementary on the sensory space;<br />

Table 1c contains all the ideal information z provided <strong>by</strong> the consumers: this variability is used to create the confidence<br />

ellipses around the averaged ideal points.<br />

Since the distance between products is somewhat subjective in multivariate analysis, a test is needed, which would<br />

help concluding about the eventual differences between the ideals. <strong>The</strong> solution proposed consists in using the consumer’s<br />

variability to create confidence ellipses around the averaged ideal products (Husson, Lê, & Pagès, 2005). If all the<br />

confidence ellipses are overlapping, no systematic shift is observed across products and can be concluded that consumers<br />

associated the product set to one unique ideal. On the contrary, if the confidence ellipses are separated, a systematic shift<br />

is observed across products and can be concluded that consumers associated the product set to more than one ideal.<br />

<strong>The</strong>se confidence ellipses can either be constructed according to partial bootstrap, or to total bootstrap (Cadoret, &<br />

Husson, 2012). In our case, since we are dealing with low dimensionality, the two techniques return similar results and only<br />

partial bootstrap is used here. It consists in creating fictive panels of consumers <strong>by</strong> selecting randomly with replacement<br />

consumers from the original panel and <strong>by</strong> estimating the average point of each fictive panel <strong>by</strong> using the barycentric<br />

property of the PCA (Husson, et al., 2005). By reproducing these steps many times, confidence ellipses containing 95% of<br />

the projections obtained from the fictive panels are created.<br />

<strong>The</strong> confidence ellipses are usually represented on the first two dimensions of the PCA, as these dimensions explained<br />

the maximum of variance. However, the difference between products might be highlighted on further dimensions,<br />

especially if the first two dimensions together only explain a low amount of the total variance. In this case, limiting the<br />

interpretation to the first two dimensions might bring wrong conclusions (e.g. single ideal while products are differentiated<br />

on the third or fourth dimension).<br />

In order to avoid such interpretation error, a Hotelling T² test is performed. This test is a good addition to the visual<br />

inspection of the confidence ellipses since it checks for significance differences between products in a multivariate way.<br />

This test includes in its process all the dimensions associated with an eigenvalue larger than 1.<br />

Based on the visual inspection and on the results of the Hotelling T² test, conclusions are drawn whether the panel<br />

associated the product set tested with one or with multiple ideals. Such conclusion can be also enriched <strong>by</strong> the univariate<br />

analysis.<br />

3.3. Univariate analysis<br />

At the attribute level, the systematic shift is measured through the product effect from the two‐way ANOVA<br />

performed on each ideal attribute (Equation 1).<br />

(1)<br />

If the majority of consumers is associating the products tested with one unique ideal, no systematic shift is observed<br />

across products. In this case, the product effect is not significant. On the contrary, if the majority of consumers is rating the<br />

ideal intensity of an attribute differently from one product to another (i.e. consumers are associating the product set with<br />

multiple ideals), the product effect will appear to be significant. In practice, the 5% level is considered here.<br />

When multiple ideals are detected, an analysis performed attribute <strong>by</strong> attribute helps defining on which attributes the<br />

ideals differ the most. A Tukey test can be performed in order to compare the products <strong>by</strong> pair and create groups of<br />

products which are belonging to the same subcategory (i.e. which are not significantly different <strong>by</strong> pair).<br />

141


4.1. Pre‐Treatment of the Data<br />

3.4. Product and Portfolio Optimization<br />

When consumers rate multiple ideals, each homogeneous subgroup of products should be optimized separately. <strong>The</strong><br />

methods proposed <strong>by</strong> <strong>Worch</strong> et al. (2010) such as the PLS on dummy variables and the Fishbone method can be used. In<br />

this case, each subgroup of products would be optimized according to its corresponding ideal product.<br />

When the number of products belonging to a same subcategory is large enough (in practice, a minimum of 6 products<br />

is advised), techniques that assume a single ideal product per consumer, such as the family of ideal point modeling<br />

methods, can be applied to this product subset.<br />

A cautionary note is needed here, however. When we conclude that the testing products contain products from<br />

different subcategories, we must still consider the balance of the experimental design when we form subsets of the original<br />

dataset. Thus, we recommend analyzing the design matrix for artifacts in the sequence effects that could be formed <strong>by</strong> the<br />

data subsetting. In the event that the design is no longer well balanced after some products are removed from the main set,<br />

we recommend optimizing all of the products individually using PLS on dummy variables.<br />

4. Examples<br />

To illustrate the methodology presented in the previous section, studies performed at OP&P Product Research,<br />

Utrecht, <strong>The</strong> Netherlands, are used. In all these cases, the <strong>Ideal</strong> <strong>Profile</strong> Method presented <strong>by</strong> <strong>Worch</strong>, et al. (2012) was used.<br />

More information concerning the projects is given in the results section. However, for confidentiality reasons, the names of<br />

the products and attributes are not given.<br />

Also, in these examples, a part of subjectivity and good sense is needed for interpretation. <strong>The</strong> conclusions we would<br />

adopt will be argued, but these are not necessarily the only reasonable conclusions.<br />

4.1. Beer<br />

<strong>The</strong> first project considered is a beer project including 8 beers which were tested following the IPM <strong>by</strong> 84 Dutch<br />

consumers. Both perceived and ideal intensity were rated on 32 attributes. Through the inspection of the sensory<br />

attributes, 9 of them were discarded from the analysis since they were not discriminating the products at 20%.<br />

<strong>The</strong> first two dimensions explain 65% of the total variance (Figure 1). <strong>The</strong> confidence ellipses around the averaged<br />

ideal points seem all superimposed on these two dimensions. A closer look still shows some differences between products<br />

6 and 8 for example. This result is confirmed <strong>by</strong> the Hotelling T² test performed on the first 5 dimensions (Table 2).<br />

Figure 1: 95% confidence ellipses created around the averaged ideal products on the first two dimensions<br />

for the beer example.<br />

142


4. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong>s as a Tool for Optimization<br />

1 2 3 4 5 6 7 8<br />

1 1,000 0,727 0,672 0,781 0,667 0,068 0,123 0,784<br />

2 0,727 1,000 0,666 0,184 0,353 0,096 0,328 0,739<br />

3 0,672 0,666 1,000 0,177 0,231 0,129 0,244 0,438<br />

4 0,781 0,184 0,177 1,000 0,880 0,036 0,090 0,570<br />

5 0,667 0,353 0,231 0,880 1,000 0,089 0,345 0,648<br />

6 0,068 0,096 0,129 0,036 0,089 1,000 0,273 0,013<br />

7 0,123 0,328 0,244 0,090 0,345 0,273 1,000 0,261<br />

8 0,784 0,739 0,438 0,570 0,648 0,013 0,261 1,000<br />

Table 2: P‐value of the Hotelling T² test comparing the products <strong>by</strong> pair for the beer example.<br />

From these results, it seems that the products 6 and 8 belong to different subcategories and hence should be<br />

optimized separately. However, the gain in quality in terms of optimization seems questionable compared to the eventual<br />

risk of unbalancing the experimental design <strong>by</strong> working on a subset of the data (full dataset without product 6). For this<br />

reason, we suggest considering all the products as belonging to one unique subcategory of products, and pursuing a<br />

portfolio optimization within this product subcategory.<br />

4.2. Coffee<br />

<strong>The</strong> second project considered is a coffee study, in which 8 coffees were tested following the IPM <strong>by</strong> 77 Dutch<br />

consumers. Both perceived and ideal intensity were rated on 16 attributes. No attributes were discarded here since the<br />

product effect was always significant at 20%.<br />

In this study, the first two dimensions of the sensory space explain around 80% of the total variance (Figure 2). On<br />

these dimensions, all the ellipses are clearly overlapping. This would suggest that all products belong to the same<br />

subcategory and are associated to one unique ideal. However, the Hotelling T² test performed on the first three dimensions<br />

(Table 3) suggests differences between products. A closer look to the third dimension seems necessary here.<br />

Figure 2: 95% confidence ellipses created around the averaged ideal products on the first two dimensions<br />

for the coffee example.<br />

143


4.1. Pre‐Treatment of the Data<br />

1 2 3 4 5 6 7 8<br />

1 1,000 0,656 0,163 0,003 0,003 0,000 0,001 0,000<br />

2 0,656 1,000 0,736 0,045 0,017 0,001 0,004 0,001<br />

3 0,163 0,736 1,000 0,316 0,070 0,005 0,024 0,007<br />

4 0,003 0,045 0,316 1,000 0,401 0,098 0,327 0,203<br />

5 0,003 0,017 0,070 0,401 1,000 0,382 0,854 0,857<br />

6 0,000 0,001 0,005 0,098 0,382 1,000 0,760 0,742<br />

7 0,001 0,004 0,024 0,327 0,854 0,760 1,000 0,997<br />

8 0,000 0,001 0,007 0,203 0,857 0,742 0,997 1,000<br />

Table 3: P‐value of the Hotelling T² test comparing the products <strong>by</strong> pair for the coffee example.<br />

In Figure 3, it appears that the products are different according to attributes Attr3, Attr5 and Attr8 on the third<br />

dimension. <strong>The</strong> ANOVA and the Tukey posthoc test performed on Attr3, Attr5 and Attr8 confirms this inference (Table 4).<br />

For these attributes, the Tukey test always opposes products 1, 2 and 3 to the products 5, 6, 7 and 8, with product 4 being<br />

somewhat in the middle.<br />

Figure 3: 95% confidence ellipses created around the averaged ideal products on the dimensions 1 and 3<br />

for the coffee example.<br />

1 2 3 4 5 6 7 8<br />

<strong>Ideal</strong><br />

Att3<br />

56.12 c 56.14 c 56.53 bc 56.19 c 58.23 abc 60.08 ab 61.34 a 61.03 a<br />

<strong>Ideal</strong><br />

Att5<br />

46.72 b 48.9 ab 49.24 ab 50.87 a 52.23 a 51.58 a 51.93 a 50.76 a<br />

<strong>Ideal</strong><br />

Att8<br />

60.61 a 60.18 a 59.68 ab 57.62 ab 57.9 ab 56.31 b 57.64 ab 57.74 ab<br />

Table 4: Results of the Tukey test on the attributes of interest for the coffee dataset.<br />

Two products are associated to the same group (characterized <strong>by</strong> a letter) if they are not significantly different.<br />

Although the groups are not clearly distinctive, we would recommend two subcategories of coffees here, one with the<br />

products 1, 2 and 3 and one with the rest of the products.<br />

4.3. Meal salad<br />

<strong>The</strong> third project considered is a meal salad study. In this project, 10 salads have been tested following the IPM <strong>by</strong> 82<br />

Dutch consumers. Both perceived and ideal intensity were rated on 29 attributes. Only one attribute was discarded from<br />

the analysis since it was not discriminating the products.<br />

144


4. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong>s as a Tool for Optimization<br />

<strong>The</strong> first two dimensions of the sensory space explain around 76% of the total variance (Figure 4). On these first two<br />

dimensions, the confidence ellipses are all on a close area and are overlapping. However, it can be seen that the products 3,<br />

9 and 10 are separated from the rest of the group. Here, the product 4 seems to be in‐between the two groups of products.<br />

This result is confirmed <strong>by</strong> the Hotelling T² test, performed on the first five dimensions here (Table 5).<br />

Figure 4: 95% confidence ellipses created around the averaged ideal products on the first two dimensions<br />

for the meal salad example.<br />

1 2 3 4 5 6 7 8 9 10<br />

1 1,000 0,915 0,000 0,171 0,161 0,023 0,709 0,001 0,000 0,001<br />

2 0,915 1,000 0,000 0,122 0,135 0,016 0,836 0,004 0,001 0,005<br />

3 0,000 0,000 1,000 0,000 0,000 0,000 0,000 0,000 0,321 0,039<br />

4 0,171 0,122 0,000 1,000 0,006 0,001 0,059 0,000 0,102 0,018<br />

5 0,161 0,135 0,000 0,006 1,000 0,930 0,270 0,000 0,000 0,000<br />

6 0,023 0,016 0,000 0,001 0,930 1,000 0,078 0,000 0,000 0,000<br />

7 0,709 0,836 0,000 0,059 0,270 0,078 1,000 0,000 0,000 0,001<br />

8 0,001 0,004 0,000 0,000 0,000 0,000 0,000 1,000 0,000 0,000<br />

9 0,000 0,001 0,321 0,102 0,000 0,000 0,000 0,000 1,000 0,026<br />

10 0,001 0,005 0,039 0,018 0,000 0,000 0,001 0,000 0,026 1,000<br />

Table 5: P‐value of the Hotelling T² test comparing the products <strong>by</strong> pair for the meal salad example.<br />

Based on these initial results, we would suggest that the product set can be divided into two subcategories. However,<br />

a closer look at the Hotelling T² test shows significant difference between products 9 and 10 (p‐value=0.026), suggesting 3<br />

possible subcategories.<br />

<strong>The</strong> Tukey posthoc test (Table 6) shows that the differences between these two products concern the attributes Attr4,<br />

Attr14, Attr15 and Attr24 which are less relevant attributes here. Here the same ideal product could be considered for<br />

these two products since they are not significantly different on the “important” attributes.<br />

1 2 3 4 5 6 7 8 9 10<br />

<strong>Ideal</strong><br />

Att4<br />

61.61 a 58.91 ab 60.49 a 61.58 a 61.49a 61.1 a 55.04 bc 62.98 a 62.47a 54.08 c<br />

<strong>Ideal</strong><br />

Att14<br />

59.42 ab 54.05 cd 59.53 ab 60.78 a 61.96a 60.21 ab 55.03 bcd 59.09 abc 62.42a 52.38 d<br />

<strong>Ideal</strong><br />

Att15<br />

54.88 abcd 56.07 abc 53.18 bcd 54.06 abcd 50.21d 50.39 d 53.07 bcd 58.89 a 56.87ab 51.44 cd<br />

<strong>Ideal</strong><br />

Att24<br />

31.8 ab 31.43 ab 31.57 ab 29.78 ab 32.08a 32.31 a 30.9 ab 32.84 a 33.12a 27.36 b<br />

Table 6: Results of the Tukey test on the attributes of interest for the meal salad example.<br />

Two products are associated to the same group (characterized <strong>by</strong> a letter) if they are not significantly different.<br />

In conclusion, in this case, two subcategories of products would be considered, one containing the product 3, 9 and 10,<br />

and one containing the rest of the products. Only product 4 seems to be in the middle and could be assigned to either of<br />

the two subcategories.<br />

145


4.1. Pre‐Treatment of the Data<br />

5. Conclusion<br />

Many of the commonly used tools for portfolio optimization, most notably including the family of ideal point modeling<br />

techniques, rely on the assumption that each consumer uses a single internal ideal product to assess the tested products.<br />

When the products tested are very close in terms of sensory characteristics, this assumption is almost certainly correct.<br />

However, it often happens that the products tested are fairly different from a sensory point of view. In this case, the<br />

assumption of one unique ideal product per consumer could be incorrect. Because of the richness of the data collected<br />

using <strong>Ideal</strong> <strong>Profile</strong> Method, it is possible to test this assumption. In other words, it is possible to investigate whether the<br />

tested products all belong to the same product subcategory. Following this investigation, the product set can be split into<br />

multiple subcategories as needed for product and portfolio optimization.<br />

Acknowledgements<br />

We thank Daniel Ennis and Pieter Punter for support and valuable feedback.<br />

References<br />

Ash<strong>by</strong>, F. G., & Ennis, D. M. (2002). A Thurstone‐Coombs<br />

model of concurrent ratings with sensory and<br />

liking dimensions. Journal of Sensory Studies, 17,<br />

43‐59.<br />

Beausire, R. L. W., Norback, J. P., & Maurer, A. J. (1988).<br />

Development of an acceptability constraint for a<br />

linear programming model in food formulation.<br />

Journal of Sensory Studies, 3(2), 137‐149.<br />

Borgognone, M.G., Bussi, J., & Hough, G. (2001).<br />

Principal component analysis in sensory analysis:<br />

covariance or correlation matrix? Food Quality and<br />

Preference, 12, 323‐326.<br />

Busing, F. M. T. A., Groenen, P. J. K., & Heiser, W. J.<br />

(2005). Avoiding degeneracy in multidimensional<br />

unfolding <strong>by</strong> penalizing on the coefficient of<br />

variation. Psychometrika, 70(1), 71‐98.<br />

Busing, F. M. T. A., Heiser, W. J., & Cleaver, G. (2010).<br />

Restricted unfolding: Preference analysis with<br />

optimal transformations of preferences and<br />

attributes. Food Quality and Preference, 21(1), 82‐<br />

92.<br />

Cadoret, M., & Husson, F. (2012). Confidence ellipses in<br />

holistic approaches. Oral presentation in 12 th<br />

European Symposium on Statistical Methods for<br />

the Food Industry, Feb.‐March, Paris, France.<br />

Carroll, J.D. (1972). Individual differences and<br />

multidimensional scaling. In Shepard, R.N.,<br />

Romney, A.K., & Nerloves, S. Multidimensional<br />

scaling: theory and applications in the behavioral<br />

sciences. Academic Press, New York.<br />

Carroll, J. D. (1980). Models and methods for<br />

multidimensional analysis of preferential choice<br />

(or other dominance) data. In Lantermann,E., &<br />

Feger, H., Similarity and choice (pp. 234–289).<br />

Bern: Hans Huber.<br />

Carroll, J. D., & Chang, J. J. (1970). Analysis of individual<br />

differences in multidimensional scaling via an N‐<br />

way generalization of ’Eckart–Young’<br />

decomposition. Psychometrika, 35, 283–319.<br />

Coombs, C. H. (1964). A theory of data. New York: Wiley.<br />

Cooper,H.R., Earle, M.D., & Triggs, C.M. (1989). Ratios of<br />

<strong>Ideal</strong>s – A New Twist to an Old Idea. In Product<br />

Testing with Consumers for Research Guidance.<br />

ASTM STP 1035, p54‐63.<br />

Ennis, D. M. (1993). A single multidimensional model for<br />

discrimination, identification, and preferential<br />

choice. Acta Psychologica, 84, 17–27.<br />

Ennis, D.M. (2003). Designing new product portfolios.<br />

IFPress, 6(2), 2‐3. Retrieved from<br />

http://www.ifpress.com.<br />

Ennis, D.M. (2004). Competitive strategies in product<br />

portfolio design. IFPress, 7(1), 2‐3. Retrieved from<br />

http://www.ifpress.com.<br />

Ennis, J. M., & Fayle, C. M. (2010). Portfolio optimization<br />

based on first choice. IFPress, 13(2), 2‐3. Retrieved<br />

from http://www.ifpress.com.<br />

Ennis, D. M., & Johnson, N. L. (1994). A general model<br />

for preferential and triadic choice in terms of<br />

central F distribution functions. Psychometrika,<br />

59(1), 91–96.<br />

Ennis, D.M., & Rousseau, B. (2004). Motivations for<br />

product consumption: Application of a<br />

probabilistic model to adolescent smoking.<br />

Journal of Sensory Studies, 19, 107–117.<br />

Ennis, D.M, Rousseau, B., & Ennis, J. M. (2011). Short<br />

Stories in Sensory and Consumer Science (1st ed.).<br />

Richmond, VA: IFPress.<br />

Gonzàlez, R., Sifre, S., Benedito, J., & Noguès, V. (2002).<br />

Comparison of electromyographic pattern of<br />

sensory experts and untrained subjects during<br />

chewing of Mahon cheese. Journal of Dairy<br />

Research, 69, 151‐161.<br />

146


4. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong>s as a Tool for Optimization<br />

Hoggan, J. (1975). New Product Development. MBAA<br />

Technical Quarterly, 12, 81‐86.<br />

Husson, F., Lê, S., & Pagès, J. (2005). Confidence ellipse<br />

for the sensory profiles obtained <strong>by</strong> principal<br />

component analysis. Food Quality and Preference,<br />

16, 245‐250.<br />

Lagrange, V., & Norback, J.P. (1987). Product<br />

optimization and the acceptor set size. Journal of<br />

Sensory Studies, 2(2), 119‐136.<br />

Lovely, C., & Meullenet, J.‐F. (2009). Comparison of<br />

preference mapping techniques for the<br />

optimization of strawberry yogurt. Journal of<br />

Sensory Studies, 24(4), 457‐478.<br />

MacFie, H.J., Bratchell, N., Greenhoff, K., & Vallis, L.V.<br />

(1989). Designs to balance the effect of order of<br />

presentation and first‐order carry‐over effects in<br />

hall tests. Journal of Sensory Studies, 4, 129‐148.<br />

MacKay, D. (2001). Probabilistic unfolding models for<br />

sensory data. Food Quality and Preference, 12,<br />

427–436.<br />

MacKay, D.B., Easley, R. F., & Zinnes, J. L. (1995). A single<br />

ideal point model for market structure analysis.<br />

Journal of Marketing Research, 32, 433‐443.<br />

Mattes, R. D., & Lawless, H. T. (1985). An adjustment<br />

error in optimization of taste intensity. Appetite,<br />

6(2), 103‐114.<br />

Meullenet, J. F., Lovely, C., Threlfall, R., Morris, J. R., &<br />

Striegler, R. K. (2008). An ideal point density plot<br />

method for determining an optimal sensory<br />

profile for Muscadine grape juice. Food Quality<br />

and Preference, 19(2), 210‐219.<br />

Meullenet, J. F., Xiong, R., & Findlay, C. J. (2007).<br />

Multivariate and probabilistic analyses of sensory<br />

science problems. IFT Press, Blackwell Publishing,<br />

1 st edition, Ames, Iowa, USA.<br />

Moskowitz, H.R. (1972). Subjective ideals and sensory<br />

optimization in evaluating perceptual dimensions<br />

in food. Journal of Applied Psychology, 56, 60‐66.<br />

Moskowitz, H R. (1995). One practitioner’s overview to<br />

applied product optimization. Food Quality and<br />

Preference, 6(2), 75‐81.<br />

Moskowitz, H R, Jacobs, B. E., & Lazar, N. (1985). Product<br />

response segmentation and the analysis of<br />

individual differences in liking. Journal of Food<br />

Quality, 8(2‐3), 169‐181.<br />

Moskowitz, H., & Krieger, B. (1998). International<br />

product optimization: a case history. Food Quality<br />

and Preference, 9(6), 443‐454.<br />

Moskowitz, H.R., Stanley, D. W., & Chandler, J. W.<br />

(1977). <strong>The</strong> Eclipse method: Optimizing product<br />

formulation through a consumer generated ideal<br />

sensory profile. Canadian Institute of Food Science<br />

and Technology Journal, 10(3), 161‐168.<br />

Mullen, K., & Ennis, D. M. (1979). Rotatable designs in<br />

product development. Food Technology, 33(7),<br />

74‐80.<br />

Mullen, K., & Ennis, D. M. (1985). Fractional factorials in<br />

product development. Food Technology, 39(5),<br />

90‐103.<br />

Pangborn, R.M., & Pecore, S D. (1982). Taste perception<br />

of sodium chloride in relation to dietary intake of<br />

salt. <strong>The</strong> American journal of clinical nutrition,<br />

35(3), 510‐520.<br />

Punter, P. H., & <strong>Worch</strong>, T. (2009). <strong>The</strong> ideal profile<br />

method: Combining classical profiling with JAR<br />

methodology. SPISE 2009 proceeding: Food<br />

consumer insights in Asia.<br />

Rothman, L., & Parker, M. (2009). Just‐About‐Right (JAR)<br />

Scales: Design, Usage, Benefits and Risks. ASTM<br />

Manual, MNL63‐EB.<br />

Rousseau, B., Ennis, D. M., & Rossi, F. (2012). Internal<br />

preference mapping and the issue of satiety. Food<br />

Quality and Preference, 24(1), 67‐74.<br />

Schiffman, S. S., Reynolds, M. L., & Young, F. W. (1981).<br />

Introduction to multidimensional scaling: theory,<br />

methods, and applications. New York, NY:<br />

Academic Press.<br />

Stone, H., Sidel, J., Oliver, S., Woosley, A., & Singleton,<br />

R.C. (1974). Sensory evaluation <strong>by</strong> quantitative<br />

descriptive analysis. Food Technology, 28, 24‐34.<br />

Szczesniak, A., Loew, B.J., &Skinner, E.Z. (1975).<br />

Consumer texture profile technique. Journal of<br />

Food Science, 40, 1253‐1256.<br />

Teratanavat, R., Mwai, J., & Jeltema, M. (2012). Free‐<br />

Choice in Context Preference Ranking: A New<br />

Approach for Portfolio Assessment. Product<br />

Innovation Toolbox, 291‐302.<br />

Tubbs, J., Oupadissakoon, G., Lee, Y. S., & Meullenet, J. F.<br />

(2010). Performance and representation of<br />

Euclidian Distance <strong>Ideal</strong> Point Mapping (EDIPM)<br />

using a third dimension. Food Quality and<br />

Preference, 21(3), 278‐285.<br />

Van Trijp, H.C.M., Punter, P.H., Mickartz, F., & Kruithof,<br />

L. (2007). <strong>The</strong> quest for the ideal product:<br />

Comparing different methods and approaches.<br />

Food Quality and Preference, 17, 387‐399.<br />

Van de Velden, M., Beuckelaer, A. D., Groenen, P. J. F., &<br />

Busing, F. M. T. A. (2013). Solving degeneracy and<br />

stability in nonmetric unfolding. Food Quality and<br />

Preference, 27(1), 85–95.<br />

Vickers, Z. (1988). Sensory specific satiety in lemonade<br />

using a just right scale for sweetness. Journal of<br />

Sensory Studies, 3(1), 1‐8.<br />

<strong>Worch</strong>, T., Dooley, L., Meullenet, J. F., & Punter, P. H.<br />

(2010). Comparison of PLS dummy variables and<br />

Fishbone method to determine optimal product<br />

characteristics from ideal profiles. Food Quality<br />

and Preference, 21(8), 1077‐1087.<br />

147


4.1. Pre‐Treatment of the Data<br />

<strong>Worch</strong>, T., Lê, S., Punter, P., & Pagès, J. (2012a). <strong>The</strong><br />

<strong>Ideal</strong> <strong>Profile</strong> Method (IPM): the ins and outs. Food<br />

Quality and Preference,<br />

http://dx.doi.org/10.1016/j.foodqual.2012.08.001<br />

<strong>Worch</strong>, T., Lê, S., Punter, P.H., & Pagès, J. (2012b).<br />

Assessment of the consistency of ideal profiles<br />

according to non‐ideal data for IPM. Food Quality<br />

and Preference, 24, 99‐110.<br />

<strong>Worch</strong>, T., Lê, S., Punter, P.H., & Pagès, J. (2012c).<br />

Extension of the consistency of the data obtained<br />

with the <strong>Ideal</strong> <strong>Profile</strong> Method: Would the ideal<br />

products be more liked than the tested products?<br />

Food Quality and Preference, 26, 74‐80.<br />

<strong>Worch</strong>, T., Lê, S., Punter, P.H., & Pagès, J. (2012d).<br />

Construction of an <strong>Ideal</strong> map (IdMap) based on<br />

the ideal profiles obtained directly from<br />

consumers. Food Quality and Preference, 26, 93‐<br />

104.<br />

Zinnes, J. L., & Griggs, R. A. (1974). Probabilistic<br />

multidimensional unfolding analysis.<br />

Psychometrika, 39, 327‐350<br />

In the following section, unless mentioned, we position ourselves in a situation where consumers are<br />

homogeneous regarding the hedonic judgment and where all the products belong to the same sub‐category,<br />

meaning that they are related to a single ideal product.<br />

148


4.2. <strong>The</strong> <strong>Ideal</strong> Product<br />

used as Reference


4. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong>s as a Tool for Optimization<br />

Since the Food Industry cannot formulate one product per consumer (not cost effective), the optimization<br />

procedures presented in the literature (Szczesniak, Loew, & Skinner, 1975; Hoggan, 1975; Cooper, Earle, &<br />

Triggs, 1989) are done according to one ideal product used as a reference to match at the panel level. Hence<br />

the consensus that would satisfy a maximum of consumers has to be found. In practice, the averaged ideal<br />

profile calculated over the entire panel of consumers is often considered.<br />

In the next section, another solution incorporating the individual ideal profiles is presented. This solution is<br />

obtained from a new mapping technique called <strong>Ideal</strong> Mapping (IdMap). <strong>The</strong> procedure of this methodology is<br />

developed in “Construction of an <strong>Ideal</strong> Map (IdMap) based on the ideal profiles obtained directly from<br />

consumers” <strong>by</strong> <strong>Worch</strong> et al. Since this methodology is inspired from the external Preference Mapping, a<br />

comparison with this technique is presented in the article and is extended in the follow up section §4.2.2.<br />

4.2.1. Presentation of the IdMap<br />

Journal:<br />

Title:<br />

Food Quality and Preference<br />

Construction of an <strong>Ideal</strong> Map (IdMap) based on the ideal profiles obtained directly from<br />

consumers.<br />

Authors: <strong>Worch</strong>, T., Lê, S., Punter, P., & Pagès, J.<br />

Abstract:<br />

Keywords:<br />

Reference:<br />

In this paper, the <strong>Ideal</strong> Mapping technique is presented. It is similar to the Preference<br />

Mapping technique using the quadratic model proposed <strong>by</strong> Danzart. Indeed, both methods<br />

start from the sensory product space (i.e. they are both called “external” maps) and aim at<br />

defining areas within the product space that would satisfy a maximum number of consumers.<br />

However many differences are observed between the maps. Among them, there is (1) the<br />

nature of the maps (based on hedonic ratings vs. ideal profiles), (2) the way they are<br />

constructed (individual models vs. variability of the ideal profiles), (3) their meanings (liking<br />

zones vs. ideal zones) and (4) the proportion of consumers they would satisfy (high vs. low).<br />

<strong>The</strong> application of both methodologies on the two examples shows that the IdMap is<br />

rather a complement to the PrefMap than a substitute. When the final ideal product (i.e.<br />

satisfying a maximum number of consumers) belongs to the product space (e.g. Perfume<br />

dataset), the IdMap confirms the PrefMap solution. When the final ideal product is located<br />

outside the product space (e.g. Croissant dataset), the IdMap can be seen as an extension of<br />

the PrefMap.<br />

<strong>Ideal</strong> <strong>Profile</strong> Method, Preference Mapping, confidence ellipses, consumers, optimization<br />

<strong>Worch</strong>, T., Lê, S., Punter, P., & Pagès, J. (2012). Construction of an <strong>Ideal</strong> Map (IdMap) based on<br />

the ideal profiles obtained directly from consumers. Food Quality and Preference, 26, 93‐104.<br />

151


4.2. <strong>The</strong> <strong>Ideal</strong> Product used as a Reference<br />

1. Introduction<br />

In sensory analysis, a common practice is to ask a panel of experts or trained panelists to rate the products tested on a<br />

set of pre‐defined attributes (Quantitative Descriptive Analysis or QDA®, Stone, Sidel, Oliver, Woolsey & Singleton, 1974).<br />

Meanwhile, consumers evaluate the same products and rate them according to their liking (Central Location Test or CLT).<br />

From these two tests, two different types of information concerning the products are collected: the sensory profile on one<br />

hand and the hedonic scores on the other hand.<br />

In order to better understand the consumers' hedonic judgments, and more especially which sensory attributes<br />

influence positively or negatively their liking, an analysis joining these two types of information ‐sensory description and<br />

hedonic judgments‐ is performed. For instance, the two tables can be combined and analyzed simultaneously. This is the<br />

principle of the Preference Mapping techniques (Greenhoff & MacFie, 1994) which became important in the process of<br />

product development as it guides for products’ improvement.<br />

In practice, two types of Preference Mapping technique exist (Carroll, 1972). <strong>The</strong>se two techniques differ according to<br />

the point of view adopted:<br />

• if the focus is on the hedonic data –the sensory information being projected as supplementary within the<br />

preference space‐ an Internal Preference Mapping (or MDPref) is performed;<br />

• if the focus is on the sensory profiles of the products, the hedonic scores being then regressed on the<br />

sensory dimensions, an External Preference Mapping (or PrefMap) is performed.<br />

In both cases, several derivatives exist. For the internal preference mapping, there are the Consumers' Preference<br />

Analysis (CPA, Lê, Pagès & Husson, 2006) or the Landscape Segmentation Analysis (LSA, Ennis, 2005). For the external<br />

preference mapping, the diversity mainly lies in the choice of the model explaining the individual liking scores in function of<br />

the sensory dimensions (Schlich & McEwan, 1992). It can be more or less complex, going from the linear model to the<br />

quadratic model proposed <strong>by</strong> Danzart (1998).<br />

At the present time, the model proposed <strong>by</strong> Danzart (noted here as PrefMapD) is the standard model used in external<br />

preference mapping. It allows constructing a surface plot at the panel level (as an addition of individual surface plots<br />

obtained from each consumer) in which the profiles of an ideal product which belongs to the area where a maximum<br />

proportion of consumers would like the product can be estimated (Danzart, 2009; Mao & Danzart, 2008).<br />

Although many external preference mapping studies involving all types of products have been published in the recent<br />

years (for a short review, see Van Kleef, Van Trijp & Luning, 2006), it is subject to many criticisms. Among them can be<br />

mentioned (Faber, Mojet & Poelman, 2003):<br />

• only the two first sensory dimensions are used to explain the liking scores. Hence, some relevant information<br />

is discarded, which can lead to “irrelevant” models for a non‐negligible number of consumers;<br />

• adding extra dimensions in the circular, elliptic or quadratic models can over‐fit the liking scores. In this case,<br />

the optimization of the products can be due to a small proportion of consumers only, as only a low number<br />

of degrees of freedom are available for the estimation of the parameters.<br />

<strong>The</strong>refore, other multi‐table analyses such as Multiple Factor Analysis (MFA, Escofier & Pagès, 2008; Couronne, 1996),<br />

PLS regression (Husson & Pagès, 2003) or the L‐PLS regression ‐when extra information concerning the consumers is<br />

available‐ (Lengard & Kermit, 2006) have been proposed.<br />

In this paper, we propose a variation of PrefMap when sensory data is collected according to the <strong>Ideal</strong> <strong>Profile</strong> Method<br />

(IPM, <strong>Worch</strong>, 2011; <strong>Worch</strong>, Lê, Punter & Pagès, 2011). In this case, the consumers provide three types of information: the<br />

sensory profiles (i.e. how consumers perceive the products), the hedonic scores (i.e. how they like the products) as well as<br />

their ideal profiles (i.e. what are the consumers’ expectations). This technique takes into consideration the sensory profiles<br />

of the products and the ideal profiles directly provided <strong>by</strong> consumers for the construction of the map.<br />

2. Material and methods<br />

2.1. Notation<br />

<strong>The</strong> same notation as the one used in the paper from <strong>Worch</strong>, Lê, Punter & Pagès (2012) checking for the consistency of<br />

the ideal data obtained from the IPM are used here. Hence, we denote in the rest of the article (the vectors are in bold):<br />

P: number of products tested;<br />

A: number of attributes used to describe the products tested as well as the ideal products;<br />

J: number of consumers.<br />

1)<br />

: intensity perceived <strong>by</strong> the consumer j for the product p and the attribute a;<br />

. ; 1: : vector or intensities perceived <strong>by</strong> the consumer j for the P products and the attribute a;<br />

. : average over the index p; average intensity perceived <strong>by</strong> the consumer j on attribute a over the P products. (Table<br />

152


4. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong>s as a Tool for Optimization<br />

.<br />

Consumer j Attribute 1 … Attribute a … Attribute A<br />

Product 1<br />

…<br />

Product p <br />

…<br />

Product P<br />

.<br />

Table 2: Organization and illustration of the notation for the sensory data.<br />

: ideal intensity of the attribute a provided <strong>by</strong> the consumer j after testing the product p;<br />

. ; 1: : vector of ideal intensities of the attribute a provided <strong>by</strong> the consumer j for the P products;<br />

.: average over the index p; average ideal intensity of the attribute a provided <strong>by</strong> the consumer j over the P<br />

products.<br />

: hedonic judgment provided <strong>by</strong> the consumer j for the product p;<br />

. ; 1: : vector of hedonic judgments provided <strong>by</strong> the consumer j for the P products.<br />

<strong>The</strong> difference between consumers related to a different use of the scale is not of great interest here. <strong>The</strong> averaged<br />

ideal profile from each consumer is hence corrected <strong>by</strong> subtracting, for each attribute, the averaged intensity that the<br />

consumer perceived for the entire set of products (Eq.1). <strong>The</strong> corrected averaged ideal profile is denoted .. .<br />

̃. . . (1)<br />

Note: <strong>The</strong> term corrected refers to a geometric translation of the ideal ratings according to the consumer’s use of the<br />

scale. It is performed in order to readjust all the consumers’ scales together. In other words, corrected refers to corrected<br />

for the scale use. In the rest of the document, we denote as corrected ideal profile the ideal profile from a consumer which<br />

has been corrected from the use of the scale using Eq. 1.<br />

2.2. Materials<br />

To illustrate the methodology presented below, two datasets obtained from the IPM are used: the perfume (<strong>Worch</strong>, Lê<br />

& Punter, 2010) and the croissant datasets.<br />

Perfume: It concerns 12 luxurious women perfumes among which two were duplicated (Table 2). Each product has<br />

been rated on 21 attributes (listed in Table 2) <strong>by</strong> 103 Dutch consumers. For each perfume and each attribute, both the<br />

perceived and ideal intensities have been rated on a line scale. After rating each product on perceived and ideal intensity,<br />

overall liking was rated on a structured 9‐point category scale. <strong>The</strong> 14 samples were presented in monadic sequence, taking<br />

care of order and carry‐over effects (MacFie, Bratchell, Greenhoff & Vallis, 1989) in two 1‐hour sessions.<br />

Products Type Attributes<br />

Angel Eau de Parfum Intensity Spicy<br />

Cinema Eau de Parfum Freshness Woody<br />

Pleasures Eau de Parfum Jasmine Leather<br />

Aromatics Elixir Eau de Parfum Rose Nutty<br />

Lolita Lempicka Eau de Parfum Chamomile Musk<br />

Chanel N⁰5 Eau de Parfum Fresh lemon Animal<br />

L’Instant Eau de Parfum Vanilla Earthy<br />

J’Adore (EP) Eau de Parfum Citrus Incense<br />

J’Adore (ET) Eau de Toilette Anis Green<br />

Pure Poison Eau de Parfum Sweet fruit<br />

Shalimar Eau de Toilette Honey<br />

Coco Mademoiselle Eau de Parfum Caramel<br />

Table 2: List of products and attributes in the perfume study.<br />

Note: <strong>The</strong> products Pure Poison and Shalimar have been duplicated.<br />

Croissant: Following the same procedure, nine croissants have been tested <strong>by</strong> 151 Dutch consumers (Table 3). Each<br />

product has been rated on 26 attributes (Table 3). For confidentiality reasons, the product names and their differences in<br />

the recipes will not be mentioned here.<br />

153


4.2. <strong>The</strong> <strong>Ideal</strong> Product used as a Reference<br />

2.3. Method<br />

Products<br />

Attributes<br />

Croissant 1 Length External color Butter taste<br />

Croissant 2 Height Internal color Overall taste<br />

Croissant 3 Bending Aroma of butter Sweetness<br />

Croissant 4 Shape Aroma overall Saltiness<br />

Croissant 5 Twist Crispiness Fatty taste<br />

Croissant 6 Consistency of shape Lamination Musty taste<br />

Croissant 7 Consistency of size Firmness Aftertaste intensity<br />

Croissant 8 Layers Moistness of crumb Aftertaste length<br />

Croissant 9 Gloss Chewiness<br />

Table 3: List of products and attributes in the croissant study.<br />

<strong>The</strong> construction of the <strong>Ideal</strong> Map is based on the methodology of the PrefMapD. <strong>The</strong>refore, a comparison of results<br />

obtained from both methodologies is also presented.<br />

2.3.1. IdMap<br />

2.3.1.1. Definition of the product space<br />

Like for PrefMapD, the IdMap takes as starting point the sensory product space. Thus, the IdMap is defined as an<br />

external map which is directly comparable to PrefMapD. <strong>The</strong> product space is created from the averaged sensory profiles<br />

. (Table 4a). It is obtained <strong>by</strong> multivariate analysis (Principal Component Analysis, MFA, Generalized Procrustes Analysis,<br />

etc.). In this case, PCA is used.<br />

2.3.1.2. Projection of the corrected ideal products from each consumer and of the liking scores on that space<br />

In this product space, the corrected ideal products ̃ obtained from each consumer are projected as supplementary<br />

entities (Table 4b). <strong>The</strong> distribution of the projection of these ideal products provides a first idea on the direction to take to<br />

develop an eventual ideal product satisfying a maximum of consumers (Figure 1).<br />

Attribute 1 … Attribute a … Attribute A Cons. 1 … Cons. j … Cons. J<br />

Product 1<br />

…<br />

Product p . .. <br />

…<br />

Product P (a) (c)<br />

Cons. 1 Product 1<br />

…<br />

Cons. j Product p ̃<br />

…<br />

Cons. J Product P<br />

(b)<br />

Table 4: Organization of the data used for the definition of the sensory space (a)<br />

with projection of the corrected ideal profiles as supplementary entities (b),<br />

and of the liking scores as supplementary variables (c).<br />

154


4. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong>s as a Tool for Optimization<br />

Dim 2 (26.14%)<br />

-20 -10 0 10 20 30<br />

-40 -20 0 20 40<br />

Figure 1: Projection of the corrected ideal products provided from the consumers on the sensory product space.<br />

2.3.1.3. Creation of the IdMap as a Density Map.<br />

Dim 1 (45.41%)<br />

To create the IdMap, a first solution consists in measuring the density of points (i.e. ideal products) projected in each<br />

zone of the space (Figure 2).<br />

Figure 2: <strong>Ideal</strong> Map obtained based on the density of ideal products projected in each zone of the space.<br />

However, the low density of points projected (PxJ for full designs) does not allow the creation of a map which would be<br />

as precise as the one obtained with PrefMapD. Indeed, a high resolution (i.e. square the space in a high number of small<br />

zones) only associates each individual zone with a very small number of projections while a low resolution (i.e. squaring the<br />

space in a lower number but wider zones) creates a "gross" map.<br />

Moreover, this procedure does not take into account important information concerning the variability of the ideal<br />

profiles provided <strong>by</strong> the same consumer. Indeed, the IdMap created based on the density does not consider the origin of<br />

the projections: in this case, no difference is made whether the ideal products in a same zone are provided <strong>by</strong> one or many<br />

consumers.<br />

Let’s consider 100 consumers providing 10 ideal profiles each. 1000 points are hence projected on this map. An ideal<br />

product belonging to a zone of the space regrouping 10% of the projections can either be linked to a large number of<br />

consumers (one point per consumer), or to a small number of consumers (the 10 ideal profiles of 10 consumers). In these<br />

cases, the impact is not the same since the creation of such ideal product will not affect the same population (100 vs. 10<br />

consumers).<br />

2.3.1.4. Smoothing procedure: use of confidence ellipses around the averaged ideal products<br />

155


4.2. <strong>The</strong> <strong>Ideal</strong> Product used as a Reference<br />

In order to take into account the variability within consumers of their ideal ratings, a confidence ellipse is constructed<br />

around the averaged ideal profile provided <strong>by</strong> each consumer (Husson & Lê Pagès, 2005). <strong>The</strong>se confidence ellipses are<br />

obtained <strong>by</strong> partial bootstrap on the products tested.<br />

In practice, a random sampling with replacement of P' among the P tested products is performed (usually, P’ is equal<br />

to P). For each consumer, the corrected ideal profile averaged over the P' products is computed and projected as illustrative<br />

on the sensory space. This corresponds to answering the following question: "where the corrected averaged ideal product<br />

of a consumer would be projected if, instead of rating it according to the P products, he would rate it according to the P’<br />

products?"<br />

This simulation step is iterated many times (500 times in practice) and the confidence ellipses containing 95% of the<br />

projections are constructed around each consumer (Figure 3).<br />

Dim 2 (26.14%)<br />

-15 -10 -5 0 5 10 15<br />

-10 -5 0 5 10 15 20<br />

Dim 1 (45.41%)<br />

Figure 3: Confidence ellipses constructed around the corrected averaged ideal products from each consumer.<br />

Note: In this situation, the consumers are associated to one unique ideal profile that they described P times with a<br />

certain variability highlighted <strong>by</strong> the confidence ellipses. When the products tested are from different categories (e.g. milk<br />

and dark chocolate), consumers might provide multiple ideals. In such situation, the IdMap should be performed on the<br />

larger subset of products corresponding to one unique ideal.<br />

For each point of the sensory space, the amount (in percentage) of ellipses covering that area is computed. In other<br />

words, for each point of the space, the proportion of consumers having an ideal in each area of the space is measured<br />

(Figure 4). In order to facilitate the interpretation of the results, a color code is associated to each zone of the space: the<br />

larger the proportion of consumers in an area of the space, the lighter the color.<br />

156


4. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong>s as a Tool for Optimization<br />

Dim 2(26.1%)<br />

-15 -10 -5 0 5 10 15<br />

1111 10 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 11 111 1110 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0<br />

1111 10 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 1 1 1 1 1 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0<br />

1111 110 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1111 111 1110 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0<br />

1111 110 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 2 2 2 2 110 1 1 1 1 1 1 1 1 1 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0<br />

1111 110 0 0 0 0 0 0 0 0 0 0 0 0 0 11222222221 1 1 1 1 1 1 1 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0<br />

1111 110 0 0 0 0 0 0 0 0 0 0 0 0 1 1 1 2222222221111 111 10 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0<br />

1111 110 0 1 1 1 1 0 0 0 0 0 0 111122222223 2 2 1 1 1 1 1 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0<br />

1111 110 1111 1110 0 0 0 1112 2 2 2 2 2 2 2 3 2 2 2 11 110 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0<br />

1111 110 1111 1111 0 0 1 1 1 1 1 22222223 2 2 2 11 2 11 1111 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0<br />

1111 110 1111 1111 0 0 1 1 1 1 1 2 2 2 2 2 2 2 2 2 2 2 3 2 2 2 1 1 1 1 1 1 1 1 0000000000000000<br />

1111 10 0 1111 1111 10 1 1 1 1 1 222222211 113 2 2 2 2 1111 1111 110 0 0 0 0 0 0 0 0 0 0 0 0<br />

1111 0 0 0 0 1 1 1 1 1 1 1 0 0 0 1112 2 3 3 3 3 3 2 11 13 3 2 2 2 2 1111 1122 21110 0 0 0 0 0 0 0 0 0 0<br />

1110 0 0 0 0 0 11 1111 0 0 0 1 3 3 3 3 4 4 3 3 2222 1 2 3 2 2 2 2 1111 12 2 2 2 2 1 1 1 1 0 0 0 0 0 0 0 0 0<br />

110 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 223333442 2 2 2 2 3 2 3 2 2 2 3 3 3 3 2 3 2 2 2 2 2 2 111100000000<br />

0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 22222223 2 2 2 2 3 3 3 1 2 2 2 4 3334 4 3 3 2 2 2 2 111111000 000<br />

0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 333333331 2223 3 3 2 3 223 3 3 3 4 4 4 33 32211111110 0 0 0 0<br />

0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1122333332 2 2 2 33 332 3 4 3 2 3344 4443 3 3 2 111111110 0 0 0<br />

0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 22222223 4 4 4 5 4 4 5 33 34 3 3 4 5 4 4 4 4 4 3 3 2 1112 2 2 111 000<br />

0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 2 2 4 4 4 223 4 4 4 5 77 665 4 4 5 4 5 6 6 6 5 4 4 4 4 3 2 112222111 000<br />

0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 1 2 3 4 4 4 334 6 7 6 7 88 9910 8 7 6 5 4 5 77 6 5 5 4 5 3 2 2 1 222221 1 1 0 0<br />

0001 1 1 1 0000 0011 112 2 3 4443 777 78 8 9 911101110 9 8 5 4 5 7 7 6 6 5 5 3 2 2 1 222221 1 1 0 0<br />

0001 1 1 1 1 0 0 0 0 1 1 1 1 22223 5 667 9 9 88111111111111111110 9 7 7 6 7 8 8 6 6 4 2 2 1 222221 1 1 0 0<br />

0000 1 1 1 1 1 2 1 1 1 22 223 3 4 55881010111113131415151313141110111011 9 8888 6 6 3 3 2 2 2 2 2 2 1 1 1 0 0<br />

0000 1 1 1 1 2 2 2 1122 3 3 4 4 8 8111110131112141518191719181914121210101011 8 9 8 5 5 5 5 3 4 222221 1 000<br />

0000 01 2 333332 2 3 5 6 7 9 111515161618201821232322222120181817151514101112 9 8 7 5 5 5 3 4 4 2 3331 0 0 0 0<br />

0000 001 3344 446 7 10 9 101314192021232323252527272626252420201617161514101110 88 5 6 5 66443332 2 2 1 1<br />

0000 0002 4 4 6 7778 9 111314172124242425262726302931323329232019181616161612111110 7 6 7 8 7 554442 2 2 2 1<br />

0000 00002 5 6 7778 101212152125272825262929313432343435342826201716201817141414131010 9 8 7 7 6 6 5 4 3 3 3 2 1<br />

0000 0001 2 44 6 8 7 101213131421263232303031313434353635323329272120161618171415161513101010 9 8 6 6 5 5 4 3 3 3 1<br />

0000 001 1 2 3 4 5 6 7 1012121315232629333536373935353333313029262519191918151615151515131111 9997 665 4 4 332<br />

0000 01 1 1 1 2 3 668 9 11111315222727313237404239373434323227242019191919181716111416151210 8 9 8887 5 4 4 4 2 2<br />

0000 01 1 1 1 1 2 4 6 881010111721253034353841423837343530272625201819191818171413141413101010 8 9 8 8 7 7 4 4 3 2 2<br />

0000 01 1 1 1 1 1 337 8 1010121420232628323438433937373429272722201817161514151313121210 9 8 9 7 8 9 77663 3 2 2<br />

0000 01 1 1 1 1 1 334 5 6 9 1214182021232429323537363529252224222019161414121313121111 9 8887 7 6 6 6 6 5 4 222<br />

0000 01 1 1 1 1 1 1 3 44 5 5 7 1012172020232429323428262520212019201415121310101010 9 10 8 6 7 7 6 5 6 55442 2 2 1<br />

0000 01 1 1 1 1 1 1 1 44 45 6 7 8 101618191824273026252219211917171413151011111011 9 7 6 6 6 5 4 3333332 2 2 2<br />

0000 001 1 1 1 1 1 1 1 4 4 4 4 6 8 991314161719192018171718181512121313 9 1111 9 10 9 6 6 6 4 332 3 3 3 3 3 2 2 2 2<br />

0000 0001111 1111 2 33336 8 10121312101213141415161614111212 9 10 9 1010 9 66 5 5 5 33222221 1 1 1 1<br />

0000 00001 1 1 1 1 1 1 1 2 3 3 4 4 7 7 6 555 6 9 1111111111121111 7 7 7 7 8 8 8 6 5 4 4 4 2 1 1 1 1 1 1 1 1 1 1 1<br />

0000 0000001 1 1 1 1 1 1 1 334 5 5 5 5 4 4 5 7 8 9 8889 10 8 8 7 6 7 8 6 5 7 5 4 4 4 111111111111<br />

0000 0000000 01 1 1 1 1 2 2 4 4 4 55444 5566 7 10 88 7 8 7 8 6 5 7 6 5 5 3 3 3 2 111111111111<br />

0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 113334 4 3 3 3 3 3 4 5 6 7777 776 554 5 6 5 44 2 11111111111111<br />

0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 2 2 2 2 1 2 3 3 3 3 3 4 4 4 5 8 8 7 888 5554 4 4 4 4 2 11111111111111<br />

0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 2 2 2 1111333 3344 5 6 77 776 6 6 6 5 3332 2 11111111111111<br />

0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 1 1 1 1 1 1 1 1 2 3 3 3 3 4 4 5 5 5 5 6 5 4443 1 2 2 2 2 2 1 1 1 1 1 1 1 1 1 1 1 1 1<br />

0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 1 1 1 1 1 1 1 1 2 2 3333 34 5 4 333 2221 1 1 22 221 1 1 1 1 1 1 1 1 1 1 1 1<br />

0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 1 1 1 1 1 1 1 1 1 1 2233 3332 2 2 2 1111 1112 2 2 1 1 1 1 1 1 1 1 1 1 1 1 1<br />

0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 1 1 1 1 1 1 1 1 1 1 1 2 2 2 2 3 3 2 2 2 2 1111 1111 2 2 1 1 1 1 1 1 1 1 1 1 1 1 1<br />

0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 2 2 2 2 2 2 2 2 1111 1111 12 1 1 1 1 1 1 1 1 1 1 1 1 1<br />

0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 2 11 10 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1<br />

0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 1 1 1 1 1 1 1 1 1 1 1<br />

0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 111111111111<br />

0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1111111111111111000 000 0000 0000 00000 1111111 111<br />

0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1111111111111110000 000 0000 0000 0000001 1 1 1 1 1 1 1 1<br />

0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0000 000 0000 0000 0000000 11111111<br />

0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1111111111110 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 1 1 1 1 1<br />

0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 1 1 1 1 1 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 111 111<br />

0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 1 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 1 1 1<br />

0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 1 1<br />

0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1<br />

0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1<br />

-10 -5 0 5 10 15 20<br />

Dim 1(45.4%)<br />

Figure 4: Proportion of consumers sharing a common ideal for each point of the sensory space.<br />

2.3.1.5. Creation of the IdMap<br />

Finally, the external <strong>Ideal</strong> Map including contour lines associated with the proportion of consumers is constructed<br />

(Figure 5).<br />

Dim 2<br />

-6 -4 -2 0 2 4 6 8<br />

3<br />

1<br />

7<br />

20<br />

2<br />

15<br />

6<br />

5<br />

30<br />

10<br />

25<br />

4<br />

15<br />

15<br />

10<br />

Dim 1<br />

Figure 5: <strong>Ideal</strong> Map including contour lines indicating the proportion of consumers.<br />

2.3.1.6. Notion of weight for the consumers<br />

-5 0 5 10 15<br />

In theory, a large confidence ellipse means that the product is associated with a large variability. In our case, a large<br />

variability can be interpreted in two ways:<br />

157


4.2. <strong>The</strong> <strong>Ideal</strong> Product used as a Reference<br />

• the consumer considered is associated with a large ideal area;<br />

• the consumer considered has difficulties rating stable ideals.<br />

In practice, it is impossible defining a threshold above which a confidence ellipse would be considered as large as well<br />

as determining the reason of this variability. However, a consumer associated with a large (vs. small) confidence ellipse has<br />

a stronger influence (resp. lower) in the construction of the IdMap. Indeed, a larger (resp. smaller) area of the sensory space<br />

is covered.<br />

For that reason, it might be worthwhile homogenizing consumers. To do so, each consumer is associated with a weight<br />

which is inversely proportional to the size of its corresponding ellipse. Each weighted consumer is thus associated with an<br />

ellipse of area equal to one unit which is spread on the sensory space:<br />

• a consumer rating stable ideal intensities (hence associated with a small ellipse) has a strong weight on each<br />

point of the small surface it covers;<br />

• a consumer rating large ideal intensities (hence associated with a large ellipse) has a small weight on each<br />

point of the wide surface it covers.<br />

<strong>The</strong> map thus obtained is noted weighted <strong>Ideal</strong> Map or wIdMap. In this case, the contour lines don’t correspond to the<br />

raw proportion of consumers, but to a corrected proportion according to the different consumers’ weights.<br />

If one assumes that large confidence ellipses correspond to consumers with wide ideal area, the use of the IdMap is<br />

recommended. However, if one assumes that wide ellipses correspond to instability of the ideal ratings, the wIdMap is<br />

preferred.<br />

2.3.1.7. Definition of the ideal product<br />

For the PrefMapD, the coordinates corresponding to the maximum proportion of consumers overlapping can be<br />

extracted. By using the inverse formula from the PCA ‐which aims at estimating the sensory profile of a product based on<br />

the coordinates on the map‐ a potential profile of the ideal product can be estimated based on these coordinates. This<br />

procedure can also be applied to the IdMap technique. As the individual ideal profiles are known, one could also use as<br />

ideal product the averaged ideal profile calculated directly from the consumers sharing an ideal product in this area of the<br />

map.<br />

2.3.2. Comparison of the IdMap and the PrefMapD<br />

Although both methodologies (IdMap and the PrefMapD) are similar, the nature of the data involved differs. And it is<br />

especially according to this difference that both techniques are compared.<br />

2.3.2.1. Link between the maps (a priori)<br />

According to <strong>Worch</strong> et al. (2012), a consumer is consistent if the ideal product provided shares similar characteristics<br />

with the preferred product. Thus, in the sensory space, the projection as illustrative of the ideal profiles provided <strong>by</strong> a<br />

consumer must be close to the preferred product. To check that, the corrected ideal profiles of the consumers (Table 4b) on<br />

one hand and the hedonic scores on the other hand (Table 4c) are respectively projected as supplementary entities and<br />

supplementary variables on the sensory space (Table 4a). For a panel composed of consistent consumers, the distribution<br />

of the consumers within the correlation circle (hedonic) is coherent (i.e. going in the same direction) with the distribution of<br />

the projections of their ideal profiles within the sensory space.<br />

This double projection provides a first visual impression about the relationship between IdMap and PrefMapD.<br />

However, it is only approximate as the one to one relationship is not further studied here.<br />

2.3.2.2. Liking threshold and definition of the PrefMapD and IdMap maps<br />

In this study a product is defined as liked <strong>by</strong> a consumer if the consumer considered would like it more than a certain<br />

threshold value. Similarly, each consumer is associated to an area of liking corresponding to the area of the sensory space<br />

which contains products he/she would like.<br />

<strong>The</strong> construction of the PrefMapD depends on the threshold value (also called liking threshold), as it determines<br />

whether a product belonging to the sensory space would be liked or not <strong>by</strong> each consumer. In practice, for a given<br />

consumer, each point of the space is associated with a product whose liking score is estimated based on a model defined<br />

for that consumer. This estimation of the liking score is compared to the liking threshold: if the estimation is larger (resp.<br />

smaller) than the threshold, the product corresponding to this point of the space is liked (resp. rejected) <strong>by</strong> the consumer.<br />

<strong>The</strong> larger the threshold, the smaller the surface of liking for each consumer. Thus, increasing the threshold reduces<br />

the chances of overlap between individual areas of liking, hence reducing the proportion of consumers sharing a common<br />

ideal. In this paper, the standard threshold is considered for PrefMapD. It corresponds to the averaged hedonic rating .<br />

each consumer provided to the products. In practice, this threshold means liking on average half of the product space for<br />

each consumer. Thus, the liking area defined for each consumer is wide and is not defining a maximum‐liking area for the<br />

standard PrefMapD.<br />

<strong>The</strong> use of such a threshold does not occur with the IdMap. However, it is possible to influence (to a lesser extent) the<br />

proportion of consumers sharing a common ideal <strong>by</strong> adjusting the size of the individual confidence ellipses: the larger the<br />

individual ellipses, the higher the chances of overlap. <strong>The</strong> size of the ellipses depends on several parameters:<br />

158


4. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong>s as a Tool for Optimization<br />

• the variability of the ideal profiles provided <strong>by</strong> a consumer;<br />

• the p‐value used to create the ellipses (<strong>by</strong> default, the ellipses contain 95% of the projections, and reducing<br />

this proportion reduces the size of the ellipse);<br />

• the number of products used for the resampling: increasing the number of products in the resampling<br />

procedure reduce the size of the ellipses;<br />

• at some extent, the application of weight to the ellipses as in the wIdMap.<br />

In practice, the confidence ellipses cover only a small area of the product space. By definition, this liking area<br />

corresponds to maximum liking (i.e. ideal product) for each consumer. Thus, we are talking about ideal area with the<br />

IdMap.<br />

<strong>The</strong> theoretical difference in the meanings of the individual liking and ideal areas in PrefMapD and IdMap is related to<br />

the threshold used. This threshold as well as the surface of the area in each map are schematized Figure 6.<br />

(a)<br />

(b)<br />

acceptance threshold<br />

for PrefMapD<br />

acceptance threshold<br />

for IdMap<br />

Density<br />

Density<br />

Liking scores<br />

Figure 6: <strong>The</strong>oretical difference in the "threshold" used to define the individual acceptance area<br />

for PrefMapD (left, a) and IdMap (right, b).<br />

Note: the arrow shows that for the PrefMapD, the acceptance threshold can be adjusted.<br />

2.3.2.3. Comparison of the results through the estimated ideal profiles obtained<br />

Liking scores<br />

Besides the visual comparison of the maps obtained with the two techniques, one can also compare the sensory<br />

profiles of the ideal products both methods would generate. However, a one‐to‐one comparison of the ideal profiles might<br />

not be sufficient, as references are needed. To enrich the comparison, the sensory profiles of the tested products are added<br />

to the comparison. <strong>The</strong>se sensory profiles are standardized on each attribute (Eq. 2a), and the same transformation is<br />

applied to the sensory profiles of the estimated ideal products (Eq. 2b).<br />

Standardization of the sensory profiles of the tested products: . .. <br />

..<br />

(2a)<br />

Standardization of the sensory profiles of the ideal products: . .. <br />

..<br />

(2b)<br />

<strong>The</strong> P+2 standardized products are represented graphically.<br />

2.3.2.4. Properties of the different maps<br />

<strong>The</strong> properties of the different maps obtained according to PrefMapD and IdMap are summarized Table 5.<br />

159


4.2. <strong>The</strong> <strong>Ideal</strong> Product used as a Reference<br />

<strong>Ideal</strong> <strong>Profile</strong>s<br />

Space considered<br />

Interpretation issues<br />

Proportion of<br />

consumers (contour<br />

lines)<br />

PrefMapD<br />

Indirect<br />

Globally estimated from an aggregation of<br />

individual data<br />

No possible validation<br />

Product space only<br />

(the individual estimations belong to the<br />

product space)<br />

Models:<br />

- Strong dependence to the individual<br />

models<br />

- Low number of degrees of freedom<br />

Mechanic dependence to the threshold<br />

considered<br />

High when the threshold is low: there is a<br />

risk of finding unstable maxima<br />

IdMap<br />

Direct<br />

Directly measured at the consumer level,<br />

and then aggregated<br />

Direct validation through the study of the<br />

consistency of the individual data<br />

Extended product space<br />

(the individual ideal data can be outside the<br />

product space)<br />

Ellipses:<br />

- Size: large ideal area or unstable ratings?<br />

- Homogenization of the ellipses? (use of<br />

individual weights)<br />

Mechanic dependence to the size of the<br />

ellipses<br />

Generally low <strong>by</strong> construction as it<br />

corresponds to a common ideal for a group<br />

of consumers<br />

Meanings of the map Area of non‐rejection (rather than area of <strong>Ideal</strong> area for each consumer<br />

preference) when the threshold is low<br />

Table 5: Properties and definition of the maps obtained with PrefMapD et IdMap.<br />

3. Results<br />

<strong>The</strong> methodology presented above is applied to the perfume and to the croissant datasets.<br />

3.1. Measure a priori of the link between the maps<br />

<strong>The</strong> consistency of the ideal and hedonic data is measured visually in the sensory space <strong>by</strong> projecting simultaneous the<br />

corrected ideal products from each consumer as supplementary entities and the hedonic ratings as supplementary<br />

variables.<br />

In the perfume example, the projection of the hedonic ratings as supplementary variables highlights homogeneity of<br />

the panel, the majority of consumers preferring the products located on the negative part of the first dimension (Figure 7).<br />

Meanwhile, the projection of the corrected ideal products also suggests homogeneity of the panel, the majority of the<br />

points being located along the negative part of the first dimension.<br />

Dim 2 (17.06%)<br />

-20 -10 0 10 20 30<br />

Dim 2 (17.06%)<br />

-1.0 -0.5 0.0 0.5 1.0<br />

-30 -20 -10 0 10 20<br />

-1.0 -0.5 0.0 0.5 1.0<br />

Dim 1 (68.12%)<br />

Dim 1 (68.12%)<br />

Figure 7: Projections as supplementary entities (left) of the corrected ideal profiles<br />

and as supplementary variables (right) of the liking ratings on the sensory space (perfume example).<br />

160


4. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong>s as a Tool for Optimization<br />

In the croissant example, the projection of the hedonic ratings as supplementary variables highlights more<br />

heterogeneity than in the perfume example (Figure 8). However, most of them point to the lower right corner of the space<br />

(positive side on the first dimension and negative side on the second dimension). <strong>The</strong> projection of the individual ideal<br />

profiles (as supplementary entities) in the same space shows homogeneity of the consumers in their ideal products, the<br />

majority of them being projected into the lower right corner of the sensory space.<br />

Dim 2 (16.31%)<br />

-40 -30 -20 -10 0 10 20<br />

Dim 2 (16.31%)<br />

-1.0 -0.5 0.0 0.5 1.0<br />

-20 -10 0 10 20 30<br />

-1.0 -0.5 0.0 0.5 1.0<br />

Dim 1 (38.4%)<br />

Figure 8: Projections as supplementary entities (left) of the corrected ideal profiles<br />

and as supplementary variables (right) of the liking ratings on the sensory space (croissant example).<br />

As the repartition of both projections is consistent in both examples, one can a priori expect some similarities in the<br />

results of the IdMap and the PrefMapD.<br />

3.2. Comparison of the maps<br />

Dim 1 (38.4%)<br />

In order to construct the different maps, the sensory space has to be defined. This space is obtained <strong>by</strong> PCA performed<br />

on the sensory profiles of the products (Table 4a).<br />

As it is often the case in PrefMapD, only the first two dimensions are considered in this case.<br />

3.2.1. Perfume example<br />

In the perfume example, the first plane of the PCA (Figure 9) summarizes 85% of the information. <strong>The</strong> first dimension<br />

opposes J'Adore and Pleasures described as fresh and fruity to Shalimar and Angel described with stronger oriental notes.<br />

<strong>The</strong> second dimension opposes Angel and Lolita Lempicka described with sweet notes to Aromatic Elixir.<br />

Figure 9: Sensory space obtained for the perfume dataset.<br />

161


4.2. <strong>The</strong> <strong>Ideal</strong> Product used as a Reference<br />

<strong>The</strong> PrefMapD (Figure 10) highlights a stronger liking area along the negative part of dimension 1. Thus, the most liked<br />

products are J'Adore and Coco M elle . <strong>The</strong> homogeneity of consumers mentioned previously is highlighted here <strong>by</strong> the large<br />

proportion of consumers liking these products. Indeed, 80% of the consumers would like J'Adore and Coco M elle more than<br />

average. However, one can find an “empty” area in which the corresponding product would be liked <strong>by</strong> more than 90% of<br />

the consumers. This corresponds to a local ideal product.<br />

Dim 2<br />

-6 -4 -2 0 2 4<br />

60<br />

70<br />

70<br />

70<br />

90<br />

JAdore_EP<br />

50<br />

80<br />

LInstant<br />

Cinema<br />

JAdore_ET<br />

PleasuresCocoMelle<br />

PurePoison PurePoison2<br />

40<br />

LolitaLempicka<br />

Chaneln5<br />

AromaticsElixir<br />

30<br />

30<br />

20<br />

Ang<br />

Shalimar<br />

Shalimar2<br />

-4 -2 0 2 4 6<br />

Dim 1<br />

Figure 10: PrefMapD for the perfume dataset.<br />

<strong>The</strong> IdMap (Figure 11a) provides similar results, the ideal area shared <strong>by</strong> a maximum of consumers being also located<br />

on the negative part of first dimension. However, this local ideal product seems a little bit less “extreme” along this<br />

dimension than the one obtained with the PrefMapD. It is shared <strong>by</strong> 38% of the consumers.<br />

In this example, the ratio in size between the smallest and the largest ellipse is about 1 to 50. In other words,<br />

consumers don’t rate their ideal with the same variability, which means that they don’t have the same weight in the<br />

construction of the map. To adjust the map according to those differences, consumers are homogenized before<br />

constructing the map.<br />

<strong>The</strong> wIdMap is shown in Figure 11b. In this case, the ideal product shared <strong>by</strong> a maximum of consumers (35%) is located<br />

in a similar area as for the IdMap. Here, the consensus areas are globally smaller than for the IdMap, although they<br />

correspond to similar proportions of consumers.<br />

162


4. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong>s as a Tool for Optimization<br />

Dim 2<br />

-4 -2 0 2 4 6 8<br />

10<br />

10<br />

10<br />

20<br />

JAdore_EP<br />

JAdore_ET<br />

20<br />

30<br />

35<br />

Pleasures<br />

CocoMelle<br />

PurePoison<br />

PurePoison2<br />

LInstant<br />

Cinema<br />

15<br />

25<br />

20<br />

10<br />

LolitaLempicka<br />

Chaneln5<br />

Angel<br />

Shalimar<br />

Shalimar2<br />

AromaticsElixir<br />

Dim 2<br />

-4 -2 0 2 4 6 8<br />

JAdore_EP<br />

JAdore_ET<br />

Pleasures<br />

20<br />

10<br />

20<br />

25<br />

30<br />

20<br />

CocoMelle<br />

PurePoison<br />

PurePoison2<br />

LInstant<br />

Cinema<br />

15<br />

LolitaLempicka<br />

15<br />

Chaneln5<br />

Angel<br />

Shalimar<br />

Shalimar2<br />

AromaticsElixir<br />

-5 0 5<br />

-5 0 5<br />

Dim 1<br />

Figure 11: IdMap (left, a) and wIdMap (right, b) obtained for the perfume dataset.<br />

By using the inverse formula in the PCA, the potential sensory profiles of the ideal products obtained with the<br />

PrefMapD and IdMap are estimated. In the PrefMapD, this ideal product is located at coordinates (‐3, 1), while in the<br />

IdMap, it is located at (‐0.9, 0.6). <strong>The</strong> sensory profiles thus obtained are given Table 6.<br />

IdMap PrefMapD IdMap PrefMapD<br />

intensity 59,0 56,4 caramel 25,1 24,6<br />

freshness 52,2 56,0 spicy 36,7 34,0<br />

jasmin 39,6 40,7 woody 27,0 24,2<br />

rose 38,1 39,7 leather 21,1 18,6<br />

camomille 29,1 28,7 nutty 28,0 26,5<br />

fresh_lemon 35,5 37,2 musk 32,5 29,9<br />

vanilla 33,1 33,3 animal 20,2 18,5<br />

citrus 30,2 31,5 earthy 20,0 17,6<br />

anis 24,9 24,6 incense 26,5 23,9<br />

sweet_fruit 32,0 34,0 green 27,1 28,7<br />

honey 26,6 26,6<br />

Table 6: Estimation of the sensory profiles of the ideal products obtained with PrefMapD and IdMap (perfume example).<br />

In order to better evaluate the differences between these two profiles, they are standardized on each attribute<br />

according to the profiles of the tested products and represented in Figure 12. <strong>The</strong> differences between these two products<br />

being mainly observed on the first dimension, the attributes are ordered according to their coordinates on this dimension<br />

(in decreasing order). For a better comparison, the standardized profiles of the products tested are also shown.<br />

<strong>The</strong> two estimated ideal profiles belong to the product space. <strong>The</strong> ideal intensity ratings are in the same order of<br />

magnitude as the products tested. A more systematic comparison per attribute of the difference between the perceived<br />

and ideal intensities allows product’s improvement. However, this is not done here.<br />

Dim 1<br />

163


4.2. <strong>The</strong> <strong>Ideal</strong> Product used as a Reference<br />

Figure 12: Sensory profiles of the ideal products obtained with PrefMapD and IdMap<br />

standardized according to the profiles of the products tested in the perfume example.<br />

Although both sensory profiles are very similar, the ideal product obtained from the PrefMapD is a little bit more<br />

“extreme” for some attributes than the one obtained from the IdMap.<br />

3.2.2. Croissant example<br />

In the croissant example, the first plane of the PCA (Figure 13) summarizes 55% of the information. <strong>The</strong> first dimension<br />

opposes the products 7, 6 and 8 described as eat, overall taste, musty taste and lamination to the products 4, 2 and 3<br />

described as firm, moist of crumb and butter and fatty taste. <strong>The</strong> second dimension opposes the products 3 and 6 defined<br />

<strong>by</strong> shape, bending and consistency of size to the product 9 defined <strong>by</strong> saltiness, overall aroma and internal color.<br />

Figure 13: Sensory space obtained for the croissant dataset.<br />

<strong>The</strong> PrefMapD (Figure 14) highlights an area of maximum liking in the lower right corner of the plane (positive side of<br />

the dimension 1 and negative side of the dimension 2). This corresponds to the results shown in Figure 8. 60% to 70% of<br />

consumers would be satisfied with a product belonging to that area. In comparison to the perfume example, this proportion<br />

is relatively low. This can be explained <strong>by</strong> the greater heterogeneity of the consumers in this example.<br />

Although there is a potential ideal product in the lower right corner of the plane, the map seems to highlight that the<br />

maximum proportion of consumers liking a product has not been reached, a higher proportion being eventually defined for<br />

a product falling outside the sensory space.<br />

164


4. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong>s as a Tool for Optimization<br />

Dim 2<br />

-4 -2 0 2 4<br />

40<br />

7<br />

40<br />

40<br />

6<br />

50<br />

40<br />

8<br />

40<br />

50<br />

50<br />

9<br />

1<br />

50<br />

40<br />

50<br />

5<br />

3<br />

2<br />

50<br />

60<br />

70<br />

60<br />

70<br />

4<br />

50<br />

-4 -2 0 2 4<br />

Dim 1<br />

Figure 14: PrefMapD for the croissant dataset.<br />

In the IdMap (Figure 15a), the area containing the ideal product satisfying a maximum of consumers is also located in<br />

the lower right corner of the space. However, this ideal area is defined outside the product space as it is more extreme<br />

along the 2 nd dimension.<br />

Here again, the ratio in size between the smallest and the largest ellipse is about 1 to 50. <strong>The</strong> solution obtained after<br />

balancing consumer together is also shown here.<br />

<strong>The</strong> results of the wIdMap (Figure 15b) are similar to the one of the IdMap. <strong>The</strong> ideal product satisfying a maximum of<br />

consumers is also located in the lower right corner of the sensory space. However, in this case, areas of consensus are less<br />

well defined and the proportions of consumers are slightly decreasing.<br />

Dim 2<br />

-8 -6 -4 -2 0 2 4<br />

7<br />

6<br />

8<br />

1<br />

9<br />

10<br />

10<br />

5<br />

10<br />

10<br />

15<br />

3<br />

2<br />

15<br />

10<br />

4<br />

15<br />

10<br />

Dim 2<br />

-8 -6 -4 -2 0 2 4<br />

7<br />

6<br />

8<br />

1<br />

9<br />

5<br />

10<br />

10<br />

3<br />

2<br />

10<br />

10<br />

4<br />

10<br />

-4 -2 0 2 4 6 8<br />

-4 -2 0 2 4 6 8<br />

Dim 1<br />

Figure 15: IdMap (left, a) and wIdMap (right, b) obtained for the croissant dataset.<br />

Dim 1<br />

165


4.2. <strong>The</strong> <strong>Ideal</strong> Product used as a Reference<br />

By using the inverse formula in the PCA, the potential sensory profiles of the ideal products obtained with the<br />

PrefMapD and IdMap are estimated. In the PrefMapD, this ideal product is located at coordinates (4.3;‐1) while in the<br />

IdMap, it is located at (4.3;‐4.5). <strong>The</strong> sensory profiles thus obtained are given Table 7.<br />

IdMap PrefMapD IdMap PrefMapD<br />

length 63,3 61,7 crispiness 46,7 51,7<br />

height 59,8 60,5 lamination 48,0 38,9<br />

bending 67,2 47,0 firmness 65,9 64,5<br />

shape 62,2 50,9 moistness_crumb 61,5 60,8<br />

twist 60,9 42,9 eat 33,1 35,1<br />

consistency_shape 40,7 40,9 butter_taste 54,4 51,7<br />

consistency_size 56,0 54,1 overall_taste 25,5 28,4<br />

layers 58,1 56,9 sweetness 39,3 37,1<br />

gloss 49,0 49,6 saltiness 25,5 27,8<br />

external_color 53,4 55,1 fatty_taste 42,8 45,0<br />

internal_color 37,7 43,6 musty_taste 21,3 23,6<br />

butter_aroma 54,0 50,5 aftertaste_intensity 43,3 45,0<br />

overall_aroma 28,0 30,7 aftertaste_length 41,9 43,7<br />

Table 7: Estimation of the sensory profiles of the ideal products obtained with PrefMapD and IdMap (croissant example).<br />

<strong>The</strong> standardized ideal profiles are shown Figure 16. <strong>The</strong> difference being mainly along the second dimension, the<br />

attributes are ordered in decreasing order along this dimension.<br />

It shows which attributes (and how) should be changed to improve the products tested. It appears here that the<br />

intensities overall taste and musty taste should be reduced while sweetness, butter taste and butter aroma should be<br />

intensified. And the ideal profiles obtained with PrefMapD and IdMap differ mainly for the attributes musty taste, overall<br />

aroma and saltiness for which IdMap requires less intensity while for lamination, shape, consistency of size and bending it<br />

requires more intensity to get closer to the ideal.<br />

4. Conclusions<br />

Figure 16: Sensory profiles of the ideal products obtained with PrefMapD and IdMap<br />

standardized according to the profiles of the products tested in the croissant example.<br />

<strong>The</strong> ideal mapping technique is similar to the external preference mapping technique. However, the nature of the data<br />

used is different: for PrefMapD the sensory profiles of the products are combined to the hedonic scores while in the IdMap,<br />

the sensory profiles of the products are associated to ideal ratings. For that matter, the objectives of the techniques are<br />

different: the PrefMapD is used to define zones of maximum liking, and eventually market opportunities while the IdMap<br />

166


4. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong>s as a Tool for Optimization<br />

aims at defining (estimated or directly) the profile of an ideal product that could be used to guide product developers for<br />

the improvement of their products. Moreover, the IdMap can also be used to find clusters of consumers based on their<br />

ideals.<br />

In the construction of the maps, the major difference between both techniques is related to the meaning of the liking<br />

area defined for each consumer. In the PrefMapD, the individual surfaces are obtained <strong>by</strong> comparing the estimations to a<br />

threshold. As the standard value of this threshold corresponds to the average hedonic rating provided <strong>by</strong> each consumer<br />

for all products, the individual surfaces are large. Hence, they cannot be considered strictly as ideal area. In the IdMap, the<br />

individual surfaces are smaller as they correspond to the ideal surface for each consumer. A consequence is that the<br />

proportion of consumers overlapping is decreased in this case.<br />

In order to get more similar maps (especially in terms of proportions of consumers), one could raise the threshold in<br />

the PrefMapD. <strong>The</strong> liking areas thus defined correspond to areas where only potentially highly liked products are<br />

considered for each consumer, which corresponds more to an ideal area for each consumer. And <strong>by</strong> raising the threshold,<br />

the individual surfaces of liking are reduced, which also reduces the likelihood of overlap between consumers.<br />

As opposed to PrefMapD, the IdMap does not require to model the hedonic ratings in function of the sensory<br />

descriptions. <strong>The</strong> variability of the ideal ratings provided <strong>by</strong> each consumer is used to define individual ideal surfaces from<br />

which the map is constructed. <strong>The</strong> confidence ellipses thus obtained can eventually be balanced together depending on the<br />

point of view adopted (wIdMap).<br />

Thus, the IdMap is rather a complement than a substitute for the PrefMapD. It is therefore recommended to combine<br />

both techniques, PrefMapD being thus used to validate IdMap. Meanwhile, IdMap can enrich PrefMapD. Indeed, one can<br />

expect here that the two maps are:<br />

• close and consistent if the ideal product obtained with PrefMapD belongs to the product space;<br />

• consistent and going in the same direction when it is defined outside the product space.<br />

In the two examples considered, the results from IdMap and PrefMapD are consistent. <strong>The</strong> information provided <strong>by</strong><br />

the two maps is complementary (especially in the croissant example). Specifically, when the ideal product is defined outside<br />

the product space, the sensory profile provided directly from the IPM is more stable than the ideal profile estimated from<br />

PrefMapD.<br />

In practice, with the PrefMapD, ideal profiles can also be estimated outside the product space. However, this<br />

procedure is not advised as the validity of the estimation is questionable for products outside the range of values (models<br />

being calibrated to a certain range). More precisely, there is a risk that the quadratic effects become predominant and the<br />

more the product is extreme (and hence far from the product space), the more the products is liked <strong>by</strong> the consumers.<br />

For that reason, the estimation of an ideal product outside the product space seems more valid with IdMap. In this<br />

case, the interpretation still should be done cautiously as consumers haven’t been confronted with such product. A<br />

validation step which consists in creating a product closer to this part of the space and to test it again with the same<br />

consumers to ensure a higher liking is obtained.<br />

In these two examples, the consumers are homogeneous in their ideal and hedonic ratings. No clusters were found<br />

here. However, in a situation where the panel of consumers is heterogeneous, one may consider to segment the panel in<br />

homogeneous group of consumers first before applying the methodology proposed here on each cluster separately. This<br />

corresponds to the standard methodology for analyzing consumer data when the panel is heterogeneous.<br />

References<br />

Carroll, J.D. (1972). Individual differences and<br />

multidimensional scaling. In Shepard, R.N.,<br />

Romney, A.K., & Nerloves, S. Multidimensional<br />

scaling: theory and applications in the behavioral<br />

sciences. Academic Press, New York.<br />

Couronne, T. (1996). Application de l’analyse factorielle<br />

multiple à la mise en relation de données<br />

sensorielles et de données de consommateurs.<br />

Sciences des Aliments, 16, 23‐35.<br />

Danzart, M. (1998). Quadratic model in preference<br />

mapping. 4 th Sensometric Meeting, Copenhagen,<br />

Denmark, August 1998.<br />

Danzart, M. (2009). Cartographie des préférences. In<br />

Evaluation sensorielle, manuel méthodologique,<br />

3 ème édition, Lavoisier, Paris, p443‐450.<br />

Ennis, D.M. (2005). Analytic approaches to accounting<br />

for individual ideal points. IFPress, 8(2), 2, 3.<br />

Escofier, B., & Pagès, J. (2008). Analyses factorielles<br />

simples et multiples. 4 ème édition, Dunod, Paris.<br />

Faber, N.M., Mojet, J., & Poelman, A.A.M. (2003). Simple<br />

improvement of consume fit in external preference<br />

mapping. Food Quality and Preference, 14, 455‐<br />

461.<br />

Greenhoff, K., & MacFie, H.J.H. (1994). Preference<br />

Mapping in Practice. In MacFie, H.J.H., & Thomson,<br />

D.M.H. (Eds.). Measurement of food preferences.<br />

Glasgow: Blackie Academic & Professional, p137‐<br />

166.<br />

Husson, F., Lê, S., & Pagès, J. (2005). Confidence ellipse<br />

for the sensory profiles obtained <strong>by</strong> principal<br />

167


4.2. <strong>The</strong> <strong>Ideal</strong> Product used as a Reference<br />

component analysis. Food Quality and Preference,<br />

16, 245‐250.<br />

Husson, F., & Pagès, J. (2003). Nuage plan d’individus et<br />

variables supplémentaires. Revue de statistique<br />

appliquée, 51(4), 83‐93.<br />

Lê, S., Husson, F., & Pagès, J. (2006). Another look at<br />

sensory data: How to “have your salmon and eat it,<br />

too”. Food Quality and Preference, 17, 658‐668.<br />

Lengard, V., & Kermit, M. (2006). 3‐Way and 3‐block PLS<br />

regressions in consumer preference analysis. Food<br />

Quality and Preference, 17, 234‐242.<br />

MacFie, H.J., Bratchell, N., Greenhoff, K., & Vallis, L.V.<br />

(1989). Designs to balance the effect of order of<br />

presentation and first‐order carry‐over effects in<br />

hall tests. Journal of Sensory Studies, 4, 129‐148.<br />

Mao, M., & Danzart, M. (2008). Multi‐response<br />

optimisation strategies for targeting a profile of<br />

product attributes with an application on food<br />

data. Food Quality and Preference, 19, 162‐173.<br />

Schlich, P., & McEwan, J.A. (1992). Cartographie des<br />

préférences, un outil statistique pour l’industrie<br />

agro‐alimentaire. Sciences des Aliments, 12, 339‐<br />

355.<br />

Stone, H., Sidel, J., Oliver, S., Woosley, A., & Singleton,<br />

R.C. (1974). Sensory evaluation <strong>by</strong> quantitative<br />

descriptive analysis. Food Technology, 28, 24‐34.<br />

Van Kleef, E., Van Trijp, H.C.M., & Luning, P. (2006).<br />

Internal versus external preference analysis: An<br />

exploratory study on end‐user evaluation. Food<br />

Quality and Preference, 17, 387‐399.<br />

<strong>Worch</strong>, T. (2011). <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong> Method. In Current<br />

status and future directions for alternative<br />

descriptive sensory methods workshop. Oral<br />

presentation at the 9 th Pangborn Sensory Science<br />

Symposium, Toronto, Canada, September 2011.<br />

<strong>Worch</strong>, T., Lê, S., & Punter, P.H. (2010). How reliable are<br />

the consumers? Comparison of sensory profiles<br />

from consumers and experts. Food Quality and<br />

Preference, 21, 309‐318.<br />

<strong>Worch</strong>, T., Lê, S., Punter, P.H., & Pagès, J. (2011).<br />

Analysis of ideal data obtained <strong>by</strong> the <strong>Ideal</strong> <strong>Profile</strong><br />

Method to better understand consumers and their<br />

needs. Poster presentation at the 9 th Pangborn<br />

Sensory Science Symposium, Toronto, Canada,<br />

September 2011.<br />

<strong>Worch</strong>, T., Lê, S., Punter, P.H., & Pagès, J. (2012).<br />

Assessment of the consistency of ideal profiles<br />

according to non‐ideal data for IPM. Food Quality<br />

and Preference, 24, 99‐110.<br />

4.2.2. Complementary comparison between IdMap and PrefMapD<br />

In this section, the distinction between the individual zones related to the consumers’ acceptance/ideal for<br />

the two techniques is made. Let’s call “individual acceptance zone” the surface of the sensory space accepted<br />

<strong>by</strong> a consumer in PrefMapD and “individual ideal zone” the surface of the sensory space which contains the<br />

ideal product of a consumer in IdMap. At the panel level, the association of the different individual acceptance<br />

or ideal zones defines the “response surface”.<br />

4.2.2.1. Level of acceptance in the PrefMapD<br />

In the article presented §4.2.1, it has been shown that the PrefMapD solution returns an ideal product that<br />

would satisfy a larger proportion of consumers (91% in the perfume example, 71% in the croissant one)<br />

compared to IdMap (40% in the perfume example, 19% in the croissant one). This difference of proportions has<br />

been explained <strong>by</strong> the difference in the surface of the acceptance zone considered for each consumer: In the<br />

PrefMapD, each product on the map which is more liked than averaged (<strong>by</strong> default) <strong>by</strong> a given consumer is<br />

accepted while in the IdMap, only the ideal product is considered. By increasing the level of acceptance in the<br />

PrefMapD, one can expect more similar results between the two techniques. Indeed, in the PrefMapD, the<br />

higher the level of acceptance, the more the individual acceptance zones correspond to individual ideal zones.<br />

However, increasing the level of acceptance reduces the surface of the individual acceptance zone, which<br />

implies reducing the agreement between consumers (i.e. the proportions of consumers agreeing).<br />

168


4. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong>s as a Tool for Optimization<br />

In order to quantify the impact of the level of acceptance on the surface of the individual acceptance zone<br />

the surface (in percentage) of the product space which would be accepted <strong>by</strong> each consumer is calculated at<br />

different levels of acceptance. <strong>The</strong> levels of acceptance considered are expressed in number of standard<br />

deviations in the liking ratings. Here we use 0, 0.5, 1 and 1.5.<br />

<strong>The</strong> application of this methodology to the 24 projects shows a stability of the results at a given level of<br />

acceptance (called “seuil” in Figure 4.5). <strong>The</strong> surface of the individual acceptance zones are similarly distributed<br />

across projects. By construction, these surfaces decrease with the increase of the level of acceptance. This<br />

surface, which covers around 50% of the product space when the level of acceptance is set to 0, decreases to<br />

30% with a level of 0.5, 14% with a level of 1 and 6% with a level of 1.5.<br />

Figure 4.5: Distribution of the individual surfaces of response (in percentage of the total product space)<br />

in function of the level considered, for each project.<br />

<strong>The</strong> averaged surface of response obtained with the different levels of acceptance is given for each project<br />

Table 4.4.<br />

169


4.2. <strong>The</strong> <strong>Ideal</strong> Product used as a Reference<br />

Level=0 Level=0.5 Level=1 Level=1.5 Level=0 Level=0.5 Level=1 Level=1.5<br />

Applesauce 51,9 32 13 5,2 Licorice 50,9 32 12,8 5,4<br />

Beer 49,4 31 15,2 5,2 Milk drink 51,2 30,3 14,6 6<br />

Candy bar 50,6 30,4 14,3 5,1 Org. yoghurt 53,5 32,2 13,8 5,2<br />

Coffee 49,3 28,4 15 6,9 Perfume 52,4 32,3 15 4,8<br />

Cream yoghurt1 51 28,2 14,4 6,8 Rye bread 51,8 31,1 13 5,3<br />

Cream yoghurt2 49,4 29,9 14,5 6,6 Salad 51,4 30,7 14,5 5,4<br />

Croissants 50,7 31,4 13,7 5,7 Soup1 50,6 29,9 12,3 5,5<br />

Donuts1 54 31,2 14,6 5,3 Soup2 47,4 29,2 15 6,8<br />

Donuts2 52,3 29,8 14,6 6,3 Vanilla des. 48,9 27,9 14,3 7<br />

Flavour wat. 49,2 29,7 13,8 6,2 Water 50,1 27,1 14,3 6,8<br />

Ice cream 52,6 30,8 13,8 5,4 Yoghurt1 50,2 30,8 14,7 5,7<br />

Lemon wat. 49,4 27,7 14,4 6,8 Yoghurt2 48,3 29,7 14,8 6<br />

Table 4.4: Averaged surface of response obtained in function of the level considered, for each project.<br />

As in most cases, 50% of the product space would be accepted <strong>by</strong> each consumer, the assumption made in<br />

the article supposing that it is more a surface of “non‐rejection” than an “ideal” surface in the standard<br />

PrefMapD seems verified. Indeed, it is difficult to consider that half of the surface of the product space would<br />

correspond to a potential ideal product for the majority of consumers. However, as soon as the level of<br />

acceptance increases, the surfaces of the individual acceptance zone shrinks. <strong>The</strong>se individual surfaces<br />

correspond to maximum appreciation, which can be more interpreted as “ideal” products.<br />

By increasing the level of acceptance, the surface of the individual acceptance zones decreases. It also<br />

impacts the proportion of consumers agreeing with a common ideal. Indeed, <strong>by</strong> decreasing the individual<br />

acceptance zones, the odds to find a consensus between consumers decrease. In other words, the more you<br />

satisfy one particular consumer, the more that consumer will like the product, but the less the product will be<br />

accepted <strong>by</strong> the rest of the panel. Moreover, an artifact of using a high level of acceptance (which would give<br />

solutions closer to the “ideal”) is that no ideal product might be found for some consumers. This can either be<br />

due to the low estimation of the liking ratings (i.e. inferior to the level of acceptance), to the poor liking<br />

discrimination of the products or to the localization of the “ideal” product outside the product space.<br />

To evaluate the relationship between the level of acceptance and the maximum proportion of consumers,<br />

the maximum proportion of consumers sharing a common ideal is measured at different levels of acceptance<br />

(<strong>by</strong> going from 0 to 1.5 with a step of 0.1). <strong>The</strong> results obtained for the different projects are presented in Table<br />

4.5. As expected, the higher the level of acceptance, the smaller the maximum proportion. Although some<br />

patterns can be observed, the relationship between the maximum proportion of consumers and the level of<br />

acceptance cannot be generalized. Indeed, the proportion decreases quickly (from around 80% to 60%) with<br />

the increase of the level of acceptance (from 0 to 0.4). For a level higher than 0.4, the relationship seems then<br />

linear. However, this observation is not true for all projects, some of them showing different patterns.<br />

170


4. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong>s as a Tool for Optimization<br />

IdMap<br />

wIdMap<br />

PrefMap<br />

level=0<br />

PrefMap<br />

level=0.5<br />

PrefMap<br />

level=1<br />

PrefMap<br />

level=1.5<br />

IdMap wIdMap PrefMap<br />

level=0<br />

PrefMap<br />

level=0.5<br />

PrefMap<br />

level=1<br />

PrefMap<br />

level=1.5<br />

Applesauce 24,0 18,0 70,0 59,4 44,4 27,8<br />

Cream<br />

yoghurt2<br />

34,0 26,2 82,8 61,7 53,1 48,4<br />

Beer 23,0 27,4 71,4 57,1 41,7 35,7<br />

Ice<br />

cream<br />

29,0 32,0 85,7 59,5 52,4 42,9<br />

Croissants 19,0 16,1 70,9 54,3 43,0 34,4 Soup1 38,0 29,0 80,7 78,0 73,4 66,1<br />

Donuts1 21,0 14,7 84,1 50,8 45,2 40,5 Soup2 52,0 43,1 87,5 71,2 67,3 66,3<br />

Donuts2 17,0 13,9 85,0 54,5 44,9 39,5<br />

Flavour<br />

water<br />

22,0 16,5 73,5 55,4 49,4 44,6<br />

Licorice 24,0 20,2 67,5 50,0 50,0 47,5<br />

Lemon<br />

water<br />

32,0 24,2 72,0 52,0 50,0 47,0<br />

Coffee 23,0 30,3 70,1 55,8 53,2 50,6<br />

Candy<br />

bar<br />

38,0 46,6 71,6 50,6 44,4 37,0<br />

Salad 30,0 25,6 70,7 56,1 46,3 40,2<br />

Vanilla<br />

des.<br />

25,0 15,3 82,9 56,6 51,3 46,1<br />

Water 37,0 34,1 69,3 57,1 54,6 52,8<br />

Milk<br />

drink<br />

30,0 19,7 78,4 60,2 54,5 44,3<br />

Perfume 40,0 35,0 91,3 68,9 51,5 40,8 Yoghurt1 21,0 27,3 75,0 57,1 45,2 35,7<br />

Rye bread 23,0 18,3 67,5 54,8 50,3 42,0 Yoghurt2 33,0 29,1 72,6 51,3 47,9 44,4<br />

Cream<br />

Org.<br />

34,0 27,3 77,3 55,5 50,8 46,1<br />

29,0 25,8 92,9 64,6 52,0 33,9<br />

yoghurt1<br />

yoghurt<br />

Table 4.5: Maximum proportions of consumers sharing a common ideal obtained for IdMap, wIdMap<br />

and PrefMapD (at different level of acceptance).<br />

With high level of acceptance, the individual acceptance zones correspond more to “ideal” products. <strong>The</strong><br />

maximum proportions of consumers obtained at different level of acceptance with PrefMapD are compared to<br />

the maximum proportions obtained with IdMap and wIdMap. <strong>The</strong>se results are summarized in Figure 4.6. <strong>The</strong><br />

maximum proportions are always higher with PrefMapD than with IdMap or wIdMap, even when the level of<br />

acceptance is set to 1.5. PrefMapD seems more appropriate to find common ideal points between consumers.<br />

This might be due to the fact that the PrefMapD is limited to the sensory space while IdMap and wIdMap allow<br />

extending the product space in the case consumers have ideal products located outside the boundaries.<br />

Figure 4.6: Distribution of the maximum proportions of consumers<br />

obtained with the different techniques across the different projects.<br />

171


4.2. <strong>The</strong> <strong>Ideal</strong> Product used as a Reference<br />

4.2.2.2. Stability of the PrefMapD<br />

In the PrefMapD, a response surface is obtained at the panel level <strong>by</strong> summing up the individual<br />

acceptance zones (Mao, & Danzart, 2008). On this response surface, maxima are often interpreted as “ideal”<br />

products and their estimated profiles are used to optimize the tested products. However, it has been shown<br />

that the results of the PrefMapD (i.e. individual surfaces of response and maximum proportions) depend on the<br />

level of acceptance considered (Delarue, Danzart, & Sieffermann, 2010). In the previous section, we have<br />

studied the influence of the level of acceptance on the individual acceptance zone and on the maximum<br />

proportions. It remains to check the visual stability of the map when the level of acceptance increases.<br />

<strong>The</strong> two projects (perfume and croissant) presented in the paper are also used here for illustration.<br />

<strong>The</strong> results obtained in the article (see §4.2.1) for the perfume project showed that the best product<br />

estimated <strong>by</strong> the PrefMapD was located on the negative part of the first dimension of the sensory space. This<br />

solution was obtained with the standard level of acceptance corresponding to 0. Increasing the level of<br />

acceptance to 0.5 (Figure 4.7a) and 1 (Figure 4.7b) pushes the area of maximum consensus to the negative<br />

extremity of the first dimension. In other words, the best product defined with a level of acceptance of 0 is not<br />

the most appreciated product for most of the consumers but simply a product liked <strong>by</strong> a maximum of them.<br />

Although a product situated on the negative extremity of the first dimension might not be appreciated <strong>by</strong> all<br />

the consumers, it would correspond to the ideal product for this group of consumers.<br />

Figure 4.7: PrefMapD obtained with level of acceptance set to 0.5 (a, left) and 1 (b, right) for the perfume project.<br />

In this article, it has also been shown that for the croissant project, the best product estimated <strong>by</strong> the<br />

PrefMapD was situated on the right bottom corner of the sensory space, most probably outside the product<br />

space, when the acceptance level of was considered. In Figure 4.8 are presented the results of the PrefMapD<br />

with a level of acceptance of 0.5 (Figure 4.8a) and 1 (Figure 4.8b). Although one could expect to find a stable<br />

ideal zone on the bottom right corner, it is actually situated all around the sensory space (positive and negative<br />

extremities of both dimensions).In other words, the strongest structure in liking (i.e. products which would be<br />

highly appreciated <strong>by</strong> a certain proportion of consumers) is observed on all extremities of the space (except the<br />

left bottom corner).<br />

172


4. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong>s as a Tool for Optimization<br />

Figure 4.8: PrefMapD obtained with level of acceptance set to 0.5 (a, left) and 1 (b, right) for the croissant project.<br />

This result is actually generalized to most of the 24 projects: the increase of the level of acceptance<br />

highlights areas of higher appreciation on the extremities of the sensory dimensions. This might be an effect of<br />

the use of quadratic effects in the individual models.<br />

In this situation, the individual models used in the PrefMapD express for each consumer the liking ratings<br />

in function of the 5 following effects: Dim 1 , Dim 2 , Dim 2 1 , Dim 2 2 and the interaction Dim 1 :Dim 2 . <strong>The</strong> shape of the<br />

different individual response surface expresses different consumer behaviors (Danzart, in SSHA, 2009)). Some<br />

theoretical individual response surfaces are presented Figure 4.9. Among these consumers, some show a<br />

preference (a and f), some show a rejection (b and d) while some others are eclectic as they show similar liking<br />

patterns for products different from a sensory point of view (c and e).<br />

173


4.2. <strong>The</strong> <strong>Ideal</strong> Product used as a Reference<br />

Figure 4.9: Few examples of theoretical individual surfaces of response obtained with PrefMapD.<br />

A closer look at these individual response surfaces show that consumers expressing a rejection and eclectic<br />

consumers are associated to high estimations of the liking scores on the extremities of the sensory map. In<br />

those cases, the quadratic effects play an important role in the shape of the individual response surface. And<br />

those quadratic effects mathematically increase strongly the estimation of the liking scores on extreme values.<br />

Hence, increasing the level of acceptance tends to highlight particularly these consumers.<br />

In the case of the IdMap, this property of the map is not observed since it is not based on regression<br />

models. However, the difference of the nature of the map (due to the data involved for their construction) puts<br />

forward complementarities rather than competition between both maps.<br />

174


4.3. Optimization Procedure<br />

using <strong>Ideal</strong> <strong>Profile</strong>s


4. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong>s as a Tool for Optimization<br />

Now the ideal product, which should be used as a reference to match in the optimization procedure, is<br />

defined, guidance on improvement can be given to the product developers. In this section, different ways for<br />

improvement are considered. First, a review of the methods presented in the literature since the early 70’s is<br />

presented. <strong>The</strong>n, two new methodologies, which are product based and which take into consideration the link<br />

between the perception of an attribute and the appreciation of the products, are compared. <strong>The</strong>se<br />

methodologies are presented in the paper “Comparison of PLS dummy variables and Fishbone method to<br />

determine optimal product characteristics from ideal profiles” <strong>by</strong> <strong>Worch</strong>, Dooley, Meullenet, and Punter (2010)<br />

and published in Food Quality and Preference.<br />

4.3.1. Review of the existing methodologies<br />

<strong>The</strong> optimization procedure of the tested products is done <strong>by</strong> comparing the sensory profiles of the<br />

products to the sensory profiles of a referent ideal product. To do so, Szczesniak, Loew, and Skinner (1975)<br />

proposed two graphical comparisons of the tested products’ profiles with the ideal profile. In both cases, the<br />

attributes are ordered in the descending order of average intensity ratings. A connecting line is drawn between<br />

the individual characteristics resulting in a profile. In the first graph, the profiles for several products including<br />

the ideal (i.e. the reference to match) are represented together on the same chart allowing direct comparison.<br />

In the second graph, the ideal intensities define a straight line set at the ‘0’ rating, and the tested products are<br />

represented accordingly using their deviation from the ideal. <strong>The</strong> latter case is similar to a Just About Right<br />

situation. A similar procedure has been used <strong>by</strong> Hoggan (1975). <strong>The</strong> perceived intensity of the beer to optimize<br />

was compared to the perceived intensity of the competitor (and brand leader on the market) on a list of<br />

attributes. <strong>The</strong>se comparisons of the intensities were done graphically using bar charts. For each attribute, a<br />

tick mark corresponding to the ideal level provided <strong>by</strong> the panel of consumers was added on the graph, this<br />

ideal level being considered as the reference to match to improve the beer. In these two cases, the<br />

optimization is done <strong>by</strong> direct comparison.<br />

With the IPM, since the perceived and ideal intensity is measured on each attribute for each consumer, the<br />

deviation from ideal can be computed (Szczesniak, Loew, & Skinner, 1975, Cooper, Earle, & Triggs, 1989). <strong>The</strong><br />

information considered it then similar to a JAR scale. Hence, the methodology developed to analyze JAR data<br />

can be applied to these deviations. A large overview of the methodologies analyzing JAR data can be found in<br />

Meullenet, Xiong, and Findlay (2007).<br />

Instead of considering the raw ideal intensities or the deviation between perceived and ideal intensity,<br />

Cooper, Earle, and Triggs (1989) proposed to use the ratio between the perceived and ideal intensity. In this<br />

case, the deviation from the ideal is expressed in percentage of change to adopt. However, with this procedure,<br />

the authors point out two main issues:<br />

• depending on the ratio considered, the percentage of change can vary. Let’s consider an absolute<br />

sample score of 4 and an ideal score of 5. <strong>The</strong> ratio will either be 0.8 (corresponding to a<br />

percentage of change or 20%), or 1.25 (corresponding to a percentage of change of 25%) whether<br />

the ideal intensity is considered as the numerator or the denominator in the ratio;<br />

• for attributes with negative hedonic connotation (i.e. attributes for which the absence is the ideal<br />

level), it can be problematic since a score of 0 for the ideal intensity will return an infinite ratio of<br />

the product to the ideal score.<br />

177


4.3. Optimization Procedure using <strong>Ideal</strong> <strong>Profile</strong>s<br />

To avoid the first issues, the authors propose a log transformation of the ratio. In that case,<br />

log(Sensory/<strong>Ideal</strong>) becomes log(Sensory)‐log(<strong>Ideal</strong>) or more precisely log(Sensory)–a constant. And this formula<br />

is true whether the ratio is considering the <strong>Ideal</strong> intensity as numerator or denominator. For the second issue,<br />

the ideal scores of 0 are replaced <strong>by</strong> scores close to 0 (0.1 can be used in practice).<br />

Additionally to their graphical representation, Szczesniak, Loew, and Skinner (1975) proposed to compare<br />

the products with the ideal <strong>by</strong> submitting the data to factor analysis. In this case, the comparison is based on all<br />

attributes considered simultaneously. This methodology has also been considered <strong>by</strong> Cooper et al. (1989).<br />

In 1977, Moskowitz, Stanley, and Chandler proposed a methodology based on models called <strong>The</strong> Eclipse<br />

Method. It requires the experimenter to have a series of products for which the different formulations (or<br />

recipes) are known. Consumers are then asked to evaluate each product and to rate the perceived intensity on<br />

a list of attributes using the method of magnitude estimation (Moskowitz, & Sidel, 1971). For each attribute, a<br />

separate regression equation predicting the magnitude of that attribute based on the formulation (i.e. physical<br />

ingredients) of the products is estimated. Since the evaluation of the products is performed <strong>by</strong> consumers, the<br />

experimenter can also ask them to rate on the same scale the intensity they would like to have, for each<br />

attribute, which would correspond to the profile of their ideal product. Finally, the experimenter can turn<br />

around the regression equations defined previously and predict the formulation of a product that would come<br />

close to the ideal product.<br />

In most of these methodologies, the potential link between the perception of an attribute and the<br />

appreciation of the products is not taken into consideration. However, it seems important to consider it since<br />

optimizing products on attributes which are not driving liking is of minor interest. <strong>The</strong> two procedures<br />

presented in the next section take into consideration whether or not an attributes are drivers of liking and<br />

guide on improvement <strong>by</strong> suggesting which attributes should be changed in priority to have a bigger impact on<br />

liking.<br />

4.3.2. Proposition of a Product Based Optimization<br />

<strong>The</strong> two methodologies proposed here guide product improvement <strong>by</strong> using the ideal profiles obtained<br />

directly from consumers. <strong>The</strong>se methodologies are proposed <strong>by</strong> <strong>Worch</strong>, Dooley, Meullenet, and Punter (2010)<br />

and are published in Food Quality and Preference in an article entitled “Comparison of PLS dummy variable and<br />

Fishbone method to determine optimal product characteristics from ideal profiles”.<br />

178


4. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong>s as a Tool for Optimization<br />

Journal:<br />

Title:<br />

Food Quality and Preference<br />

Comparison of PLS dummy variables and Fishbone method to determine optimal product<br />

characteristics from ideal profiles.<br />

Authors: <strong>Worch</strong>, T., Dooley, L., Meullenet, J.F., & Punter, P.<br />

Abstract:<br />

Keywords:<br />

Reference:<br />

Sensory professionals mostly used trained or expert panels for diagnostic purposes and<br />

only use consumers for hedonic assessments. In market research, consumers are not only used<br />

for hedonic assessments, but also for product diagnostic purposes (as is the case with Just‐<br />

About‐Right procedure). In the <strong>Ideal</strong> <strong>Profile</strong> Method, consumers are also used for both tasks.<br />

<strong>The</strong>y rate the perceived and ideal intensities and the acceptance of a series of products. <strong>The</strong><br />

two information (product description and hedonic data) are then used for product<br />

improvement. In this paper, the results of two methods of analysis ‐ PLS on dummy variables<br />

and Fishbone method ‐ will be compared. <strong>The</strong> objectives of this study were 1) to compare PLS<br />

and Fishbone method to determine their similarity in predicting the impact of the attributes on<br />

overall liking, and 2) to determine if the methods would return similar or contrasting<br />

conclusions. This methodology has been applied to a study concerning twelve commercially<br />

available women's perfumes. Though the differences in model derivations caused some small<br />

dissimilarities, similar trends were found between products across methods for those<br />

perfumes far from the ideal. <strong>The</strong>re was agreement regarding which attributes are too strong or<br />

too weak, and the order of importance of these attributes for liking. Perfumes that were<br />

already near the consumer's ideal showed greater dissimilarity between the two methods.<br />

PLS dummy variables, Fishbone plots, <strong>Ideal</strong> profile, Just About Right, Consumer liking<br />

<strong>Worch</strong>, T., Dooley, L., Meullenet, J.F., & Punter, P. (2010). Comparison of PLS dummy variables<br />

and Fishbone method to determine optimal product characteristics from ideal profiles. Food<br />

Quality and Preference, 21, 1077‐1087.<br />

1. Introduction<br />

In the sensory world, it is common practice to use experts or trained panelists for the sensory description of products<br />

(i.e. Quantitative Descriptive Analysis or QDA®), and consumers for the hedonic evaluation. It is believed that consumers<br />

are not capable of accurate sensory characterization of products without training. In the literature, many warnings are<br />

given concerning the use of consumers for the sensory description of products:<br />

• “…as with any untrained panel, beyond the overall acceptance judgment there is no assurance that the responses<br />

are reliable or valid” (Stone & Sidel, 2004)<br />

• “…consumers can only tell you what they like or dislike” (Lawless & Heymann, 1999)<br />

However, QDA and associated methods, done with experts or trained panels, can be expensive and time consuming<br />

(both in terms of panelist training and testing time). More expeditious and still efficient methods with consumers (Healy &<br />

Miller, 1970; Abdi, Valentin, Chollet & Chrea, 2007; Gazano, Ballay, Eladan, & Sieffermann, 2005; Nestrud & Lawless, 2008)<br />

have been presented in recent years, including Flash <strong>Profile</strong> (Sieffermann, 2002), Napping® (Pagès, 2005) and Free Sorting<br />

Tasks.<br />

Husson, Le Dien & Pagès (2001) showed that consumers meet the requirements of discrimination, consensus and<br />

reproducibility, <strong>Worch</strong>, Lê & Punter (2009) found no significant differences between products profiled <strong>by</strong> trained or<br />

consumer panels, and Moskowitz (1996) showed that consumers can be used for the sensory description of sauces, and<br />

therefore “refutes the notion that consumers are incapable of validly rating the sensory aspects of products”. Hence, the<br />

use of consumers for profiling might be an alternative for experts or trained panelists.<br />

Still, many authors doubt if consumers possess the capability to profile products and suggest using consumers only for<br />

the evaluation of attributes which are easily detectable and differentiated (Meilgaard, Civille, & Carr, 2007; Stone & Sidel,<br />

2004).<br />

In order to put the best possible product on the market, it is essential to understand consumer product perception and<br />

preferences, and relate hedonic responses to sensory product specifications. Several methods have been developed<br />

recently to define and characterize a “consumer ideal product”. <strong>The</strong> general idea behind these methods is to extract liking<br />

information from consumers and link this information to the sensory characteristics of the products obtained from trained<br />

or expert panels. <strong>The</strong> characteristics of the ideal product are estimated through statistical methods. Among these methods<br />

are external preference mapping (Greenhoff & MacFie, 1994) and Unfolding (Coombs, 1976).<br />

179


4.3. Optimization Procedure using <strong>Ideal</strong> <strong>Profile</strong>s<br />

As the need for ideal product understanding becomes more important in the food industry, methods which directly<br />

measure ideals have been introduced (Issanchou, 2009, Meullenet, Xiong & Findlay, 2007). <strong>The</strong> Just About Right (JAR)<br />

method, in which consumers are asked to rate a product’s intensity relative to their ideal, uses an implicit ideal. In this case,<br />

consumers are asked to indicate for a number of attributes if the product they tasted is Just About Right, too little/much or<br />

far too little/much compared to their personal ideal product. When consumers can express the difference of the perceived<br />

intensity from an implicit ideal, it is assumed that they have a good representation and understanding of their personal<br />

ideal, and can rate it directly (<strong>Ideal</strong> <strong>Profile</strong> Method). In this method, consumers are asked to rate both the perceived and the<br />

ideal intensities for each attribute and each product. At the end of a session, each consumer, who tested P products, will<br />

yield P perceived and P ideal intensities for each attribute.<br />

Asking the ideal intensities for only one reference product or without a reference product is not recommended since<br />

ideals are influenced <strong>by</strong> the perceived intensities and we want the exact differences between perceived and ideal<br />

intensities for each consumer. Compared to the JAR scale, which only asks the deviations from ideal for each attribute and<br />

product combination, in the <strong>Ideal</strong> <strong>Profile</strong> method, both perceived and ideal intensities are asked directly (the JAR question<br />

‘is it just right, too much or too little’ is replaced <strong>by</strong> the question ‘how strong is it and what would be the ideal strength’).<br />

Disagreement exists in the sensory community as to whether or not consumers are capable of understanding and/or<br />

specifying their ideal. Some believe that consumers are unable to express their needs, are unaware of their needs or have a<br />

limited frame of reference (Stone & Sidel, 2004). Others are less strict and demonstrated limitations of the use of Just<br />

About Right, without completely rejecting it (Epler, Chambers & Kemp, 1998). Others believe that consumers know their<br />

likes and dislikes and can explain the reasons for their opinions (Moskowitz, Munoz, & Gacula, 2003). Most market<br />

researchers belong to this latter school of thought.<br />

Recently, Van Trijp, Punter, Mickartz & Kruithof (2007) compared three methods to obtain ideal profiles: JAR, the<br />

conventional method (combining consumer liking with expert profiles) and a variant (the <strong>Ideal</strong> <strong>Profile</strong> method presented in<br />

this paper) and found a high robustness of the ideals despite the methodological dissimilarities.<br />

In this study, the authors agree with the assumption that consumers are able to describe products and specify their<br />

ideal. <strong>The</strong>y compare two different methodologies that can be used to analyze JAR or <strong>Ideal</strong> <strong>Profile</strong> data, and which give<br />

guidance for product improvement, based on the deviations from the ideal levels and the relative importance of each<br />

attribute for liking. For the analysis of JAR data, PLS on dummy variables can be used (Xiong & Meullenet, 2006). For the<br />

analysis of <strong>Ideal</strong> <strong>Profile</strong> data, a method based on Regression on Principal Components can be used (the Fishbone method).<br />

2. Material and Methods<br />

2.1. Notation<br />

In this document, the following notation is used (bold type being used for vectors):<br />

: intensity perceived <strong>by</strong> the consumer j for the product p and the attribute a;<br />

. ; 1: : vector or intensities perceived <strong>by</strong> the consumer j for the P products and the attribute a;<br />

. : average over the index p; average intensity perceived <strong>by</strong> the consumer j on attribute a over the P products.<br />

: ideal intensity of the attribute a provided <strong>by</strong> the consumer j after testing the product p;<br />

. ; 1: : vector of ideal intensities of the attribute a provided <strong>by</strong> the consumer j for the P products;<br />

.: average over the index p; average ideal intensity of the attribute a provided <strong>by</strong> the consumer j over the P<br />

products.<br />

: overall liking ratings given <strong>by</strong> the consumer j for product p;<br />

. ; 1: : vector of liking ratings given <strong>by</strong> the J consumers on product p.<br />

.. ; 1:<br />

: vector of liking ratings given <strong>by</strong> the J consumers for the P products. In this case, l is appended<br />

1:<br />

vertically (JxP rows and 1 column).<br />

2.2. Materials<br />

<strong>The</strong> materials used in this study are the same as presented in <strong>Worch</strong> et al. (2009). Twelve commercially available<br />

luxury perfumes (see Table 1) were tested <strong>by</strong> 103 Dutch consumers (44 men and 59 women 48 between 18 and 35 years<br />

old, 55 between 45 and 60 years old) at OP&P Product Research (Utrecht, the Netherlands). <strong>The</strong> women were daily luxury<br />

perfume users, and the men had a girlfriend or wife who used perfume regularly. Additionally, the men had to name at<br />

least two luxurious women perfumes. This criterion was added so they were direct or indirect users of this type of product.<br />

180


4. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong>s as a Tool for Optimization<br />

Products<br />

Type<br />

Angel<br />

Eau de Parfum<br />

Cinema<br />

Eau de Parfum<br />

Pleasures<br />

Eau de Parfum<br />

Aromatics Elixir Eau de Parfum<br />

Lolita Lempicka Eau de Parfum<br />

Chanel N⁰5<br />

Eau de Parfum<br />

L’Instant<br />

Eau de Parfum<br />

J’Adore (EP)<br />

Eau de Parfum<br />

J’Adore (ET)<br />

Eau de Toilette<br />

Pure Poison<br />

Eau de Parfum<br />

Shalimar<br />

Eau de Toilette<br />

Coco Mademoiselle Eau de Parfum<br />

Table 1: List of products.<br />

Two products (Pure Poison and Shalimar) were replicated to test for panelist consistency (a total of 14 samples were<br />

tested). A balanced design and sequential monadic serving order was followed to account for order and carryover effects<br />

(MacFie, Bratchell, Greenhoff, & Vallis, 1989). <strong>The</strong> study was performed on two separate days, with seven products being<br />

tested each day. Perfumes were sprayed onto cotton pads, placed in lidded Styrofoam® cups and replaced hourly.<br />

<strong>The</strong> consumers rated both perceived and ideal intensities on 21 attributes: Odor intensity, Freshness, Jasmine, Rose,<br />

Camomille, Fresh lemon, Vanilla, Mandarin/Orange, Anise, Sweet fruit/Melon, Honey, Caramel, Spicy, Woody, Leather,<br />

Nutty/Almond, Musk, Animal, Earthy, Incense and Green. A 100mm unstructured line scale, with marks at 10% and 90% was<br />

used. After testing each product, the consumer rated the overall liking on a structured 9 point scale.<br />

2.3. Methods<br />

For the PLS on dummy variables and for the Fishbone method, the aim is to estimate, for each attribute, the possible<br />

gain in liking if that attribute was at its ideal level. Hence, we can define for each product:<br />

(1)<br />

Where<br />

is the potential loss in liking due to the deviations of the product tested from its ideal;<br />

is the liking of the ideal product (where liking is maximized);<br />

is the appreciation of the product tested <strong>by</strong> the different consumers.<br />

In the Equation 1, is the important parameter to minimize: it measures the difference between the actual<br />

liking and the liking of the ideal product.<br />

2.3.1. PLS on dummy variables<br />

In 2006, Xiong & Meullenet proposed the use of PLS on dummy variables to analyze JAR data. In the <strong>Ideal</strong> <strong>Profile</strong><br />

method, data can be transformed into JAR values <strong>by</strong> taking (for each consumer) the difference between perceived and ideal<br />

intensities for each product and each attribute ( ). PLS is applied on each product separately, which<br />

creates a product specific model, meaning that each product is given its own unique guidance on improvement. Since each<br />

product is optimized separately, the analysis takes only subject variability into consideration.<br />

Algorithmically, PLS on dummy variables is done in three steps. First, for a given product p, the original dataset is<br />

organized into dummy variables. To do so, the difference is calculated. Depending on its sign, the difference is assigned<br />

to the category too little (attribute ‐), or the category too much (attribute +). Hence, for each attribute, two columns (the so<br />

called dummy variables) with J rows (J being the number of consumers) are created, one taking the positive values of the<br />

difference, and one taking the negative values of the difference. <strong>The</strong> values from the other column are set to 0 (attribute –<br />

when the difference is positive, or attribute + when the difference is negative).<br />

Dummy variables have better prediction properties for the overall liking (Figure 1) than the original variables. <strong>The</strong><br />

construction of the dummy variables and the decision rules are presented in Table 2. Compared to binary dummy variables,<br />

which only take values of 0 and 1, the dummy variables used here take either the value of the difference , or 0.<br />

181


4.3. Optimization Procedure using <strong>Ideal</strong> <strong>Profile</strong>s<br />

Figure 1: Prediction of liking when using the original (left) or dummy (right) variables.<br />

Panelist Product Perc. Att <strong>Ideal</strong> Att Difference Attribute + Attribute ‐<br />

1 p 77.0 49.4 29.6 29.6 0<br />

2 p 43.3 36.4 6.9 6.9 0<br />

… …<br />

j p <br />

0<br />

0 0 0 0<br />

0 <br />

… …<br />

J p 35.4 57.0 ‐21.6 0 ‐21.6<br />

Table 2: Decision rule for the construction of the dummy variables, with (resp. ) the perceived (resp ideal) intensity<br />

rated <strong>by</strong> consumer j for the product p and attribute a.<br />

Second, a PLS regression explaining the overall liking . in function of the dummy variables is performed. A descending<br />

step <strong>by</strong> step selection of the model is done through jackknifing (Martens & Martens, 2000) until only significant dummy<br />

<br />

variables remain in the model. <strong>The</strong> weights and associated to the significant dummy variables, which have an<br />

<br />

impact on liking, are then extracted. For a given attribute a, the comparison of the two regression weights and <br />

<br />

helps determining on which region the attribute is more detrimental to overall liking. For instance, if the coefficient is<br />

<br />

significantly different from 0 while isn’t, the product considered is described as having too much of the attribute a. This<br />

explains why the liking is not optimal for this product.<br />

Third, the potential gain in liking (called “mean drop” in Xiong & Meullenet (2006)) associated with each dummy<br />

<br />

variable is calculated <strong>by</strong> multiplying the dummy variables <strong>by</strong> their associated weights and (Equation 2).<br />

gain in liking <br />

<br />

gain in liking <br />

β <br />

β <br />

<br />

dummyvariable <br />

dummyvariable <br />

Graphically, only the gain in liking associated to the significant dummy variables is shown.<br />

2.3.2. Fishbone method<br />

(2)<br />

Compared to the PLS on dummy variables, the Fishbone method (Punter, 2008; Punter & <strong>Worch</strong>, 2009) is not product<br />

specific. <strong>The</strong> impact of each attribute on overall liking is estimated <strong>by</strong> taking all the products simultaneously in the<br />

regression model. Hence, the variability involved in the analysis is both product and consumer related.<br />

Algorithmically, the Fishbone method is done in four steps. First, a Principal Component Analysis (PCA) ‐ run on the<br />

correlation matrix ‐ is performed on the product x subject x attribute matrix. In this case, one row is one product described<br />

<strong>by</strong> one subject (hence, we have PxJ rows, P and J being the number of products and subjects respectively).<br />

Second, the overall liking is regressed on the dimensions of the PCA (Equation 3). Backward deletion is performed until<br />

only significant dimensions are kept in the model.<br />

(3)<br />

Where<br />

is the liking of product p <strong>by</strong> consumer j<br />

is the weight of the dimension a on liking ( 0 for not significant dimensions)<br />

182


4. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong>s as a Tool for Optimization<br />

<strong>The</strong> weight of each attribute on overall liking is then estimated using Equation 4.<br />

∑ <br />

Where<br />

is the weight of the attribute a on liking;<br />

is the weight of the dimension i on liking;<br />

is the loading of the attribute a on dimension i.<br />

<br />

<br />

(4)<br />

Third, for each product p, the difference (noted ) between the averaged ideal . and the averaged perceived<br />

intensities . is calculated for each attribute a. This difference is made relative to the actual perceived intensity of the<br />

product. It is expressed in percentage of change that must be obtained to make the attribute ideal (Equation 5).<br />

100 . . / . (5)<br />

For each attribute, the relative difference is weighted in function of its potential impact on liking. To do so, the<br />

relative difference is multiplied <strong>by</strong> the attributes’ weight . We obtain the relative difference corrected <br />

(Equation 6).<br />

(6)<br />

For each product, the possible overall gain in liking is computed <strong>by</strong> subtracting the averaged overall liking of the actual<br />

product to the liking of the ideal product. By default, the liking of the ideal product is set as the maximum value of the liking<br />

scale used (9 in the perfume example). <strong>The</strong> difference obtained is made relative to the liking of the product tested and is<br />

expressed as percentage (Equation 7).<br />

100 9 <br />

./<br />

. (7)<br />

Finally, the potential gain in liking for each product and each attribute is calculated <strong>by</strong> matching the relative<br />

difference corrected with the overall gain in liking. For a given product p, the sum of the relative difference corrected over<br />

the A attributes is forced to be equal to the overall gain in liking. <strong>The</strong> scaling factor used is presented Equation 8 and its<br />

calculation is highlighted in the example presented below:<br />

With<br />

<br />

<br />

<br />

∑<br />

<br />

<br />

(8)<br />

Example: Let’s consider a product described on three attributes Att1, Att2 and Att3. On a 9 point hedonic scale, this<br />

product had a liking rating of 6. To increase from 6 to 9, liking can be increased <strong>by</strong> 50% (=100*((9 6)/6)). <strong>The</strong> relative<br />

difference corrected for the three attributes is presented in Table 3 (left).<br />

Relative difference<br />

corrected (%)<br />

Potential gain in<br />

liking (%)<br />

Att1 5 Att1 10<br />

Att2 8 Att2 16<br />

<br />

Att3 12 Att3 24<br />

Sum 25 Sum 50<br />

Table 3: Calculation of the potential gain in liking from the relative difference corrected.<br />

In order to match the overall gain in liking (50%) with the sum of the relative difference corrected (25%), we force the<br />

two percentages to be equal. Hence, a scaling factor equal to 2 (=50/25) is applied to the relative difference.<br />

For interpretation purposes, the effects of the attributes are considered independent. If the intensity of an attribute a<br />

for a product p is changed from its perceived level . to its ideal level . without changing the intensity of the other<br />

attributes, then liking would increase with %. But as the attributes are often highly correlated, the effects of the<br />

attributes are somehow linked. <strong>The</strong>refore, the conclusions drawn here should only be taken as guidance to improvement,<br />

and not as recipe.<br />

For each attribute and each product, the difference between ideal and perceived intensities (. . ) and the<br />

potential gain in liking are shown in a graph (as this graph looks like a fishbone, it has been named “Fishbone plot”).<br />

In the Fishbone plots, attributes are arranged in increasing order in function of the potential gain in liking (represented as<br />

histogram on the graphic). In order to simplify the graphic, only the attributes with a possible impact on liking of 2% or<br />

higher are shown. As a complement, the difference between ideal and perceived intensities is also shown on the graph<br />

(diamonds).<br />

183


4.3. Optimization Procedure using <strong>Ideal</strong> <strong>Profile</strong>s<br />

2.3.3. Comparison of the results of the PLS and the Fishbone methods<br />

In both methods, the main information extracted concerns the potential impact of each attribute on overall liking. This<br />

is shown as a potential gain in liking if that attribute was at its ideal level and is either expressed as potential gain (PLS) or as<br />

percentage ( in the Fishbone method). In PLS, these potential gains can be summed together over all attributes in<br />

order to estimate the potential liking of the ideal product. In the Fishbone method, the ideal liking rating is assumed to be 9<br />

on a 9 point scale, which is why it is expressed as a percentage.<br />

<strong>The</strong> correlation coefficient is then calculated between the vectors of potential gain in liking related to the different<br />

attributes for PLS and for the Fishbone method.<br />

<br />

Note that in PLS, each attribute is related to two coefficients and . As only one coefficient (noted ) per<br />

attribute is necessary, three different cases can be defined:<br />

• the two dummy variables are not significant: the variable is considered as not important and the coefficient<br />

is set to 0;<br />

• only one of the two dummy variables is significant: the variable is considered important and the coefficient<br />

<br />

takes the weight or associated to the significant dummy variable;<br />

• both dummy variables are significant: the variable is considered important (see Xiong & Meullenet (2006) for<br />

an example on how to treat this particular case). In the perfume dataset, we are not concerned with such a<br />

situation since none of the paired regression coefficients were significant at the same time.<br />

When an attribute is important, it implies that the intensities of at least one of the corresponding dummy variables<br />

deviate from zero and are not just about right. When an attribute is not important, it implies that either the corresponding<br />

pairs of dummy variables are zero or just about right, or that the attribute does not affect the overall liking.<br />

2.3.4. Validations of the results obtained with the two methods<br />

In order to check the validity of the results, the link between the current and the ideal products must be studied. This<br />

can be done <strong>by</strong> examining the position of the ideal products in the current product space. To do so, the current product<br />

space is created <strong>by</strong> applying PCA to the product x attribute matrix .. . , 1: & 1: . In this product space,<br />

the averaged ideal products .. ., 1: & 1: are projected as supplementary entities (Escofier & Pagès,<br />

2008). <strong>The</strong> attribute representation related to this product space provides an overview of the attributes to be<br />

increased/decreased in intensity to position the current product closer to its ideal. <strong>The</strong> conclusions drawn here are then<br />

compared to the raw values of the product and its ideal.<br />

When the relationship between both methods is weak, a decision must be made as to which method may be most<br />

appropriate.<br />

2.3.5. Measurement of the repeatability of the methods (duplicated products)<br />

Another way to validate the two methods is to assess the validity of the conclusions they draw. With replicated<br />

products, one can compare the conclusions from one product with its replicate. <strong>The</strong> two conclusions should converge and<br />

return similar recommendations.<br />

As previously stated, the correlation coefficient is measured between the vector of potential gain related to the A<br />

attributes for a product and its replicate, for each method.<br />

3. Results and discussion<br />

Before applying the methodology described previously to the perfume dataset, the quality of the data must be<br />

checked. <strong>The</strong> methodology used here to validate the data is the one proposed <strong>by</strong> Van Trijp et al. (2007). It consists of (1)<br />

checking that the products are different in terms of their attribute levels and overall liking and (2) ensuring the reliability of<br />

ideal levels across the products. A one way analysis of variance measuring the product effect on each variable (perceived<br />

intensity, ideal intensity and overall liking) can be performed. <strong>The</strong> first point is validated if the product effect is significant<br />

for all the variables involved (perceived intensity and overall liking). <strong>The</strong> second point is validated if the product effect is not<br />

significant for the variables involved (ideal intensity). <strong>The</strong> results (Table 4) indicate that the product effect is significant for<br />

all the intensity attributes and the overall liking at 5%, except for jasmine (p value=0.138), camomille (p‐value=0.838) and<br />

anis (p‐value=0.264). Concerning the ideal attributes, the product effect is never significant at 5%, except for the ideal<br />

freshness (p‐value=0.010).<br />

184


4. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong>s as a Tool for Optimization<br />

Perceived<br />

intensity<br />

<strong>Ideal</strong><br />

intensity<br />

Perceived<br />

intensity<br />

<strong>Ideal</strong><br />

intensity<br />

Intensity 0.000 0.616 Caramel 0.000 0.558<br />

Freshness 0.000 0.010 Spicy 0.000 0.974<br />

Jasmine 0.138 0.098 Woody 0.000 0.074<br />

Rose 0.001 0.250 Leather 0.000 0.159<br />

Chamomile 0.838 0.994 Nutty 0.000 0.557<br />

Fresh lemon 0.000 0.448 Musk 0.000 0.835<br />

Vanilla 0.000 0.061 Animal 0.000 0.983<br />

Citrus 0.012 0.999 Earthy 0.000 0.645<br />

Anis 0.264 0.997 Incense 0.000 0.819<br />

Sweet fruit 0.000 0.639 Green 0.000 0.932<br />

Honey 0.000 0.988<br />

Table 4: p‐values related to the product effect in the one‐way ANOVA used for the validation of the <strong>Ideal</strong> <strong>Profile</strong> data.<br />

3.1. Results<br />

Table 5 shows the correlation coefficients measured for each product between the gain in liking obtained from the<br />

Fishbone and PLS on dummy variables method. It ranges from 0.60 (Cinema, Lolita Lempicka and Shalimar) showing a<br />

strong linear link between the results from both methods, to 0.33 (J’Adore (EP)), indicating no linear link between the<br />

results from both methods. <strong>The</strong> average correlation coefficient is 0.30.<br />

Product<br />

R<br />

Angel 0.52<br />

Aromatics Elixir 0.35<br />

Chanel N⁰5 0.53<br />

Cinema 0.60<br />

Coco Mademoiselle 0.30<br />

J’Adore (EP) ‐0.33<br />

J’Adore (ET) 0.42<br />

L’Instant<br />

Not available<br />

Lolita Lempicka 0.60<br />

Pleasures 0.17<br />

Pure Poison ‐0.21<br />

Pure Poison 2 0.39<br />

Shalimar 0.60<br />

Shalimar 2 0.47<br />

Table 5: Correlation coefficient measured between the potential gain in liking for each attribute obtained from the two<br />

methods. For L’Instant, no model can be found in the PLS on dummy variables.<br />

3.1.1. Case of a product showing agreement between both methods: Angel<br />

Figure 2a and 2b show the results for Angel from PLS on dummy variables and from the Fishbone method, respectively.<br />

Figure 2: PLS on dummy variables (left, a) and Fishbone plots (right, b) results for Angel.<br />

185


4.3. Optimization Procedure using <strong>Ideal</strong> <strong>Profile</strong>s<br />

In Figure 2a, for all attributes except camomille, one dummy variable is significant, meaning that it is not at its just<br />

about right level. <strong>The</strong> most important attributes to modify (i.e. those that would increase liking the most) are freshness,<br />

earthy, odor intensity, green, woody and fresh lemon (the attributes are ordered in function of their increasing impact on<br />

liking). Moreover, the sum of the potential gain in liking shows that if all attributes were at their ideal levels, overall liking<br />

for Angel would increase from 4.5 to 6.0.<br />

Figure 2b is a bit stricter, as only 17 out of 21 attributes were selected. <strong>The</strong> most important attributes from the<br />

Fishbone method are fresh lemon, green, freshness, earthy and jasmine. Aside from providing the potential increase in<br />

liking, it also states how much each attribute should be modified to attain the ideal level (represented in the graphical<br />

display as “diamonds”). For some attributes, such as odor intensity, a large change in terms of intensity is necessary (around<br />

12 points in score), but this does not necessarily induce a big gain in overall liking (only around 4% gain). For other<br />

attributes such as jasmine, a smaller change (around 5 points in score) will generate more gain in liking (around 8%).<br />

In this case, similar attributes have the highest impact on overall liking. <strong>The</strong> only exception concerns odor intensity<br />

which seems to be one of the most important attributes in PLS, and one of the less important (but still relevant) attributes<br />

in the Fishbone method.<br />

3.1.2. Case of a product showing disagreement between both methods: J’Adore (EP)<br />

Figure 3 (a and b) shows the results for J’Adore (EP) from the PLS on dummy variables and from the Fishbone methods,<br />

respectively.<br />

Figure 3: PLS on dummy variables (left, a) and Fishbone plots (right, b) results for J’Adore (EP).<br />

In PLS on dummy variables (Figure 3a), only 9 out of 21 attributes show an impact on the overall liking. Among these 9<br />

attributes are fresh lemon, odor intensity, honey and freshness. <strong>The</strong> sum of the potential gain in liking shows that changing<br />

the attributes to their ideal level would only increase the overall liking from 6.6 to 7.3.<br />

<strong>The</strong> Fishbone method (Figure 3b) also shows that 9 out of 21 attributes affect the overall liking, including spicy, green,<br />

animal, musk, nutty, anise, camomille, rose and jasmine. <strong>The</strong>se attributes all deviate from the ideal level <strong>by</strong> having too little<br />

in the product (in the graphic, the diamonds all point to the positive side, indicating that the differences . . are all<br />

positive).<br />

In this case, only four attributes are similar between the two methods (honey, nutty, rose and anise). <strong>The</strong> conclusions<br />

drawn from these data would be different depending of which method was used.<br />

3.1.3. Comparison of the PLS and Fishbone results<br />

For Angel, the correlation coefficient between the estimated potential gain in liking for each attribute from both<br />

methods is relatively high (0.52, see Figure 4). As most of the attributes are close to the first bisectrix, we can conclude that<br />

they agree on the estimation of the potential gain in liking calculated for each attribute. <strong>The</strong> only minor disagreement<br />

concerns the attributes incense (more important in PLS) and fresh lemon (more important in the Fishbone plots).<br />

186


4. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong>s as a Tool for Optimization<br />

Figure 4: Relationship between the potential improvements in liking <strong>by</strong> attribute suggested <strong>by</strong> the two methods for Angel.<br />

For J’Adore (EP), there is no similarity between the two methods, as the correlation coefficient between the potential<br />

gain in liking for each attribute is ‐0.33 (see Figure 5). Indeed, the two methods point out different attributes. In PLS,<br />

intensity, fresh lemon, honey, freshness, nutty, citrus and caramel are the most important attributes to change, while spicy,<br />

green, animal, vanilla and woody are the most important for the Fishbone method. <strong>The</strong> only common attributes are honey,<br />

nutty, rose etc. More generally, for Angel, Chanel N°5, Cinema, Lolita Lempicka and Shalimar, there is a link between the<br />

results from both methods (r>0.5), while for J’Adore (EP) and Pure Poison, the methods seem to present different<br />

conclusions (r


4.3. Optimization Procedure using <strong>Ideal</strong> <strong>Profile</strong>s<br />

fresh and flower notes (J’Adore (EP) and (ET) and Pleasures) to the perfumes with oriental notes (the two replicates of<br />

Shalimar and Angel); the second dimension opposes the perfumes with vanilla, honey and caramel notes (Angel, Lolita<br />

Lempicka) to the perfume with spicy and intense notes (Aromatics Elixir).<br />

Figure 6: Product space obtained <strong>by</strong> PCA<br />

with projection as illustrative of the ideal products (points with a label started with ID)<br />

Figure 7: Variable representation associated to the product space obtained <strong>by</strong> PCA.<br />

<strong>The</strong> projection of the ideal perfumes in this product space illustrates that the ideals are located near J’Adore (EP),<br />

Cinema and L’Instant. It appears that the ideal products have fresh, sweet fruit and citrus notes, with some vanilla and<br />

honey odor. With respect to the correlation between attributes, this also corresponds to low ratings in the odor intensity<br />

and spicy notes.<br />

<strong>The</strong> direct comparison of the profiles for a product and its ideal is possible through the use of spider plots. To bring<br />

Angel closer to its ideal (Figure 8), fruit and flower notes (sweet fruit, fresh lemon, rose, green and freshness) should be<br />

188


4. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong>s as a Tool for Optimization<br />

increased and oriental notes (incense, earthy, animal, spicy, leather, musk, etc.) and the odor intensity should be decreased.<br />

<strong>The</strong>se conclusions correspond to those stated in §3.1.1.<br />

Figure 8: Comparison of the perceived and ideal profiles for Angel.<br />

<strong>The</strong> comparison of the perceived and ideal profiles for J’Adore (EP) (Figure 9) shows that the current product is already<br />

close to its ideal, the only difference being the vanilla, nutty and spicy notes (needs more) and the odor intensity (needs<br />

less). In §3.1.2, we have shown that the conclusions drawn from the two methods disagree, the only agreement being on<br />

honey, nutty, citrus and rose. This disagreement is not important, since both conclusions are realistic. Indeed, as the<br />

attributes are highly correlated (Figure 7), decreasing the perception of freshness (defined as important in the PLS) is<br />

equivalent to increasing the perception of spicy (defined as important in the Fishbone).<br />

Figure 9: Comparison of the perceived and ideal profiles for J’Adore (EP).<br />

189


4.3. Optimization Procedure using <strong>Ideal</strong> <strong>Profile</strong>s<br />

One hypothesis to explain the disagreement between the two methods is due to the similarity between the current<br />

product and its ideal. When a product is close to its ideal, it is more difficult to create a clear hierarchy in terms of<br />

importance of the different attributes on liking, as they all might have the same impact. In this case, it is more difficult to<br />

define a model explaining the liking. For instance, for J’Adore (EP), the difference between the perceived and the ideal<br />

intensities is almost constant among the attributes (around 2 points in intensity), which makes the hierarchy difficult to<br />

create. As for Angel, the difference between the perceived and the ideal intensities is larger (and more heterogeneous), the<br />

hierarchy is easier to create and the model is easier to define (which leads to a better agreement between methods).<br />

Moreover, the calculation of the correlation coefficient doesn’t take into account the link existing between attributes.<br />

In PLS, the closeness between perceived and ideal profiles can lead to a particular case where no model is found, as no<br />

dummy variables are significant (as is the case for L’Instant). As all products are used simultaneously in the model, this is<br />

not observed with the Fishbone method.<br />

3.1.5. Reproducibility of the results<br />

In this study, two products (Pure Poison and Shalimar) were replicated. This enables us to measure the consistency of<br />

each method <strong>by</strong> comparing the results from the two replicates together.<br />

3.1.5.1. Case of Shalimar<br />

Figure 10a and 10b shows that for Shalimar and its replicate, both methods are reproducible. On each Figure, all<br />

attributes are close to the first bisectrix, meaning that from one replicate to another, the two methods give the same<br />

importance to the attributes (on the Fishbone method, only freshness and fresh lemon are slightly shifted showing that<br />

these attributes have a slightly bigger impact on liking for the first replicate than for the second). <strong>The</strong> correlation coefficient<br />

between the results obtained with the two replicates is 0.93 for the PLS on dummy variables (Figure 10a) and 0.86 for the<br />

Fishbone method (Figure 10b). Overall, the results are consistent for the replicates.<br />

Moreover, the same attributes (freshness, earthy, fresh lemon and green) are important in both methods, the only<br />

difference being that for the Fishbone method, sweet fruit and citrus appear to be important while for the PLS it is not the<br />

case. With respect to the product space (Figure 6), Shalimar is far from its ideal. <strong>The</strong>se results appear to confirm the<br />

statement made in §3.1.4.<br />

Figure 10: Reproducibility of the results obtained with PLS (left, a) and Fishbone (right, b) for Shalimar.<br />

3.1.5.2. Case of Pure Poison<br />

In Figure 11a and 11b, for Pure Poison, the results are less reproducible than for Shalimar. <strong>The</strong> PLS on dummy variables<br />

(Figure 11a) indicates that each replicate is only defined <strong>by</strong> a few drivers of liking and from one replicate to another, the<br />

drivers of liking differ. For the first replicate, odor intensity is the main driver of liking while for the second replicate, it’s<br />

freshness, green and musk (odor intensity no longer influences liking). A correlation coefficient of 0.12 is measured between<br />

both replicates. Still, the variable representation (Figure 7) shows similar patterns as the attributes highlighted for the two<br />

replicates are highly correlated. Hence, the conclusions are not in complete disagreement.<br />

For the Fishbone method (Figure 11b), the results are more consistent. <strong>The</strong> correlation coefficient is 0.78. Green,<br />

jasmine, sweet fruit, earthy and freshness seem to be the most important attributes in both cases.<br />

190


4. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong>s as a Tool for Optimization<br />

Figure 11: Reproducibility of the results obtained with PLS (left, a) and Fishbone (right, b) for Pure Poison.<br />

With respect to the product space (Figure 6), it appears that Pure Poison is close to its ideal. As for J’Adore (EP)<br />

(§3.1.2), this closeness makes it difficult to define a model with the PLS on dummy variables method. Hence, the results are<br />

different from one replicate to the other (as only small changes are necessary to make Pure Poison ideal). Concerning the<br />

Fishbone method, the models defined for the two replicates are more similar than with the PLS on dummy variables, and<br />

the conclusions are similar. This is probably due to the way the model is created. In the Fishbone method, all products are<br />

considered simultaneously while for PLS, it is product specific. In this manner, the Fishbone method is more “stable”, but<br />

the model associated to this method over fits the data. Indeed, in the Fishbone method, the model defined might<br />

overestimate the impact of some attribute on overall liking (in this case, several attributes seem to improve a product that<br />

is already close to ideal).<br />

3.2. Discussion and synthesis<br />

Globally, the results are consistent from one analysis to another, especially when the products tested are far from the<br />

ideal. When the products are already close to the ideal, the definition of a model is not always possible with the PLS on<br />

dummy variables (i.e. no significant dummy variables can be found) while the Fishbone method tends to over‐estimate the<br />

importance of some attributes on overall liking. In that case, both methods will show disagreement. Indeed, the correlation<br />

coefficient measured between the results obtained from the two methods is usually low. But it has to be said that the<br />

correlation coefficient doesn’t take into account the link existing between the attributes.<br />

<strong>The</strong> advantages and disadvantages of both methods are summarized Table 6.<br />

Advantages<br />

Disadvantages<br />

When should we<br />

use it?<br />

PLS dummy variables<br />

<strong>The</strong> model is product‐related, and product‐specific<br />

improvements are made.<br />

<strong>The</strong> model estimates attribute weights separately for<br />

each product.<br />

Less idea about what is generally important for a set<br />

of products.<br />

Difficulties to find model when products are close to<br />

the ideal.<br />

Fishbone method<br />

<strong>The</strong> model is general for a set of product.<br />

<strong>The</strong> general idea for improvement across all products in the<br />

product set; product adjustments are made based on a<br />

global idea.<br />

<strong>The</strong> attributes weights are fixed for all products, although<br />

they might change from one product to another.<br />

It can over‐estimate the impact of some attributes on<br />

overall liking when the products are close to ideal.<br />

To define the drivers of liking for one particular To define drivers of liking for a set of products.<br />

product.<br />

Table 6: Advantages and disadvantages of the two analyses.<br />

For further analysis, it may be interesting to compare PLS and Fishbone methods <strong>by</strong> making both methods product<br />

specific. This would avoid the over estimation of the impact of some attributes on overall liking for the Fishbone, and would<br />

provide a more fair comparison when the products are close to ideal.<br />

Finally, in this example, we didn’t check for clusters of consumers with respect to their liking. As the ideal profiles and<br />

the overall liking are strongly linked, defining clusters might enrich the analysis, as we could give different guidance on<br />

improvement depending on the final target consumers.<br />

191


4.3. Optimization Procedure using <strong>Ideal</strong> <strong>Profile</strong>s<br />

Acknowledgement<br />

<strong>The</strong> authors would like to thank the reviewers for their interesting and valuable comments and suggestions.<br />

References<br />

Abdi, H., Valentin, D., Chollet, S., & Chrea, C. (2007).<br />

Analyzing assessors and products in sorting tasks:<br />

DISTATIS, theory and applications. Food Quality<br />

and Preference, 18, 1‐16.<br />

Coombs, C.H. (1976). A theory of data. Wiley & Sons Inc.<br />

New York.<br />

Escofier, B., & Pagès, J. (2008). Analyses factorielles<br />

simples et multiples: Objectifs, méthodes et<br />

interprétations. 4ème éd., Paris: Dunod.<br />

Epler, S., Chambers IV, E., & Kemp, K. E. (1998). Hedonic<br />

scales are a better predictor than Just About Right<br />

scales of optimal sweetness in lemonade. Journal<br />

of Sensory Studies, 13, 191‐197.<br />

Gazano, G., Ballay, S., Eladan, N., & Sieffermann, J.M.<br />

(2005). Flash profile and flagrance research: Using<br />

the words of the naïve consumers to better grasp<br />

the perfume’s universe. In ESOMAR fragrance<br />

research conference, 15 17 May 2005, New York,<br />

NY.<br />

Greenhoff, K., & MacFie, H.J.H. (1994). Preference<br />

Mapping in Practice. In H.J.H. MacFie & D.M.H.<br />

Thomson (Eds.), Measurement of food preferences<br />

(p. 137‐166), Glasgow: Blackie Academic &<br />

Professional.<br />

Healy, A., & Miller, G.A. (1970). <strong>The</strong> verb as the main<br />

determinant of the sentence meaning.<br />

Psychometric Science, 20, 372.<br />

Husson, F., Le Dien, S., & Pagès, J. (2001). Which value<br />

can be granted to sensory profiles given <strong>by</strong><br />

consumers? Methodology and results. Food<br />

Quality and Preference, 12, 291‐296.<br />

Issanchou, S. (2009). Détermination directe d’un idéal<br />

sensorial. Evaluation sensorielle. (3ème édition,<br />

p225‐234) Lavoisier: Manuel méthodologique.<br />

Lawless, H.T. & Heymann, H. (1999). Sensory evaluation<br />

of food: Principles and practices. New York: Kluwer.<br />

MacFie, H., Bratchell, N., Greenhoff, K., & Vallis, L.V.<br />

(1989). Designs to balance the effect of order of<br />

presentation and first order carry over effects in<br />

hall tests. Journal of Sensory Studies, 4, 129‐148.<br />

Martens, H., & Martens, M. (2000). Modified Jack knife<br />

estimation of parameter uncertainty in bilinear<br />

modeling <strong>by</strong> partial least squares regression<br />

(PLSR). Food Quality and Preference, 11, 5‐16.<br />

Meilgaard, M.C., Civille, G.V., & Carr, B.T. (2007). Sensory<br />

Evaluation Techniques. (4th edition). Boca Raton,<br />

FL: CRC Press.<br />

Meullenet, J.F., Xiong, R., & Findlay, C.J. (2007). Analysis<br />

of Just About Right Data, in Multivariate and<br />

Probabilistic Analyses of Sensory Science Problem.<br />

(pp207‐235) Blackwell Publishing, IFT Press.<br />

Moskowitz, H.R. (1996). Experts versus consumers: A<br />

comparison. Journal of Sensory Studies, 11, 19‐37.<br />

Moskowitz, H.R., Munoz, A.M., & Gacula, M.C. (2003).<br />

Descriptive panels/experts versus consumers. In<br />

Viewpoints and Controversies in Sensory Science.<br />

Trumbull, CT: Food & Nutrition Press, Inc.<br />

Nestrud, M.A., & Lawless, H.T. (2008). Perceptual<br />

mapping of citrus juices using projective mapping<br />

and profiling data from culinary professionals and<br />

consumers. Food Quality and Preference, 19, 431‐<br />

438.<br />

Pagès, J. (2005). Collection and analysis of perceived<br />

product inter distances using multiple factor<br />

analysis: application to the study of 10 white wines<br />

from the Loire Valley. Food Quality and Preference,<br />

12, 297‐309.<br />

Punter, P.H. (2008). Bridging the Gap between R&D and<br />

Marketing. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong> Method. Presented at<br />

the Society of Sensory Professionals meeting,<br />

Cincinnati, Ohio, USA.<br />

Punter, P.H., & <strong>Worch</strong>, T. (2009). <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong><br />

Method: combining classical profiling with JAR<br />

methodology. In SPISE 2009 Proceeding: Food<br />

consumer insights in Asia, Ho Chi Minh City,<br />

Vietnam.<br />

Sieffermann, J.M. (2002). Flash profiling. A new method<br />

of sensory descriptive analysis. In AIFST 35th<br />

convention, Sidney, Australia.<br />

Stone, H., & Sidel, J.L. (2004). Sensory Evaluation<br />

Practices. (3rd edition) London, UK: Elsevier.<br />

Van Trijp, H.C., Punter, P.H., Mickartz, F., & Kruithof, L.<br />

(2007). <strong>The</strong> quest for the ideal product: Comparing<br />

different methods and approaches. Food Quality<br />

and Preference, 18, 729‐740.<br />

192


4. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong>s as a Tool for Optimization<br />

<strong>Worch</strong>, T., Lê, S., & Punter, P. (2009). How reliable are<br />

consumers? Comparison of sensory profiles from<br />

consumers and experts. Food Quality and<br />

Preference, 21, 309‐318.<br />

Xiong, R., & Meullenet, J.F. (2006). A PLS dummy variable<br />

approach to assess the impact of jar attributes on<br />

liking. Food Quality and Preference, 17, 188‐198.<br />

Through this paper, methodologies which can guide on product improvement were presented. In this case,<br />

PLS on dummy variable is product specific while the Fishbone method defines drivers of liking for the entire set<br />

of products, and then optimizes each product separately.<br />

It has to be said that in this example, the solution of improving Angel <strong>by</strong> making it closer to J’Adore is not<br />

the purpose since the products have their own identities. In some other cases, improving a less liked product<br />

can be done <strong>by</strong> making it closer to the most appreciated one.<br />

As a last remark, it has to be said that in this example, we have shown that when the products are close to<br />

their ideal, it seems that the two methods differ in their guidance on improvements. This is not completely<br />

true. Indeed, when different attributes are proposed <strong>by</strong> the two methods, these attributes are often highly<br />

negatively correlated. Hence modifying (<strong>by</strong> increasing) the one proposed <strong>by</strong> one method is often similar to<br />

modify (<strong>by</strong> decreasing) the one proposed <strong>by</strong> the second method. <strong>The</strong> application of these two methodologies<br />

to the 24 projects confirms it.<br />

193


5. General Conclusions:<br />

Validation of the IPA


5. General Conclusions<br />

<strong>The</strong> methodology of the IPA presented in the previous parts (consistency of the ideal data in §3 and the<br />

optimization procedure in §4) gives insights on how to analyze ideal data. However, at this moment, we cannot<br />

conclude concerning the validity of such procedure of analysis. Indeed, no information has been given<br />

concerning the eventual improvement of the products according to the advice on improvement proposed. <strong>The</strong><br />

procedure of the IPA that we proposed can only be validated with the formulation of a new product based on<br />

consistent ideal profiles from consumers, which would actually be more appreciated.<br />

To conclude our study, we present a detailed case study in which the knowledge of the products allow us<br />

formulating an “ideal product” <strong>by</strong> following the methodology presented in the chapters 3 and 4. This study has<br />

been done with the help of Adeline Gruel and Amandine Crine, students in Agrocampus Ouest, Rennes, in a<br />

master of applied mathematics.<br />

5.1. Description of the study<br />

5.1.1. <strong>The</strong> products<br />

During a preliminary study, 18 skin creams have been created according to an experimental design<br />

involving 4 factors: (1) the quantity of MF coemulser (ranging from 0.5% to 10%), (2) the quantity of VE<br />

coemulser (ranging from 0.5% to 10%), (3) the quantity of vegetal oil (ranging from 10% to 30%) and (4) the<br />

type of vegetal oil (sesame or macadamia). <strong>The</strong>se creams were created in such a way we could better<br />

understand what we could create, <strong>by</strong> still having a large and realistic product set.<br />

In a second step, 8 skin creams have been selected from these 18 in order to test the products according to<br />

a complete design. Each consumer’s arm was divided into 4 areas where to apply the cream. Hence, each<br />

consumer can provide the ideal profiles of each of the 8 creams, 4 creams being tested on each arm. This<br />

selection of the 8 out of 18 products has been done according to an annex study (not presented here) which<br />

aimed at creating the product space of the 18 skin creams. This product space was obtained according to the<br />

Napping® method. From this space, we selected 8 skin creams <strong>by</strong> taking care of maintaining both a large<br />

variability between products within the product space and keeping an optimal design between factors within<br />

the 8 remaining products selected.<br />

5.1.2. <strong>The</strong> consumers<br />

<strong>The</strong> 8 skin creams were applied <strong>by</strong> 72 women aged between 18 and 52 years old. <strong>The</strong>se women were<br />

recruited among the students and teaching staff of Agrocampus Ouest, Rennes, France.<br />

5.1.3. Method<br />

By following the <strong>Ideal</strong> <strong>Profile</strong> Method, the consumers rated both the perceived and ideal intensity of the 8<br />

selected creams according to a list of 13 attributes. This list is given Table 5.1. Additionally, 4 acceptance<br />

questions related to visual, texture before and after application and overall liking were asked.<br />

Visuel Texture pendant application Sensation après application<br />

Compact Onctueux Effet filmogène<br />

Aspect gras Etalement Doux<br />

Jaune Texture grasse Frais<br />

Brillant Epais Sensation de gras<br />

Pénétrant<br />

Table 5.1: List of the 13 attributes.<br />

<strong>The</strong> 8 products were presented to the consumers in a monadic sequence according to a complete design.<br />

197


Validation of the Methodology<br />

5.1.4. Preliminary study of the sensory space of the creams<br />

Before studying the ideal profiles and the relationship they have with the sensory and hedonic descriptions<br />

of the products, let’s first take a look at the sensory space of the products provided <strong>by</strong> the consumers. This<br />

product space of the 8 skin creams is obtained <strong>by</strong> PCA performed on the averaged sensory profiles of the<br />

products (table with 8 rows and 13 columns, each row corresponding to one cream and each column<br />

corresponding to one sensory attribute). This product space as well as the corresponding correlation circle are<br />

given in Figure 5.1a and Figure 5.1b.<br />

In this space, the first dimension of the PCA explains around 65% of the total variance. It opposes the<br />

creams 1 and 3 (aspect and texture gras, compact, épais and jaune) to the cream 8 (frais, étalement and<br />

brillant). This first dimension can be interpreted as a dimension of texture opposing the products which are<br />

rather fatty to the products easily applicable on the skin. <strong>The</strong> second dimension corresponds to the particular<br />

case of the attributes pénétrant, doux, effet de filmographie and sensation de gras. This dimension opposes at<br />

some extends the products 8 and 13. <strong>The</strong> products being mainly projected along the first dimensions, we can<br />

conclude that the sensory space is one‐dimensional.<br />

Figure 5.1: Sensory space of the skin creams (a, left) and correlation circle associated (b, right).<br />

If we also focus on the hedonic aspects <strong>by</strong> considering the averaged hedonic score provided <strong>by</strong> the entire<br />

panel as a supplementary variable, it appears that this variable is strongly correlated to the first dimension, the<br />

products easily applicable (8, 13, 14 and 17) being more appreciated than the fatty ones. Hence, we can notice<br />

that the majority of the sensory attributes are strongly linked to the averaged hedonic scores.<br />

1 3 5 8 13 14 15 17<br />

Averaged hedonic scores 2.47 1.79 3.02 3.38 3.44 3.61 3.33 3.32<br />

Table 5.2: Averaged hedonic scores of the creams.<br />

198


5. General Conclusions<br />

5.1.5. Preliminary study of the ideal product space<br />

Let’s focus now on the ideal product space. This space is obtained <strong>by</strong> performing a standardized PCA on<br />

the corrected averaged ideal profiles .. (table with 72 rows and 13 columns, each row representing the<br />

averaged ideal profile corrected from one consumer and each column representing one ideal attribute, §2.1).<br />

This ideal space and its corresponding correlation circle are given in Figure 5.2.<br />

<strong>The</strong> first dimension of this space opposes the ideal products from the consumers 30 and 54 which<br />

described their ideal as rather fatty (jaune, épais, texture and sensation de gras) to the consumers 44 and 53<br />

which described their ideal as more easily applicable and fresh (étalement, pénétrant, onctueux and frais).<br />

Hence, the first dimension of the ideal product space can be interpreted as a dimension of texture opposing<br />

ideal products which are rather fatty to ideal products easily applicable on the skin. <strong>The</strong> second dimension<br />

opposes the ideal product from the consumer 35 which has a fatty aspect to the ideal products from the<br />

consumer 61 which is glossier.<br />

Figure 5.2: <strong>Ideal</strong> product space and its corresponding correlation circle.<br />

We can notice that the sensory space (Figure 5.1) and the ideal product space (Figure 5.2) are structurally<br />

similar, the first dimension opposing products which are rather fatty to products which are more easily<br />

applicable and fresh in both cases. From a sensory attributes point of view, the major direction of variability<br />

between ideal products seems to be related to the major direction of variability between products (in terms of<br />

sensory description). <strong>The</strong>oretically, this relationship between the two spaces is not expected. This astonishing<br />

relationship between dimensions of variability can be interpreted in different ways. In our example, the<br />

attributes used to discriminate the products are strong drivers of liking or disliking. Since the ideal attributes<br />

referred to the hedonic <strong>by</strong> definition, the relationship between the two spaces will be justified <strong>by</strong> the strong<br />

link to the hedonic in both cases. This relationship could also be interpreted as an artifact of the <strong>Ideal</strong> profile<br />

Method in which the sensory space would strongly influence the ideal product space. This second explanation<br />

seems less realistic here.<br />

199


Validation of the Methodology<br />

In order to characterize the ideal products provided <strong>by</strong> the consumers according to the tested products,<br />

the sensory profiles of the products are projected in the ideal product space (Figure 5.3). Here, each cream is<br />

considered as the ideal of one consumer.<br />

With this projection, we can first notice that the entire set of creams is projected on the positive side of<br />

the first dimension. Hence, the creams are perceived as too fatty and not enough applicable for the majority of<br />

consumers. In other words, the consumers have rated their ideal as less fatty (low perception and sensation of<br />

fat) and more applicable (étalement, pénétrant) than the creams tested. This observation is in agreement with<br />

the averaged hedonic scores provided <strong>by</strong> the consumers. Indeed, the less fatty and more applicable creams (8,<br />

13, 14, 17) were more appreciated <strong>by</strong> the panel of consumers (table 5.2). Hence, the ideal products are going in<br />

the same direction as the more appreciated creams.<br />

Figure 5.3: Projection of the creams in the ideal product space<br />

Additionally, we will propose an indicator to measure the link between the product space (also called<br />

sensory space) and the ideal product space. To do so, we will consider the correlation coefficient between the<br />

configurations of the tested products within the two spaces. More precisely, this consists in measuring the<br />

correlation coefficient between the scores of the tested products in the sensory space and the scores of the<br />

tested products in the ideal product space for each dimension. <strong>The</strong> results thus obtained for the two first<br />

dimensions are presented in Table 5.3. <strong>The</strong> correlation coefficient between the two first dimensions being<br />

close to 1, a strong relationship between the two configurations is shown. We could say that the ideal and<br />

sensory configurations have the same structure (along the dimension). Moreover, we can notice that the<br />

sensor configuration of the tested products is also observed along the second dimension of the ideal product<br />

space (r=0.89). However, the second sensory dimension doesn’t have any equivalent in the ideal product space.<br />

200


5. General Conclusions<br />

Dim 1 (idéale) Dim 2 (idéale)<br />

Dim 1 (sensorielle) 0.99 0.89<br />

Dim 2 (sensorielle) ‐0.01 0.17<br />

Table 5.3: Relationship between the configurations of the creams obtained in the sensory and ideal spaces.<br />

From this preliminary study of the sensory space, it seems that the ideal data are consistent according to<br />

the sensory and hedonic descriptions of the products. This is what we are trying to confirm through the study<br />

of the senso‐hedonic consistency of the ideal data according to the IPA (§3)<br />

5.2. Consistency of the ideal data (§3.)<br />

5.2.1. Sensory consistency (§3.1)<br />

<strong>The</strong> ideal data provided <strong>by</strong> a consumer are consistent from a sensory point of view if the sensory profiles<br />

associated to the averaged ideal product have similar sensory characteristics as the tested product which she<br />

appreciated the most. From an attribute point of view, this means that the consumers who said they have a<br />

higher appreciation for the products perceived as more intense for an attribute a should also rate their ideals<br />

as rather intense for a. Hence, if a consumer says she has higher appreciation for the products she perceived as<br />

sweeter, we can expect her to have an ideal product rather sweet. This consistency is measured both at the<br />

consumers and pane level (§3.1.1).<br />

In practice, at the panel level, this consistency can be checked graphically within the corrected averaged<br />

ideal product space (72 rows and 13 attributes, each row representing the averaged ideal product corrected of<br />

one consumer and each column representing one ideal attribute) in which are projected the sensory profiles of<br />

the products as supplementary entities (8 rows and 13 columns, each row corresponding to the averaged<br />

sensory profile of one tested product and each column corresponding to one sensory attribute) and the<br />

hedonic scores of the products as supplementary attributes (72 rows and 8 columns, each row corresponding<br />

to the centered hedonic scores provided <strong>by</strong> one consumer to the products and each column corresponding to<br />

one product). <strong>The</strong> sensory consistency of the ideal profiles is measured at the consumer level <strong>by</strong> the relative<br />

position of the tested products projected as supplementary entities in the sensory space of the products with<br />

the liking scores of the products projected as supplementary variables in the ideal attributes space.<br />

Hence, the averaged ideal profiles corrected of the consumers are consistent at the panel level if they are<br />

projected close to the tested products they said they appreciated the most. This can be seen graphically <strong>by</strong> the<br />

correspondence between the double projections as illustrative of the products. For a consistent panel, we can<br />

expect that each product p considered as a supplementary hedonic variable points in the direction of the<br />

product p projected as a supplementary entity in the sensory space.<br />

In order to simplify the interpretation of the results, we match the sensory space and the ideal product<br />

space <strong>by</strong> centering the tables. In practice, we make sure that the center of gravity of the tested products cloud<br />

coincides with the center of gravity of the corrected averaged ideal products cloud. <strong>The</strong> interpretation of the<br />

space thus obtained is as follow: the ideal product of a consumer j is close to the tested product p if the<br />

sensory characteristics (relative to the panel of consumers) of the ideal product provided <strong>by</strong> j are similar to the<br />

sensory characteristics (relative to the product set) of p. In other words, the consumers who rated their ideals<br />

as more intense for the attribute a are projected close to the product which are more intense for a. In the<br />

cream study, this means that the consumer who has an corrected averaged ideal product as fattier and less<br />

201


Validation of the Methodology<br />

applicable (relatively to the rest of the panel of consumers) will be projected close to the fattiest and less<br />

applicable product tested (relatively to the entire set of products).<br />

In the ideal product space, the double projections of the sensory profiles as supplementary entities (8 rows<br />

and 13 columns) and of the hedonic variables associated to the products as supplementary variables (72 rows<br />

and 8 columns) are represented in Figure 5.4. <strong>The</strong>se double projections show that consumers who described<br />

their ideal as rather fatty and less applicable than the rest of the panel have a higher appreciation for the<br />

products 3 and 5 than the rest of the panel. Consumers who described their ideal as more applicable have a<br />

higher appreciation for the products 8 and 14 than the rest of the panel.<br />

Figure 5.4: Projections of the sensory profiles (a, left) and the hedonic scores (b, right) of the creams in the ideal space.<br />

At the panel level, the consistency of the ideal data is measured through the correspondence of similar<br />

products seen both through the sensory (marked as “P_1” for example) and hedonic descriptions (marked as<br />

“1” for example) within the ideal space. In this case, some correspondences seem good: the consumers who<br />

have a higher appreciation for product 3 than the rest of the panel also seem to describe her ideal with similar<br />

relative characteristics than the product 3 (i.e. a fattier product). Similarly, the consumers who have a higher<br />

appreciation for product 8 rated their ideal with similar relative characteristics than the product 8 (i.e. an ideal<br />

product more easily applicable).<br />

This correspondence is not clear for all products. <strong>The</strong> consumers who said they have a higher appreciation<br />

for product 5 than the rest of the panel described an ideal with relative sensory characteristics closer to the<br />

one of the product 1 or 3 than of the product 5. Similarly, the consumers who have a higher appreciation for<br />

product 14 than the rest of the panel described an ideal more intense for the attributes étalement, frais,<br />

pénétrant than is suggested <strong>by</strong> the characteristics of the product 14.<br />

Although the correspondence of the projections is not perfect, a general tendency can be observed. <strong>The</strong><br />

correlation coefficient measured between the scores of the supplementary entities (sensory profile of the<br />

products) and the loadings of the supplementary variables (hedonic scores of the products) along the first<br />

dimension of the ideal product space is 0.64 (corresponding to a p‐value=0.087). Hence, one would say that the<br />

ideal data are consistent from a sensory point of view, at the panel level.<br />

202


5. General Conclusions<br />

<strong>The</strong> ideal data gathered from a consumer is consistent if the averaged ideal profile corrected has the same<br />

characteristics as the product appreciated the most. At the consumer level, this consistency is measured <strong>by</strong> the<br />

link between the ideal intensity measured on one hand and the vector of linear drivers of liking for this<br />

consumer on the other hand. <strong>The</strong>se vectors of linear drivers of liking are obtained <strong>by</strong> measuring the correlation<br />

between the perceived intensity for each attribute and the hedonic ratings provided <strong>by</strong> the consumer<br />

considered. A consumer being consistent if she rates her ideal product with similar characteristics as the ones<br />

of the products she appreciates the most, one can expect that the link is strong, meaning that the correlation<br />

coefficients are high.<br />

<strong>The</strong> distribution of the correlation coefficients measured for each consumer is presented in Figure 5.5. It<br />

shows high correlation coefficients (the majority is higher than 0.47, corresponding to the critical value at 5%<br />

for a one tailed test). Hence, we can conclude that the ideal profiles are consistent at the consumer level from<br />

a sensory point of view.<br />

Figure 5.5: Distribution of the correlation coefficients measuring the individual sensory consistency of the ideal profiles.<br />

5.2.2. Hedonic consistency (§3.2)<br />

<strong>The</strong> ideal data are consistent from a hedonic point of view if they correspond to ideal products which<br />

would be more appreciated than the tested products. <strong>The</strong> hedonic scores of the ideal products cannot be<br />

provided from consumers directly, so they are estimated. We will refer to those as the estimated liking<br />

potential of the ideal profiles. In this study, the model is used.<br />

At the panel level, this consistency is estimated <strong>by</strong> comparing the distributions of the hedonic scores given<br />

to the tested products on one hand and of the estimated liking potential of the ideal products on the other<br />

hand. <strong>The</strong>se distributions are represented in Figure 5.6. For the model, the median related to the<br />

estimated liking potential of the ideal products is higher than the one related to the hedonic scores of the<br />

tested products. Hence, the ideal data seem consistent from a hedonic point of view at the panel level.<br />

203


Validation of the Methodology<br />

Figure 5.6: Distribution of the hedonic scores provided and of the estimated liking potential.<br />

At the consumer level, the consistency is measured <strong>by</strong> comparing the estimated liking potential of the<br />

ideal products to the hedonic scores of the tested products. To simplify the interpretation of the results; this<br />

comparison is done based on an indicator called standardized liking potential which is positive if this estimation<br />

is larger than the averaged hedonic score provided <strong>by</strong> the consumer to the tested products. This threshold<br />

(averaged hedonic score) will be considered as a lower threshold (horizontal red line in Figure 5.7). Indeed, it is<br />

difficult to conceive that a consistent ideal product would be associated to an estimated liking potential which<br />

is inferior than the averaged hedonic score provided to the tested products. More strictly, we could consider<br />

the quantile (at 95%) of the standardized normal distribution as a threshold. In this case, the estimated liking<br />

potential should be larger than 1.64 (horizontal blue line in Figure 5.7). <strong>The</strong> quality of the individual models<br />

being also of great importance in the estimation of the liking potential, the standardized liking potentials are<br />

represented in function of the adjusted R². An adjusted R² coefficient larger than 0.5 is considered here as large<br />

enough (vertical red line in Figure 5.7).<br />

<strong>The</strong> standardized liking potentials are represented in Figure 5.7. <strong>The</strong> majority of the consumers is located<br />

on the right upper part of the graph, meaning that the standardized liking potentials are positive and the<br />

adjusted R² of the corresponding individual model is high (the individual models explaining the hedonic ratings<br />

based on the sensory descriptions provided <strong>by</strong> the same consumer). Compared to the lower limit defined<br />

previously, the majority of the consumers are consistent. In the contrary, in the skin cream example, only 10<br />

consumers (out of 72) are consistent according the upper limit (standardized normal distribution).<br />

204


5. General Conclusions<br />

Figure 5.7: Representation of the individual standardized liking potential in function of the adjusted R² associated.<br />

Since the majority of the consumers being located between the lower and upper limit, we propose to<br />

compare the averaged liking potentials with the larger hedonic score given to the tested products (Figure 5.8a).<br />

In this case, only 31% of the consumers have an averaged ideal product for which the corresponding estimated<br />

liking potential is larger than the maximal hedonic rating provided to the products.<br />

Rather than associating each consumer to her averaged ideal product, one could consider associating her<br />

to an ideal area. This assumption is made in the <strong>Ideal</strong> mapping technique when each consumer is associated to<br />

an ideal confidence ellipse constructed around her averaged ideal product (§4.2). In this case, each consumer<br />

could be associated to the ideal product which belongs to that ideal area and which is associated to the largest<br />

estimated liking potential. We can then compare the largest hedonic score provided to the tested products to<br />

the largest liking potential estimated of each consumer. <strong>The</strong> Figure 5.8b shows that 54% of the consumers have<br />

an ideal for which the maximal liking potential is larger than the maximal hedonic score provided to the<br />

products. For the remaining 46%, the maximal liking potential is close to the maximal hedonic score.<br />

205


Validation of the Methodology<br />

Figure 5.8: Comparison of the maximal hedonic score provided <strong>by</strong> each consumer with the averaged (a, left) and<br />

maximal (b, right) estimated liking potential.<br />

From these results, one can say that the ideal data are consistent from both at the sensory and hedonic<br />

point of view, both at the panel and consumer level. Hence, these data can be used in order to improve the<br />

products.<br />

5.3. Optimization of the tested products (§4.)<br />

5.3.1. Segmentation of the panel and uniqueness of the ideal (§4.1)<br />

<strong>The</strong> study of the variability of the ideal profiles showed that the consumers described ideal more or less<br />

extreme (Figure 5.3) from an easy application point of view, compared to the tested products. Indeed, some<br />

consumers described ideal products close to the tested products while some other are far away.<br />

<strong>The</strong> projection of the averaged ideal products (72 rows and 13 columns) or of the individual ideal products<br />

(72*8 rows and 13 columns) in the sensory space (8 rows and 13 columns) shows a similar consensus between<br />

the ideal products provided <strong>by</strong> the consumers (Figure 5.9a). Indeed, the panel of consumers described an ideal<br />

more easily applicable and less fatty. Oppositely, we can note however that the variability between the ideal<br />

products is larger than the variability between the tested products. This difference can be observed through<br />

the difference of the size of the ellipses in Figure 5.9a (blue ellipse for the averaged ideal products, light blue<br />

for the individual ideal products and black for the tested products).<br />

<strong>The</strong> projection in the space of the sensory attributes of the individual hedonic scores provided <strong>by</strong> the<br />

consumers as supplementary variables (8 rows and 72 columns) shows a strong consensus between consumers<br />

(Figure 5.9b). Indeed, as mentioned §5.1.4, the consumers said they appreciate more the products more easily<br />

applicable and less fatty.<br />

This double projection strengthens the idea of consistency of the ideal data since the consumers seem to<br />

appreciate more the products which are going in the same direction than their ideal products. It also puts<br />

206


5. General Conclusions<br />

forward a strong consensus between consumers, both in their hedonic judgment and in the representation of<br />

their ideal products. Hence, no segmentation of the panel is considered here.<br />

Figure 5.9: Projection of the averaged and individual ideal profiles (a, left) as supplementary entities in the sensory space of<br />

the products and projection of the hedonic scores (b, right) as supplementary variables in the corresponding variable space.<br />

<strong>The</strong> blue ellipse corresponds to the variability of the averaged ideal products, the light blue corresponds to the variability of<br />

the individual ideal products and the black corresponds to the variability o the tested products.<br />

In this example, it seems that considering the averaged ideal product for the entire panel of consumers as<br />

product of reference to match in the procedure of optimization is a good solution. In view of this solution, and<br />

in order to follow the methodology of the IPA presented previously, we are going to use the solution obtained<br />

from the ideal mapping. <strong>The</strong> ideal product used as a reference to match in the optimization procedure<br />

corresponds then to the ideal product common to a maximum of consumers.<br />

However, before defining the sensory profile of the ideal products used as a reference, one has to be sure<br />

that the consumers associate the set of products to one unique ideal product. To do so, the averaged ideal<br />

profiles provided according to each tested product <strong>by</strong> the entire panel of consumers are projected as<br />

supplementary entities in the sensory space. Based on the variability between consumers of the ideal products,<br />

confidence ellipses are constructed around each averaged ideal products (Figure 5.10). Since all the ellipses are<br />

superimposed, one can conclude that in this study, all the pane of consumers associated the set of tested<br />

products to one unique ideal (Figure 5.10).<br />

207


Validation of the Methodology<br />

Figure 5.10: Confidence ellipses checking for the uniqueness of the ideal profile at the panel level.<br />

5.3.2. Determination of the sensory profile of the ideal product of reference (§4.2)<br />

In order to determine the ideal product used as reference to match for the optimization procedure of the<br />

products, we use the ideal mapping technique. For the construction of the ideal map, we considered that a<br />

consumer associated to a large confidence ellipse has a large ideal area (this consumer doesn’t have a well<br />

defined ideal but an ideal which is situated in a larger area). Hence, the ideal mapping technique considered<br />

does not standardize the individual ellipses <strong>by</strong> applying a weight which would be inversely proportional to the<br />

size of the ellipse. In other words, the IdMap is preferred over the wIdMap for this study (article presented in<br />

§4.2.1.).<br />

<strong>The</strong> map thus obtained according to the IdMap is presented in Figure 5.11.<br />

208


5. General Conclusions<br />

Figure 5.11: Results of the IdMap.<br />

In this ideal map, the profile of the ideal product common to a maximum of consumers is defined. As<br />

expected, it is located on the negative part of the first dimension, and on the positive part of the second<br />

dimension. Hence, we can expect that the ideal product used as a reference will be more easily applicable on<br />

the skin (more étalement and pénétrant) and less fatty (less sensation and perception de gras) than the tested<br />

products. This is confirmed in Figure 5.12 and in Table 5.4 in which the profile of the ideal product used as a<br />

reference to match is compared to the sensory profile of products 3 (the product the further from the ideal)<br />

and 17 (one of the closest‐to‐the‐ideal product).<br />

Figure 5.12: Sensory profiles of the products 3 and 17 compared to the profile of the ideal product obtained from the<br />

IdMap.<br />

209


Validation of the Methodology<br />

Produit 3 Produit 17 <strong>Ideal</strong><br />

Compact 5,58 2,70 3,74<br />

Asp. Gras 4,68 2,47 2,96<br />

Jaune 2,94 1,26 0,99<br />

Brillant 1,59 4,35 3,66<br />

Onctueux 3,01 4,41 4,57<br />

Etalement 2,56 4,52 4,45<br />

Text. Gras 3,97 3,10 2,81<br />

Epais 4,08 2,43 2,80<br />

Pénétrant 2,67 3,00 4,48<br />

Effet Filmo. 4,11 4,10 3,82<br />

Doux 2,52 3,76 5,28<br />

Frais 2,10 2,66 3,95<br />

Sens. Gras 3,98 3,70 1,40<br />

Table 5.4: <strong>Profile</strong>s of the products 3 and 17 obtained during the first study. <strong>The</strong>se profiles are compared to the profile<br />

of the ideal product used as reference (obtained according to the IdMap).<br />

<strong>The</strong> ideal product used as reference is common for 14% of the consumers (results from the IdMap).<br />

Although this proportion is low, it is from the same range as the one obtained for the 24 other projects. Hence,<br />

we can notice that the projections of the ideal products of the consumers who have a different ideal than the<br />

one used as reference are still close on the sensory space. <strong>The</strong> improvement of the products should also have a<br />

positive impact on the hedonic judgment of those consumers.<br />

5.3.3. Optimization of the products according to the ideal of reference (§4.3)<br />

<strong>The</strong> comparison of the sensory profiles of the products 17 and 3 with the one of the ideal product used as<br />

reference confirms that the product 17 has a sensory profile closer to the ideal than the product 3 (Figure<br />

5.12). As expected, the principal differences observed between the sensory profiles of these products with the<br />

one of the ideal product considered as a reference to match concern the attributes frais, doux, pénétrant<br />

(intensity to increase) and the attributes related to the perception of fat (intensity to decrease).<br />

In order to guide on improvement the attributes to change in priority, the “Fishbone Method” presented in<br />

§4.3 is applied on our data <strong>by</strong> using the solution obtained with the IdMap as the ideal product of reference to<br />

consider. <strong>The</strong> optimizations indicated for the products 3 and 17 are shown in Figure 5.13a and in Figure 5.13b.<br />

For the product 3, the entire set of attributes has to be improved. In priority, the attributes frais, doux,<br />

brillant and étalement should be intensified since they would have a larger impact on liking. Oppositely, the<br />

attribute sensation de gras should be decreased. From a hedonic point of view, the potential gain in liking<br />

would be more important if the attributes frais and doux are at their ideal level.<br />

210


5. General Conclusions<br />

Figure 5.13a: Optimization of the product 3 according to the Fishbone method.<br />

For the product 17, the attributes frais, doux and pénétrant should be intensified. Oppositely, the attribute<br />

sensation de gras should be decreased. From the hedonic point of view, the gain in liking would be more<br />

important if the attributes frais, sensation de gras and doux are at their ideal level. In that case, the gain in<br />

liking would be of around 18% for the attribute frais and 10% for the attributes sensation de gras and doux.<br />

Figure 5.13b: Optimization of the product 17 according to the Fishbone method.<br />

211


Validation of the Methodology<br />

5.4. Formulation of two new products<br />

In order to validate the methodology analyzing ideal data according to the IPA, two new products<br />

corresponding to the ideal product defined in the previous study were created. <strong>The</strong>se new products were then<br />

presented to the same consumers who were asked to rate the products according to their hedonic judgment is<br />

realized. We expect here that the consumers have a higher appreciation for the new products as they should<br />

be closer to the “ideal”.<br />

5.4.1. New sensory task<br />

Among the 18 products originally created, there were two products (the products 2 and 9) which had<br />

sensory characteristics close to the one of the ideal product (i.e. the products are more easily applicable and<br />

less fatty). Hence, a second study integrating these two products is realized. In order to keep the same total<br />

number of products in this new study (i.e. 8), these two new products were added to 6 out of the 8 previous<br />

products. <strong>The</strong>se 6 products were selected according to the D‐optimality criteria (Ben Slama, Heyd, Danzart, &<br />

Ducauze, 1998). This second set of 8 products includes the products 1, 2, 3, 5, 8, 9, 15 and 17, the products 13<br />

and 14 being discarded. This new set of 8 products was tested following the same procedure as before (IPM on<br />

the same 13 attributes and acceptance questions) <strong>by</strong> 65 of the 72 previous consumers.<br />

<strong>The</strong> sensory profiles of the products 2 and 9 are presented in Figure 5.14. <strong>The</strong>se profiles are also given in<br />

Table 5.5. <strong>The</strong>se two profiles are compared to the profile of the product 17, as it was the product the closest to<br />

the ideal taken as reference in the previous study.<br />

Figure 5.14: Comparison of the sensory profile of the product 17 with the sensory profiles of the new products.<br />

212


5. General Conclusions<br />

Produit 17 Produit 2 Produit 9<br />

Compact 2,97 1,55 3,08<br />

Asp. Gras 2,81 1,73 2,73<br />

Jaune 1,54 1,08 1,04<br />

Brillant 4,23 4,44 4,09<br />

Onctueux 4,35 3,73 4,12<br />

Etalement 4,66 5,30 4,75<br />

Text. Gras 3,06 1,81 2,56<br />

Epais 2,57 1,29 1,85<br />

Pénétrant 3,50 3,55 3,26<br />

Effet Filmo. 4,18 3,34 2,58<br />

Doux 3,91 4,20 3,07<br />

Frais 2,67 3,22 2,88<br />

Sens. Gras 3,75 2,65 1,87<br />

Table 5.5: <strong>Profile</strong>s of the products 2, 9 and 17 obtained from the first study and compared to the ideal product used as<br />

reference obtained according to the IdMap.<br />

<strong>The</strong> products 2 and 9 have sensory profiles which are different from the one of the product 17. <strong>The</strong>se<br />

differences are mainly related to the attribute sensation de gras, texture grasse, épais and effet de filmographie<br />

for which the perceived intensity is lower. (Figure 5.14 and Table 5.5).We can also notice a difference in the<br />

perceived intensity between the products 2 and 17 for the attributes étalement and frais (product 2 being less<br />

intense). <strong>The</strong>se differences are not observed between the products 9 and 17. Hence, the comparison of the<br />

sensory profiles of the products 2 and 9 suggest a better improvement for product 2 than for product 9, the<br />

attributes being closer to the ideal level.<br />

<strong>The</strong> products 2 and 9 have sensory profiles which are closer to the ideal profile used as reference and<br />

defined in the previous study. <strong>The</strong> attributes which are drivers of liking/disliking have been modified in the<br />

direction of an improvement.<br />

5.4.2. Results: liking scores of the products<br />

Before checking that the two new products created according to the optimization procedure are more<br />

appreciated than the other products, we first need to check that the sensory space obtained in this second<br />

study is still similar to the previous one. This sensory space is obtained <strong>by</strong> performing a PCA on the sensory<br />

profiles of the products (8 rows and 13 columns). This space is presented in Figure 5.15.<br />

<strong>The</strong> first dimension thus obtained opposes the products 2, 8 and 9 (étalement, pénétrant, frais and brillant)<br />

to the products 1 and 3 (compact, jaune, aspect and texture gras). Hence, the first dimension opposes the<br />

products easily applicable to the products perceived as fatty. This dimension corresponds to the one obtained<br />

previously in the first test performed, hence showing a stability of the sensory spaces obtained from the<br />

consumers across tests. We can notice that the products 2 and 9, which correspond to the optimized products,<br />

are positioned on the negative extremity of the first dimension (which corresponds to the products more easily<br />

applicable and less fatty). This would correspond to the position of the ideal products in the previous space.<br />

However, we can notice that the product9 is less extreme than the product 8 along that dimension.<br />

213


Validation of the Methodology<br />

Figure 5.15: Sensory space and corresponding correlation circle obtained in the second sensory test.<br />

<strong>The</strong> validity of the IPA methodology is measured through the hedonic judgments of the optimized<br />

products. One can expect here that these optimized products are more appreciated than the other products.<br />

For that reason, we project the averaged hedonic score for the entire panel as a supplementary variable in the<br />

sensory attribute space. <strong>The</strong> correlation circle presented in Figure 5.15 shows a strong and positive correlation<br />

with the sensory attributes frais, étalement and brillant, and a strong and negative correlation to the attributes<br />

compact, jaune, épais, aspect and texture de gras. This result confirms the one obtained in the first test, the<br />

more easily applicable and less fatty products being more appreciated. Hence, the products 2, 8 and 9 seem to<br />

be the most appreciated products.<br />

<strong>The</strong> ideal mapping obtained with the ideal products from the second test confirms the optimization<br />

performed. Indeed, Figure 5.16 shows that the product 2 is closer to the ideal product used as a reference.<br />

214


5. General Conclusions<br />

Figure 5.16: <strong>Ideal</strong> mapping obtained during the second test.<br />

In order to validate the methodology, let’s focus more particularly on the hedonic judgments. Indeed, the<br />

optimization of the products is measured through the differences in liking of the products. To do so, a two‐way<br />

analysis of variance (measuring the effect product and consumer) is performed for each of the 4 acceptance<br />

variables. For the overall liking and for the texture after application, the t‐test confirms that the product 2 is<br />

the most appreciated product. It is not the case for the product 9. However, concerning the visual aspect and<br />

the texture during application, the product 9 is the second most appreciated product, right after the product 17<br />

(Table 5.6).<br />

Visuel Texture pendant Texture après Globale<br />

Coeff P‐value Coeff P‐value Coeff P‐value Coeff P‐value<br />

Produit 1 ‐0,829 0,000 ‐0,599 0,000 ‐0,199 0,204 ‐0,495 0,001<br />

Produit 2 ‐0,012 0,935 ‐0,187 0,239 0,670 0,000 0,492 0,001<br />

Produit 3 ‐1,194 0,000 ‐0,503 0,002 ‐0,664 0,000 ‐0,904 0,000<br />

Produit 5 ‐0,111 0,470 0,004 0,979 ‐0,018 0,910 ‐0,019 0,900<br />

Produit 8 0,377 0,014 0,363 0,022 0,430 0,006 0,415 0,007<br />

Produit 9 0,620 0,000 0,415 0,009 ‐0,015 0,926 0,219 0,151<br />

Produit 15 0,471 0,002 0,013 0,932 ‐0,215 0,171 0,193 0,205<br />

Produit 17 0,680 0,000 0,493 0,002 0,010 0,949 0,099 0,515<br />

Table 5.6: Results of the t‐test related to the product effect obtained for each acceptance question.<br />

<strong>The</strong> methodology of the IPA helped us creating better products. This remark is particularly true for the<br />

product 2 as it was more appreciated globally than any other product. Indeed, the closer a product is to the<br />

ideal and the larger its liking score. However, it is not the case for the product 9 for which the optimization was<br />

not sufficient. Indeed, product 9 has a sensory profile which is closer to the one of product 17 than to the one<br />

of the ideal product to match. However, from a “visual” and “texture during application” point of view, the<br />

product 9 is the second most appreciated product (Table 5.6).<br />

215


Validation of the Methodology<br />

To conclude, this study validates the optimization procedure according to the IPA. In this example, the<br />

products, which have the closer to the ideal profiles, were the most appreciated products. Although it was<br />

expected, this result is not guaranteed, the sensory, ideal and hedonic data being measured “independently”.<br />

216


6. References 1<br />

1 Since the published and submitted articles have their own reference list, the following list only concerns the<br />

rest of the document (i.e. published and submitted articles excluded).


6. References<br />

Ben Slama, M., Heyd, B., Danzart, M., & Ducauze, C.J. (1998). Plans D‐optimaux: une statégie de réduction du<br />

nombre de produits en cartographie des préférences. Sciences des Aliments, 18, 471‐483.<br />

Carroll, J.D. (1972). Individual differences and multidimensional scaling. In Shepard, R.N., Romney, A.K., &<br />

Nerloves, S. Multidimensional scaling: theory and applications in the behavioral sciences. Academic Press,<br />

New York.<br />

Cooper,H.R., Earle, M.D., & Triggs, C.M. (1989). Ratios of <strong>Ideal</strong>s – A New Twist to an Old Idea. In Product Testing<br />

with Consumers for Research Guidance. ASTM STP 1035, L.S. Wu, Ed., American Society for Testing and<br />

Materials, Philadelphia, 54‐63.<br />

Daillant‐Spinnler, B., MacFie, H.J.H., Beyts, P.K., & Hedderley, D. (1996). Relationships between perceived<br />

sensory properties and major preference directions of 12 varieties of apples from the southern<br />

hemisphere. Food Quality and Preference, 7(2), 113‐126.<br />

Danzart, M. (1998). Quadratic model in preference mapping. 4th Sensometric Meeting, Copenhagen, Denmark,<br />

August 1998.<br />

Danzart, M. (2009a). Cartographie des Préférences. In SSHA, (2009). Evaluation sensorielle. Manuel<br />

méthodologique. 3ème édition, 431‐439, Lavoisier, Paris.<br />

Danzart, M. (2009b). Recherche d’un produit optimal. In SSHA, (2009). Evaluation sensorielle. Manuel<br />

méthodologique. 3ème édition, 431‐439, Lavoisier, Paris.<br />

Delarue, J., Danzart, M., & Sieffermann, J.M. (2010). Revisiting the definition of preference in preference<br />

mapping studies. In KEER 2010 proceedings, Paris.<br />

Earthy, P.J., MacFie, J.H., & Hedderley, D. (1997). Effect of question order on sensory perception and<br />

preference in central location trials. Journal of Sensory Studies, 12, 215‐237.<br />

Ennis, D.M. (2005). Analytic approaches to accounting for individual ideal point. IFPress, 8(2), 2‐3.<br />

Faber, N.M., Mojet, J., & Poelman, A.A.M. (2003). Simple improvement of consumer fit in external preference<br />

mapping. Food Quality and Preference, 14, 455‐461.<br />

Gacula, M., Rutenbeck, S., Pollack, L., Resurreccion, A.V.A., & Moskowitz, H.R. (2007). <strong>The</strong> just‐about‐right<br />

intensity scale: Functional analyses and relation to hedonics. Journal of Sensory Studies, 22, 194‐211.<br />

Greenhoff K.; MacFie H.J.H. (1995) Preference mapping in practice. In Measurement of food preferences,<br />

MacFie H.J.H; Thomson D.M.H. (Eds.) 137–166. Glasgow: Blackie.<br />

Hoggan, J. (1975). New Product Development. MBAA Technical Quarterly, 12, 81‐86.<br />

Husson, F., Le Dien, S., & Pagès, J. (2001). Which value can be granted to sensory profiles given <strong>by</strong> consumers?<br />

Methodology and results. Food Quality and Preference, 12, 291‐296.<br />

Husson, F., Lê, S., & Pagès, J. (2011). Clusters. In Exploratory Multivariate Analysis <strong>by</strong> Example Using R. A<br />

Chapman & Hall Book, CRC Press, London, UK.<br />

Jaeger, S.R., Wakeling, I.N., & MacFie, H.J.H. (2000). Behavioural extensions to preference mapping: the role of<br />

synthesis. Food Quality and Preference, 11, 349‐359.<br />

Lawless, H.T., & Heymann, H. (1999). Sensory evaluation of food: Principles and practices. New York: Kluwer<br />

Academic/Plenum Publishers.<br />

Lê, S., Josse, J., & Husson. F. (2008). FactoMineR: An R Package for Multivariate Analysis. Journal of Statistical<br />

Software, 25(1).<br />

Lengard, V., & Kermit, M. (2006). 3‐Way and 3‐block PLS regressions in consumer preference analysis. Food<br />

Quality and Preference, 17, 234‐242.<br />

219


6. References<br />

Lengard, V., Mage, I., & Kermit, M. (2008). L‐PLS regression for consumer preference analysis of flavored<br />

waters. Oral presentation in the 10th European Symposium on Statistical Methods for the Food Industry<br />

AGROSTAT 2008, Louvain‐la‐Neuve, Belgium, 23‐25 January 2008.<br />

MacFie, H.J., Bratchell, N., Greenhoff, K., & Vallis, L.V. (1989). Designs to balance the effect of order of<br />

presentation and first‐order carry‐over effects in hall tests. Journal of Sensory Studies, 4, 129‐148.<br />

Mao, M., & Danzart, M. (2008). Multi‐response optimisation strategies for targeting a profile of product<br />

attributes with an application on food data. Food Quality and Preference, 19, 162‐173.<br />

Martens, H., Anderssen, E., Flatberg, A., Gidskehaug, L.H., Hoy, M., Westad, F., Thybo, A., & Martens, M.<br />

(2005). Regression of a data matrix on descriptors of both its rows and of its columns via latent variables:<br />

L‐PLSR. Computational Statistics & Data Analysis, 48, 103‐123.<br />

Meilgaard, M., Civille, G.V., & Carr, B.T. (2006). <strong>The</strong> SpectrumTM descriptive analysis method. In Sensory<br />

evaluation techniques (4 th ed. Pp. 189‐253). CRC Press.<br />

Meullenet, J.F., Lovely, C., Threlfall, R., Morris, J.R., & Striegler, R.K. (2008). An ideal point density plot method<br />

for determining an optimal sensory profile for Muscadine grape juice. Food Quality and Preference, 19,<br />

210‐219.<br />

Meullenet, J.F., Xiong, R., & Findlay, C.J. (2007). Multivariate and Probabilistic Analyses of Sensory Science<br />

Problems. IFT Press, Blackwell Publishing, 1st edition, Ames, Iowa, USA.<br />

Moskowitz, H.R. (1972). Subjective ideals and sensory optimization in evaluating perceptual dimensions in<br />

food. Journal of Applied Psychology, 56, 60‐66.<br />

Moskowitz, H.R. (1995). One pratitioner’s overview to applied product optimization. Food Quality and<br />

Preference, 6, 75‐81.<br />

Moskowitz, H.R. (1996). Experts versus consumers: A comparison. Journal of Sensory Studies. 11, 19‐37.<br />

Moskowitz, H.R., & Krieger, B. (1998). International product optimization: a case history. Food Quality and<br />

Preference, 9, 443‐454.<br />

Moskowitz, H.R., & Sidel, J.L. (1971). Magnitude and hedonic scales of food acceptability. Journal of Food<br />

Science, 36:677.<br />

Moskowitz, H.R., Stanley, D.W., & Chandler, J.W. (1977). <strong>The</strong> Eclipse Method: Optimizing Product Formulation<br />

Through a Consumer Generated <strong>Ideal</strong> Sensory <strong>Profile</strong>. Canadian Institute of Food Science Technology<br />

Journal, 10, 161‐168.<br />

Nicod, H. (2009). L’organisation pratique de la mesure sensorielle. In SSHA, (2009). Evaluation sensorielle.<br />

Manuel méthodologique. 3ème édition, 50‐62, Lavoisier, Paris.<br />

Popper, R., Rosenstock, W., Scharidt, M., & Kroll, B.J. (2004). <strong>The</strong> effect of attribute questions on overall liking<br />

ratings. Food Quality and Preference, 15, 853‐858.<br />

Rivière, P., Monrozier, R., Rogeaux, M., Pagès, J., & Saporta, G. (2006). Adaptative preference target:<br />

Contribution of Kano’s model of satisfaction for an optimized preference analysis using a sequential<br />

consumer test. Food Quality and Preference, 17, 572‐581.<br />

Rothman, L., & Parker, M. (2009). Just‐About‐Right (JAR) Scales: Design, Usage, Benefits, and Risks. ASTM<br />

Manual, MNL63‐EB.<br />

Stone, H., & Sidel, J. (1993). Sensory evaluation practices. California: Academic Press.<br />

Stone, H., Sidel, J., Woosley, A., & Singleton, R.C. (1974). Sensory evaluation <strong>by</strong> quantitative descriptive<br />

analysis. Food Technology, 28, 24‐34.<br />

220


6. References<br />

Szczesniak, A., Loew, B.J., & Skinner, E.Z. (1975). Consumer texture profile technique. Journal of food science.<br />

40, 1253‐1256.<br />

Van Kleef, E., van Trijp, H.C.M., & Luning, P. (2006). Internal versus external preference analysis: An exploratory<br />

study on end‐user evaluation. Food Quality and Preference, 17, 387‐399.<br />

Van Trijp, H.C.M., Punter, P.H., Mickartz, F., & Kruithof, L. (2007). <strong>The</strong> quest for the ideal product: Comparing<br />

different methods and approaches. Food Quality and Preference, 18, 729‐740.<br />

221


7. Annexes


7.1. Experts vs. Consumers


7. Annexes<br />

Journal:<br />

Title:<br />

Food Quality and Preference<br />

How reliable are the consumers? Comparison of sensory profiles from consumers and experts.<br />

Authors: <strong>Worch</strong>, T., Lê, S., & Punter, P.<br />

Abstract:<br />

Keywords:<br />

Reference:<br />

This study compares expert and consumer sensory profiles for the same twelve perfumes<br />

in different ways: the discriminatory ability and reproducibility are analyzed through ANOVA<br />

and the panelists’ consensus through the correlation coefficients. Next, the two product<br />

spaces are first analyzed separately for each panel, and then compared through Multiple<br />

Factor Analysis. Finally, the two panels are compared using the confidence ellipses<br />

methodology. <strong>The</strong>se analyses show that the two panels give similar results with respect to the<br />

important criteria for panels (discrimination, consensus, reproducibility). <strong>The</strong> comparison of<br />

the two products spaces shows high similarity. From the confidence ellipses, it can be<br />

concluded that no significant differences exist for a given product between the two panels.<br />

Hence, in this particular case, the use of consumers appears to be a good alternative to the<br />

classical sensory profile provided <strong>by</strong> a trained panel.<br />

Experts versus Consumers, Panels comparison, Multiple Factor Analysis, Confidence Ellipses<br />

<strong>Worch</strong>, T., Lê, S., & Punter, P. (2010). How reliable are the consumers? Comparison of sensory<br />

profiles from consumers and experts. Food Quality and Preference, 21, 309‐318.<br />

1. Introduction<br />

In sensory analysis, one of the most important tools is the quantitative characterization of the perceivable product<br />

attributes. In the literature, this tool is referred to as descriptive analysis, or profiling (two frequently used profiling<br />

methods are Quantitative Descriptive Analysis (QDA®, Stone, Sidel, Oliver, Woosley, & Singleton, 1974) and Spectrum TM<br />

(Meilgaard, Civille, & Carr, 2006)). <strong>The</strong>se methods use trained or expert panels. Because of their routinely use of the type of<br />

products in question, and because of dedicated training sessions, these panels seem to be more able to characterize<br />

products in an accurate way than naïve consumers. On the other hand, hedonic questions are also of great importance and<br />

most practitioners use consumers for hedonic tasks. So trained panels are required for sensory profiles and consumers are<br />

required for hedonic profiles. In the literature, many warnings are given concerning the use of consumers for profiling:<br />

“…as with any untrained panel, beyond the overall acceptance judgment there is no assurance that the responses are<br />

reliable or valid” (Stone, & Sidel, 1993)<br />

“…consumers can only tell you what they like or dislike” (Lawless, & Heyman, 1999)<br />

According to these practitioners, profiling results from consumers lack two essential qualities: consensus between<br />

respondents and reproducibility.<br />

Moreover, it has also been shown, that asking consumers liking and intensity questions in the same test can return an<br />

unwanted halo effects (Earthy, MacFie, & Hedderley, 1997). <strong>The</strong> potential impact of the attribute questions on the hedonic<br />

ratings is a key point in the objection of the use of getting sensory information from consumers. Since the aim of this paper<br />

is to compare experts’ and consumers’ sensory profiles, this point is not studied here.<br />

In market research, most companies need quick answers about their products. Hence, they don’t always have the<br />

possibility to train panels (which is time consuming). <strong>Profile</strong>s obtained with consumers can be a good alternative, depending<br />

on the type of tests one is interested in, especially in view of the fact that consumers’ profiles also meet the requirements<br />

discrimination, panelists’ consensus and reproducibility (Husson, Le Dien, & Pagès, 2001). Moskowitz (1996) also showed<br />

that consumers can be used to assess the sensory descriptions of sauces, and hence “refutes the notion that consumers are<br />

incapable of validly rating the sensory aspects of products”.<br />

Because of these two notions (training panels takes time, and consumers are not allowed to profile products), a<br />

number of faster methods for collecting sensory data have been developed. Among them is Free Choice Profiling (Williams,<br />

& Langron, 1984), Flash Profiling (Sieffermann, 2000; Sieffermann, 2002), and Ultra Flash Profiling (Perrin, Symoneaux,<br />

Maître, Asselin, Joujon, & Pagès, 2008). <strong>The</strong>se methods have in common that they avoid training sessions beforehand, and<br />

that they use naïve consumers (Gazano, Ballay, Eladan, & Sieffermann, 2005; Nestud, & Lawless, 2008). Paradoxically, it is<br />

well accepted that consumers can be used for profiling products using these methods, but the use of consumers with<br />

standard QDA ® type profiling using a fixed, predefined vocabulary is still subject to criticism. <strong>The</strong> question remains: How<br />

reliable are consumers? To answer this question, classical sensory profiles, obtained from an expert and a consumer panel<br />

on the same products, are compared.<br />

227


How reliable are the consumers?<br />

Comparison of sensory profiles from consumers and experts<br />

2. Data<br />

<strong>The</strong> datasets provided here concern twelve luxurious women perfumes. <strong>The</strong> list of the perfumes is given Table 1. <strong>The</strong>se<br />

twelve perfumes were profiled <strong>by</strong> an expert and a consumer panel.<br />

Product<br />

Type<br />

Angel<br />

Eau de Parfum<br />

Cinéma<br />

Eau de Parfum<br />

Pleasures<br />

Eau de Parfum<br />

Aromatics Elixir Eau de Parfum<br />

Lolita Lempicka Eau de Parfum<br />

Chanel N5<br />

Eau de Parfum<br />

L’Instant<br />

Eau de Parfum<br />

J’Adore (EP) Eau de Parfum<br />

J’Adore (ET) Eau de Toilette<br />

Pure Poison Eau de Parfum<br />

Shalimar<br />

Eau de Toilette<br />

Coco Mademoiselle Eau de Parfum<br />

Table 1: List of the products<br />

<strong>The</strong> expert panel was run in Agrocampus Ouest (Rennes, France) with twelve persons (eleven students and one<br />

teacher) from the Chantal Le Cozic School (esthetic and cosmetic school in Rennes). First, two focus groups, with two<br />

moderators, were conducted. <strong>The</strong>n, a summary discussion was conducted, and a list of twelve attributes was defined:<br />

Vanille (vanilla), Notes Florales (flower note), Agrume (citrus), Boisé (woody), Vert (green), Epicé (spicy), Capiteux (heady),<br />

Fruité (fruity), Fraîcheur marine (sea freshness), Gourmand (moreish), Oriental (oriental) and Enveloppant (wrapping).<br />

Additionally, a specific training session for the most difficult attributes was performed (perfumed incense was used).<br />

<strong>The</strong> twelve products were then tested in duplicate, in two one‐hour sessions. A 10 centimeters unstructured line scale was<br />

used for rating the products.<br />

<strong>The</strong> consumer panel was run at OP&P Product Research (Utrecht, the Netherlands) with 103 naïve Dutch consumers<br />

(44 men and 59 women, 48 between 18 and 35 years old and 55 between 45 and 60 years old). <strong>The</strong> women all used<br />

luxurious perfume daily, and the men had a girlfriend or wife who used perfume regularly. Additionally, the men had to<br />

name at least two luxurious women perfumes. In this way, consumers who are (directly or indirectly) users of this type of<br />

product, were selected.<br />

<strong>The</strong> vocabulary for consumers was based on the expert list of attributes. Since the consumers had no experience with<br />

specific perfume attributes, the list was adapted to make it understandable for naïve consumers <strong>by</strong> using descriptors found<br />

online (the perfume encyclopedia at www.osmoz.com). This resulted in a list of 21 attributes: Odor intensity, Freshness,<br />

Jasmine, Rose, Camomile, Fresh lemon, Vanilla, Mandarin/Orange, Anis, Sweet fruit/Melon, Honey, Caramel, Spicy, Woody,<br />

Leather, Nutty/Almond, Musk, Animal, Earthy, Incense and Green. Actually, this vocabulary has a large correspondence with<br />

the experts’ one.<br />

In order to measure the reproducibility of the consumer panel, two products (Shalimar and Pure Poison) were<br />

duplicated. <strong>The</strong> fourteen products (twelve original and two replicates) were tested in two one‐hour session (seven products<br />

in each session). A 100 millimeter unstructured line scale, with marks at 10% and 90% was used with consumers<br />

(EyeQuestion v2.2 software developed <strong>by</strong> Logic8).<br />

In both tests, the experimental design was based on Latin Square balanced for first order and carry‐over effects<br />

(MacFie, Bratchell, Greenhoff, & Vallis, 1989).<br />

Please note that the same line scales were used for experts and consumers, but for experts, the values were recorded<br />

between 0 and 10 while for consumers, they were recorded between 0 and 100.<br />

3. Unidimensional aspects<br />

To measure the quality of the two panels, the following unidimensional measures have been computed: the product<br />

discrimination and the panel reproducibility through ANOVA and the panelists’ consensus through the correlations between<br />

each panelist and the average of the panel without that panelist.<br />

3.1. Expert panel:<br />

For each of the twelve attributes, an ANOVA is performed using the following model:<br />

(1)<br />

where is the scores for the product i given <strong>by</strong> the consumer k at the session j, is the constant, is the effect of<br />

product i, is the effect of the session j (set as random), is the effect of the panelist k (set as random), is the effect<br />

228


7. Annexes<br />

of interaction between product i and session j, is the interaction between the product i and the consumer k, is<br />

the effect of interaction between the session j and the consumer k and is the residual.<br />

In this case, the product effect expresses the discriminatory ability, while the interaction product x session expresses<br />

the reproducibility of the expert panel. <strong>The</strong> results of the F‐tests for the discrimination and for the reproducibility are<br />

shown Table 2. <strong>The</strong> consensus between panelists is usually estimated through the interaction of panelist <strong>by</strong> product<br />

(Latreille et al., 2006). But as only two products were replicated for the consumers, a proper estimation of the interaction of<br />

consumers <strong>by</strong> product is not possible. Hence for both expert and consumer panels, the panelists’ consensus is estimated<br />

through the correlation coefficients calculated between the data for each panelist and data averaged over the rest of the<br />

panel (11 experts or 102 consumers). <strong>The</strong>se data are considered as vectors, <strong>by</strong> rearranging the scaled data of each matrix<br />

on a single column. For the expert data, the averaged table over the two sessions is taken into consideration (vectors of<br />

length 12 products x 12 attributes = 144). <strong>The</strong> distribution of these coefficients is presented Figure 1a.<br />

Attribute<br />

Effect Épicé Capiteux Fruité Vert Vanille Notes Florales<br />

Product


How reliable are the consumers?<br />

Comparison of sensory profiles from consumers and experts<br />

Attribute<br />

Effect Intensity Freshness Jasmine Rose Camomile Fresh Lemon Vanilla<br />

Product<br />


7. Annexes<br />

Figure 3: Consonance analysis showing the consensus between consumers for the attributes woody (left, a) and jasmine<br />

(right, b). In each case, one arrow represents the attribute considered given <strong>by</strong> one consumer.<br />

In blue, the average over the panel for this attribute is projected as illustrative.<br />

<strong>The</strong> consumer panel results show:<br />

• the products are discriminated on all attributes, except for camomile;<br />

• the consumers are reproducible on all attributes, except for “woody”. <strong>The</strong> spider plots shown Figure 2<br />

confirm this finding;<br />

• the correlation coefficients range between ‐0.1 and 0.60, with an average around 0.25.<br />

• despite the high variability due to the use of consumers, the consonance analysis of the attribute with the<br />

higher panelists’ consensus (woody) show a structure that the attribute with the lower (jasmine) panelists’<br />

consensus does not show (Figure 3).<br />

3.3. Conclusion on the unidimensional analyses:<br />

<strong>The</strong> two panels show similar qualities with respect to discrimination and reproducibility. <strong>The</strong>re is a difference between<br />

the two panels in the correlation coefficients: they are higher for the experts than for the consumers. This is most likely<br />

caused <strong>by</strong> the fact that the consumers were not trained. Moreover, for experts, we took the average over sessions, and<br />

looked at the correlation between 144 values, while for the consumers we looked at the correlations between 252 values.<br />

<strong>The</strong>se reasons probably explain the difference observed between the two panels. But since the values are positive, we may<br />

conclude that both panels show consensus, as the averaged correlation coefficients for both panels are significant (with 100<br />

degrees of freedom (i.e. 102 observations), the correlation coefficients become significant at 5% when the values is higher<br />

than 0.195).<br />

4. Multidimensional aspects<br />

For each panel, the product space is computed <strong>by</strong> Principal Components Analysis on the products’ profile, where one<br />

profile is a table crossing the P products in rows and the K (panel) attributes (K (expert) = 12 and K (consumer) = 21) in columns, and<br />

the cell (p;k (panel) ) is the average score for the product p and the attributes k (panel) .<br />

In order to compare the results given <strong>by</strong> the experts with those given <strong>by</strong> the consumers, the two products spaces are<br />

submitted to Multiple Factor Analysis (Escofier, & Pagès, 1998). As a complement, they are also submitted to Generalized<br />

Procrustes Analysis (Gower, 1975). To do these panel comparisons, a complete table, which is the juxtaposition of the two<br />

panel’s sub tables, is created.<br />

4.1. Expert products’ space<br />

This space shows different clusters of products (Figure 4):<br />

• the first dimension (64.21% of the total inertia), opposes the products Pleasures, J’Adore (ET and EP) (high<br />

intensity ratings in Notes Florales, Vert, Agrume, Fraîcheur Marine, Fruité) to Aromatics Elixir, Shalimar and<br />

Angel (high intensity ratings in Épicé, Oriental, Capiteux, Enveloppant);<br />

• the second dimension (21.86%) opposes Aromatics Elixir and Shalimar (high intensity ratings in Boisé) to<br />

Lolita Lempicka and Angel (high intensity ratings in Vanille, Gourmand).<br />

231


How reliable are the consumers?<br />

Comparison of sensory profiles from consumers and experts<br />

Figure 4: Product space (left, a) and variables’ representation (right, b) for the experts.<br />

4.2. Consumer products’ space<br />

This space also shows different clusters of products (Figure 5):<br />

• the first dimension (68.29% of the total inertia), opposes the products J’Adore (ET and EP) and Pleasures<br />

(high intensity ratings in Citrus, Sweet Fruit, Freshness, Green, Jasmine, Rose, Fresh Lemon) to Angel,<br />

Shalimar and Aromatics Elixir (high intensity ratings in Nutty, Animal, Musk, Incense, Leather, Woody, Earthy,<br />

Spicy, Intense);<br />

• the second dimension (17.97%) opposes Aromatics Elixir (high intensity ratings in Intensity) to Lolita<br />

Lempicka (high intensity ratings in Vanilla, Honey, Caramel, Anis).<br />

Figure 5: Product space (left, a) and variables’ representation (right, b) for the consumers.<br />

4.3. Stability of the product spaces<br />

<strong>The</strong> significance of the consumer product space is measured using a permutation test (Wakeling, Raats, & MacFie,<br />

1991). For each consumer, the products are redistributed randomly: the configuration for each consumer is kept identical,<br />

but the names of the products are reorganized. Next, new average products table over consumers data are computed and<br />

submitted to a PCA. <strong>The</strong> percentage accounted for the two first dimensions is extracted. This methodology is repeated<br />

many times (in practice 100 times) and the distribution of the percentage accounted for the first plan of the PCA is drawn. If<br />

the percentage of our first plan (68.29+17.97=86.26%) is in the 5% upper limit of this distribution, then we can conclude<br />

that the PCA map is significant for the consumers.<br />

232


7. Annexes<br />

This simulation showed that the consumers’ product space is highly significant, as any simulation can get a percentage<br />

of inertia on the first plan higher than 57.04% (Figure 6). In our case, the variance explained <strong>by</strong> the first dimension only is<br />

higher than this value (68.29%). <strong>The</strong> permutation test, performed for the experts’ product space, shows similar results.<br />

Figure 6: Distribution of the percentage of inertia explained <strong>by</strong> the first PCA plan obtained from permutation tests for the<br />

consumer data.<br />

4.4. Products’ spaces comparisons<br />

<strong>The</strong> comparison of the two products’ spaces can be treated as a multi‐block analysis, as for example Generalized<br />

Procrustes Analysis (GPA), Multiple Factor Analysis (MFA), Common Components and Specific Weights Analysis (CCSWA)<br />

(Qannari, Wakeling, Courcoux, & MacFie, 2000) or STATIS (Lavit, Escoufier, Sabatier, & Traissac, 1994). <strong>The</strong> choice was<br />

made to compare them through MFA. As a complement, they are also compared through GPA.<br />

<strong>The</strong> comparison of the expert and consumer product spaces through MFA is shown Figure 7. It shows that these two<br />

products’ spaces are really close, not to say identical. <strong>The</strong> RV coefficient (Escoufier, 1973) calculated between the two<br />

configurations is 0.87. <strong>The</strong> high relation between these two spaces is confirmed <strong>by</strong> GPA (the similarity coefficient is equal to<br />

0.93), which shows similar results as MFA (therefore the GPA results are not shown).<br />

Figure 7: Comparisons of the expert and the consumer product spaces through MFA: partial points representation (left, a)<br />

and variables’ representation (right, b).<br />

233


How reliable are the consumers?<br />

Comparison of sensory profiles from consumers and experts<br />

<strong>The</strong> MFA partial points’ representation shows that the products with the more variability are Lolita Lempicka, Shalimar<br />

(the expert panel discriminates these products better in the second dimension) and Angel (the consumer panel shows a<br />

better discrimination for this product in the first dimension). Concerning the description of the products, the variables’<br />

representation shows high correlations between the equivalent attributes (i.e. Fraîcheur Marine and Freshness; Épicé and<br />

Spicy; Vanille and Vanilla). <strong>The</strong> comparison of the attributes spicy and épicé (Figure 8a) confirms this statement (correlation<br />

= 0.97). Nevertheless, a disagreement between both panels for some attributes such as boisé and woody (Figure 8b) is<br />

observed. In this particular case, the disagreement is clearly due to the product Angel which is described as intense <strong>by</strong> the<br />

consumers, and as not intense <strong>by</strong> the experts. Despite this disagreement, the correlation between both panels is high<br />

(correlation = 0.67), which shows that the disagreement is minimal and concerns only one product. In conclusion, no clear<br />

disagreement, resulting in non significant or negative correlation, between the two panels is observed.<br />

Figure 8: Comparison of the attributes Epicé/Spicy (left, a) and Boisé/Woody (right, b).<br />

4.5. Panels’ comparison through the confidence ellipses technique<br />

<strong>The</strong> confidence ellipses technique (Husson, Le Dien, & Pagès, 2005; Pagès, & Husson, 2005) enables creation of<br />

graphical confidence intervals around the products. It can also be used to compare the profiles provided <strong>by</strong> different panels<br />

(Lê, Pagès, & Husson, 2008). <strong>The</strong>se confidence ellipses have two important properties:<br />

• if two ellipses are superimposed, the two corresponding products are not significantly different;<br />

• the size of the ellipses is related to the variability existing around the corresponding products: the bigger the<br />

size, the more variability.<br />

With respect to the MFA partial points representation, one ellipse per product and per panel can be estimated. In this<br />

example, 24 ellipses are constructed (Figure 9). It enables comparison of a given product for the two different panels (same<br />

color), or different products within a panel (same type of line). <strong>The</strong> confidence ellipses are accompanied with a Hotelling T 2<br />

test (Table 4), which provides a p‐value for each pair of products.<br />

Figure 9: Confidence ellipses (at 95%) for the comparison of the two different panels.<br />

234


7. Annexes<br />

By Panel<br />

Expert Angel<br />

Aromatics<br />

Coco J’Adore J’Adore<br />

Lolita<br />

Pure<br />

Chanel N°5 Cinema<br />

Elixir<br />

M elle<br />

L’Instant<br />

Pleasures<br />

(EP) (ET)<br />

Lempicka<br />

Poison<br />

Shalimar<br />

Angel 1.00<br />

Aromatics<br />

Elixir<br />

0.00 1.00<br />

Chanel<br />

N°5<br />

0.00 0.00 1.00<br />

Cinema 0.00 0.00 0.00 1.00<br />

Coco M elle 0.00 0.00 0.00 0.03 1.00<br />

J’Adore<br />

(EP)<br />

0.00 0.00 0.00 0.00 0.03 1.00<br />

J’Adore<br />

(ET)<br />

0.00 0.00 0.00 0.00 0.28 0.36 1.00<br />

L’Instant 0.00 0.00 0.00 0.57 0.07 0.00 0.00 1.00<br />

Lolita<br />

Lempicka<br />

0.03 0.00 0.00 0.00 0.00 0.00 0.00 0.00 1.00<br />

Pleasures 0.00 0.00 0.00 0.00 0.00 0.25 0.05 0.00 0.00 1.00<br />

Pure<br />

Poison<br />

0.00 0.00 0.00 0.00 0.29 0.00 0.05 0.02 0.00 0.00 1.00<br />

Shalimar 0.00 0.75 0.10 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 1.00<br />

Consumer Angel<br />

Aromatics<br />

Coco J’Adore J’Adore<br />

Lolita<br />

Pure<br />

Chanel N°5 Cinema<br />

Elixir<br />

M elle<br />

L’Instant<br />

Pleasures<br />

(EP) (ET)<br />

Lempicka<br />

Poison<br />

Shalimar<br />

Angel 1.00<br />

Aromatics<br />

Elixir<br />

0.00 1.00<br />

Chanel<br />

N°5<br />

0.00 0.00 1.00<br />

Cinema 0.00 0.00 0.00 1.00<br />

Coco M elle 0.00 0.00 0.00 0.00 1.00<br />

J’Adore<br />

(EP)<br />

0.00 0.00 0.00 0.00 0.00 1.00<br />

J’Adore<br />

(ET)<br />

0.00 0.00 0.00 0.00 0.00 0.79 1.00<br />

L’Instant 0.00 0.00 0.00 0.82 0.00 0.00 0.00 1.00<br />

Lolita<br />

Lempicka<br />

0.00 0.00 0.00 0.09 0.00 0.00 0.00 0.28 1.00<br />

Pleasures 0.00 0.00 0.00 0.00 0.08 0.29 0.32 0.00 0.00 1.00<br />

Pure<br />

Poison<br />

0.00 0.00 0.00 0.00 0.96 0.00 0.00 0.00 0.00 0.06 1.00<br />

Shalimar 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 1.00<br />

By Product<br />

Angel Expert Consumer J’Adore (ET) Expert Consumer Coco M elle Expert Consumer<br />

Expert 1.00 Expert 1.00 Expert 1.00<br />

Consumer 0.57 1.00 Consumer 0.80 1.00 Consumer 0.56 1.00<br />

Aromatics Elixir Expert Consumer L’Instant Expert Consumer J’Adore (EP) Expert Consumer<br />

Expert 1.00 Expert 1.00 Expert 1.00<br />

Consumer 0.88 1.00 Consumer 0.94 1.00 Consumer 0.88 1.00<br />

Chanel N°5 Expert Consumer<br />

Lolita<br />

Lempicka<br />

Expert Consumer Pure Poison Expert Consumer<br />

Expert 1.00 Expert 1.00 Expert 1.00<br />

Consumer 0.45 1.00 Consumer 0.64 1.00 Consumer 0.69 1.00<br />

Cinema Expert Consumer Pleasures Expert Consumer Shalimar Expert Consumer<br />

Expert 1.00 Expert 1.00 Expert 1.00<br />

Consumer 0.96 1.00 Consumer 0.52 1.00 Consumer 0.41 1.00<br />

Table 4: P‐values obtained from the Hotelling T 2 test associated to the confidence ellipses.<br />

This analysis shows:<br />

• overall, some products are clearly different (i.e. Angel and Pleasures) while some others are not (i.e. Coco<br />

Mademoiselle and Pure Poison);<br />

• for each product, the two confidence ellipses related to the two panels are always superimposed: the<br />

products are not significantly different from one panel to another. This is confirmed <strong>by</strong> the p‐values obtained<br />

from the Hotelling T² test shown Table 4;<br />

• within a product, the two ellipses related to the two different panels have the same size: the higher amount<br />

of consumers compensates their higher variability;<br />

• within the panels, pair comparisons of products show differences: the expert panel is able to discriminate<br />

88% of the pairs while the consumers are able to discriminate 86% of the pairs. Moreover, some non<br />

significant pairs are common to both panels (i.e. Cinema and L’Instant), while some other are specific for one<br />

panel (i.e. J’Adore (ET) and Pleasures, or Aromatics Elixir and Shalimar).<br />

235


How reliable are the consumers?<br />

Comparison of sensory profiles from consumers and experts<br />

5. Conclusions and comments<br />

Both panels are similar in terms of discriminatory ability and reproducibility. By looking at the pair comparisons given<br />

<strong>by</strong> the confidence ellipses, the results are close, even though some specificity for each panel can be observed. In terms of<br />

panelists’ consensus, the experts show more consistencies than the consumers: this might be due to the fact that they have<br />

a better knowledge about this type of product (through their experience and the training sessions). Moreover, they defined<br />

their own list of attributes (for the experts, the attributes they were not able to recognize were removed while for the<br />

consumers, all attributes were imposed), and the experts received additional training on the most difficult ones.<br />

Nevertheless, the consumers “created” a similar product space as the experts. A final difference between consumers and<br />

experts resides in the variability of the results: as the consumers are not trained, we can predict that their results show<br />

more variability. But the sizes of the confidence ellipses seem to show that the higher variability related to the consumers is<br />

compensated <strong>by</strong> the larger sample size.<br />

In this particular experiment, the performance of naïve consumers does not differ from the performance of a trained<br />

expert panel. Consumers can describe the products in a reliable and repeatable way and do not differ from the trained<br />

experts. This supports the notion that consumers can also be used for classical profiling.<br />

<strong>The</strong>re are advantages and disadvantages in using consumers for classical profiling tasks. An advantage is that they use<br />

the same vocabulary which makes data analysis a lot easier. Another advantage is that they don’t need training and can be<br />

employed at any moment in time. <strong>The</strong>y can be recruited from a specific target group for the problem at hand and also<br />

provides hedonic information. Besides that, using consumers makes it possible to obtain addition information about the<br />

ideal intensities through <strong>Ideal</strong> Profiling or JAR scaling (Van Trijp, Punter, Mickartz, & Kruithof, 2007). <strong>The</strong> acquisition of<br />

sensory, ideal and hedonic information in one test from the target group can speed up product development considerably.<br />

Compared to the custom in market research where consumers are also asked hedonic and sensory questions in a Just<br />

About Right format, the use of proper profiling has the considerable advantage that both perceived and ideal intensities can<br />

be obtained instead of a relative judgment.<br />

Disadvantages of using consumers for classical profiling is the larger variability in the ratings due to the lack of training,<br />

for that reason the sample size of consumer panels should be much larger than for experts or trained panels. According to<br />

Moskowitz (1997), the minimum base size to generate stable averages is 40 to 50 panelists per cluster of consumers. He<br />

also states that beyond 80 panelists, the average is not particularly affected <strong>by</strong> the base size. Hence, where 10 to 12 trained<br />

panelists are required, we advise from our experience the use of 80 to 100 consumers. Consumers are also not suited for<br />

day‐to‐day tests within a company or for quality control. For these instances, a trained panel is much more efficient. <strong>The</strong>re<br />

is also a limitation to the kind of attributes consumers can use: they are not able to use technical or highly specific<br />

attributes.<br />

Software<br />

<strong>The</strong> analyses were done with R 2.8.0 (R Development Core Team, 2008), with the packages SensoMineR v1.08 (Lê, &<br />

Husson, 2006) and FactoMineR v1.10 (Husson, Lê, Josse, & Mazet, 2007), and with Senstools.<br />

Acknowledgements<br />

<strong>The</strong> authors would like to thank M. Cousin, M. Penven, M. Philippe and M. Toularhoat, students in applied statistics in<br />

Agrocampus Ouest (Rennes), who managed the expert study. <strong>The</strong>y also would like to thank the reviewers for their<br />

constructive comments.<br />

References<br />

Dijksterhuis, G. (1995). Assessing panel consonance.<br />

Food Quality and Preference, 6, 7‐14.<br />

Escofier, B., & Pagès, J. (1998). Analyses factorielles<br />

simples et multiples. Paris: Dunod.<br />

Escoufier, Y. (1973). Le traitement des variables<br />

vectorielles. Biometrics, 29, 751‐760.<br />

Gazano, G., Ballay, S., Eladan, N., & Sieffermann, J.M.<br />

(2005). Flash <strong>Profile</strong> and flagrance research: using<br />

the words of the naive consumers to better grasp<br />

the perfume’s universe. In: ESOMAR Fragrance<br />

Research Conference, 15‐17 May 2005, New York,<br />

NY.<br />

Gower, J.C. (1975). Generalized procrustes analysis.<br />

Psychometrika, 20, 33‐51<br />

Earthy, P.J., MacFie, J.H., & Hedderley, D. (1997). Effect<br />

of question order on sensory perception and<br />

preference in central location trials. Journal of<br />

Sensory Studies, 12, 215‐237.<br />

236


7. Annexes<br />

Husson, F., Lê, S., Josse, J. & Mazet, J. (2007).<br />

FactoMineR : Factor Analysis and Data Mining with<br />

R. URL: http://factominer.free.fr.<br />

Husson, F., Le Dien, S., & Pagès, J. (2001). Which value<br />

can be granted to sensory profiles given <strong>by</strong><br />

consumers? Methodology and results. Food Quality<br />

and Preference, 12, 291‐296.<br />

Husson, F., Le Dien, S., & Pagès, J. (2005). Confidence<br />

ellipse for the sensory profiles obtained with<br />

principal component analysis. Food Quality and<br />

Preference, 16, 245‐250.<br />

Latreille, J., Mauger, E., Ambroisine, L., Tenehaus, M.,<br />

Vincent, M., Navarro, S. & Guinot, C. (2006).<br />

Measurement of the reliability of sensory panel<br />

performances. Food Quality and Preference, 17,<br />

369‐375.<br />

Lavit, C., Escoufier, Y., Sabatier, R., & Traissac, P. (1994).<br />

<strong>The</strong> ACT (STATIS method). Computational Statistics<br />

and Data Analysis, 18. 97‐119.<br />

Lawless, H.T., & Heymann, H. (1999). Sensory Evaluation<br />

of Food: Principles and Practices. New York: Kluwer<br />

Academic/Plenum Publishers.<br />

Lê, S. & Husson, F. (2006). SensoMineR: sensory data<br />

analysis with R. URL: http://sensominer.free.fr<br />

Lê, S., Pagès, J., & Husson, F. (2008). Methodology for<br />

the comparison of sensory profiles provided <strong>by</strong><br />

several panels: Application to a cross‐cultural study.<br />

Food, Quality and Preference, 19, 179‐184.<br />

Logic8. EyeQuestion: the web based Software for<br />

Sensory and Consumer Research.<br />

URL: http://www.logic8.nl<br />

MacFie, H.J., Bratchell, N., Greenhoff, & Vallis, L.V.<br />

(1989). Designs to balance the effect of order of<br />

presentation and first‐order carry‐over effects in<br />

hall tests. Journal of Sensory Studies, 4, 129‐148.<br />

Meilgaard, M., Civille, G.V. & Carr, B.T. (2006). <strong>The</strong><br />

Spectrum TM Descriptive Analysis Method. In Sensory<br />

evaluation techniques (4 th ed., pp 189‐253). CRC<br />

Press.<br />

Moskowitz, H.R. (1996). Experts versus Consumers: a<br />

comparison. Journal of Sensory Studies, 11, 19‐37.<br />

Moskowitz, H.R. (1997). Base size in product testing: a<br />

psychophysical viewpoint and analysis. Food Quality<br />

and Preference, 8, 247‐255.<br />

Nestrud, M.A. & Lawless, H.T. (2008). Perceptual<br />

mapping of citrus juices using projective mapping<br />

and profiling data from culinary professionals and<br />

consumers. Food Quality and Preference, 19, 431‐<br />

438.<br />

Pagès, J., & Husson, F. (2005). Multiple factor analysis<br />

with confidence ellipses: a methodology to study<br />

the relationships between sensory and instrumental<br />

data. Journal of Chemometrics, 19, 138‐144.<br />

Perrin, L., Symoneaux, R., Maître, I., Asselin, C., Jourjon,<br />

F. & Pagès, J. (2008). Comparison of three sensory<br />

methods for use with the Napping ® procedure: Case<br />

of ten wines from Loire valley. Food Quality and<br />

Preference, 19, 1‐11.<br />

Qannari, E.M., Wakeling, I.N., Courcoux, P., & MacFie,<br />

H.J. (2000). Defining the underlying sensory<br />

dimensions. Food Quality and Preference, 11, 151‐<br />

154.<br />

R Development Core Team (2008). R: A language and<br />

environment for statistical computing. R Foundation<br />

for Statistical Computing, Vienna, Austria. ISBN 3‐<br />

900051‐07‐0, URL http://www.R‐project.org<br />

Sieffermann, J.M. (2000). Le profil Flash‐un outil rapide<br />

et innovant d’évaluation sensorielle descriptive. In<br />

AGORAL 2000, XIIèmes rencontres "L’innovation : de<br />

l’idée au succès" (pp. 335‐340), Montpellier, France.<br />

Siefferemann, J.M. (2002). Flash profiling. A new method<br />

of sensory descriptive analysis. In AIFST 35 th<br />

Convention, July 21‐24, Sidney, Australia.<br />

Stone, H., & Sidel, J.L. (1993). Sensory evaluation<br />

practices. California: Academic Press<br />

Stone, H., Sidel, J., Oliver, S., Woosley, A. & Singleton,<br />

R.C. (1974). Sensory evaluation <strong>by</strong> quantitative<br />

descriptive analysis. Food Technology, 28, 24‐34.<br />

Van Trijp, H.C.M., Punter, P.H., Mickartz, F. & Kruithof, L.<br />

(2007). <strong>The</strong> quest for the ideal product: Comparing<br />

different methods and approaches. Food Quality<br />

and Preference, 18, 729‐740.<br />

Wakeling, I.N, Raats, M.M. & MacFie, H.J.H. (1993). A<br />

new significance test for consensus in Generalized<br />

Procrustes Analysis. Journal of Sensory Studies, 7,<br />

91‐96.<br />

Williams, A.A. & Langron, S.P. (1984). <strong>The</strong> use of freechoice<br />

profiling for the evaluation of commercial<br />

ports. Journal of the Science of Food and<br />

Agriculture, 35, 558‐568.<br />

237


7.2. Implementation in R


7. Annexes<br />

7.2.1. <strong>The</strong> R‐Project and SensoMineR<br />

R (R development Core Team, 2011) is a free software environment for statistical computing and graphics.<br />

For more information, please look at http://www.r‐project.org/. This software environment works with<br />

packages, group of programs developed <strong>by</strong> R‐users and made freely available through the CRAN<br />

(Comprehensive R Archive Network). Among the large amount of packages providing all types of analyses<br />

(general statistics, univariate and multivariate analyses, etc.) dedicated to all kind of data (genetics, ecology,<br />

etc.), two packages can be mentioned: FactorMineR (Lê, Josse, & Husson, 2008) and SensoMineR (Lê, &<br />

Husson, 2008). FactoMineR is a package dedicated to the factorial analysis in R. An extensive description can be<br />

found in Husson, Lê, and Pagès (2011). SensoMineR is a package dedicated to the analysis of sensory data in R.<br />

<strong>The</strong> methodology developed during my PhD is made available to R users. Indeed, functions were programmed<br />

in R and were added to the SensoMineR package. <strong>The</strong> main functions programmed are presented below.<br />

<strong>The</strong> functions were programed in R under the version 2.12.2 <strong>by</strong> using the following packages: agrocampus,<br />

gridBase, FactoMineR, pls, plspm and SensoMineR.<br />

Note: In the next section, the following font code is used: the names of the functions are written in bold, the<br />

options are written in italic, and the different values an option can take (when applicable) are written between<br />

“quotes”.<br />

For all this function, the table used as input should be organized according to Table 7.1.<br />

Consumer Product Attr 1 Id_Attr 1 Attr 2 … Attr. a Id_Attr a … Id_Attr A Liking<br />

1 1<br />

1 2<br />

… …<br />

1 P<br />

2 1<br />

… …<br />

j p <br />

… …<br />

J<br />

P<br />

Table 7.1: Organization of the data submitted to R for analysis in R.<br />

In all the functions presented, col.p corresponds to the position of the column related to the product, col.j<br />

corresponds to the position of the column related to the consumers, and col.lik corresponds to the position of<br />

the liking variable. <strong>The</strong> option id.recogn is used to select automatically in the sequence of the variable names<br />

the ones related to the ideal attributes. In Table 7.1, the sequence to recognize the ideal attributes would be<br />

“Id_”.<br />

7.2.2. <strong>The</strong> <strong>Ideal</strong> <strong>Profile</strong> Analysis in R<br />

7.2.2.1. Measuring the influence of the tested products on the ideal ratings<br />

To measure the influence of the tested product on the ideal ratings, the function influe.ideal is used. For<br />

this function, only the choice in the type of multivariate analysis used to measure the influence is used. In this<br />

case, the parameter analysis either takes the value “PCA” (PCA on the sensory attributes and projection of the<br />

coefficient obtained from the anova as supplementary variables), or “MFA” (a Multiple Factor Analysis is then<br />

performed on each set of variable).<br />

241


Implementation in R<br />

7.2.2.2. Checking for multiple ideals<br />

To check for multiple ideals, the function multi.ideal is used. This function takes as input the dataset and<br />

some parameters for the construction of the ellipses (nbchoix, nbsimul, coord) and returns the sensory space<br />

with the projection of the averaged ideal points (averaged ideal profiles given <strong>by</strong> panel according to each<br />

tested product) and their corresponding confidence ellipses. Since the space should not be related to attributes<br />

which are not discriminating the products, a procedure based on a two‐way ANOVA cleans a prioiri the dataset.<br />

<strong>The</strong> option level.search.desc defines which attributes should be discarded: all the attributes associated to a p‐<br />

value larger than the threshold defined <strong>by</strong> level.search.desc for the product effect are removed from the<br />

analysis.<br />

As a complement, the Hotelling T 2 test is performed on all the dimension of the PCA associated to an<br />

eigenvalue larger than 1.<br />

7.2.2.3. Consistency of the ideal data<br />

Sensory consistency of the ideal data<br />

<strong>The</strong> function called senso.consist evaluates the (sensory) consistency of the ideal data at the consumer<br />

and/or panel level. <strong>The</strong> analysis to perform is selected using the option consist which takes the values “panel”,<br />

“consumer” or “both”.<br />

For the consistency at the panel level, the options available are the ones of the PCA from the package<br />

FactoMineR (scale.unit, ncp, axes). For the consistency at the consumer level, the individual ideal profiles can<br />

be corrected from the differences in the use of the scale (correct). If the dataset contains missing values, or if<br />

correlations coefficients computed generate missing values (this can be observed if the consumers give the<br />

same liking ratings to all the products), further calculation cannot be done. Hence, it is possible to replace these<br />

missing values <strong>by</strong> 0 using the option replace.na. Finally, the correlation coefficients can be represented<br />

graphically (graph=”TRUE”).<br />

Hedonic consistency of the ideal data<br />

<strong>The</strong> function hedo.consist evaluates the (hedonic) sensory of the ideal data. Depending on the<br />

family.model selected (“PLS”, “Danzart” or “PCR”), the corresponding model is used. When is used, ncp<br />

determines the number of component used for each individual model. When is used, ncp determines the<br />

number of dimensions to consider in the model. For , the ncp option is omitted since the model is<br />

predefined.<br />

Extra simulations testing for the randomness of the ideal information can be performed. To do so, the<br />

number of iteration to be performed in the permutation test needs to be assigned in nbsim. If nbsim=0,<br />

simulations are not performed (only the result for the real estimation is given)<br />

7.2.2.4. Use of the ideal data<br />

IdMap and wIdMap<br />

<strong>The</strong> <strong>Ideal</strong> Mapping and weighted <strong>Ideal</strong> Mapping techniques are programmed in a unique function: IdMap.<br />

In this function, the options related to the construction of the confidence ellipses are available (nbsimul,<br />

nbchoix, alpha, coord). <strong>The</strong> quality of the map is defined <strong>by</strong> the value of precision (the space is squared <strong>by</strong><br />

adding a horizontal and a vertical line at each precision step). It has to be noted that decreasing the value of<br />

precision increases the quality of the map, but also the calculation time. <strong>The</strong> levels of the contour plot<br />

242


7. Annexes<br />

(corresponding to specific percentage of consumers sharing a common ideal) can be defined using<br />

levels.contour. Finally, the plot can either be printed in color or in black and white <strong>by</strong> using the option color. In<br />

the case of pictures in black and white, the level of grey is directly proportional to the percentage of consumers<br />

across studies. This property is not true when using colors. Finally, the consumers can be balanced in the<br />

construction of the surface plot <strong>by</strong> applying a weight inversely proportional to the surface covered <strong>by</strong> the<br />

individual ideal ellipses. This is done <strong>by</strong> using the option cons.eq. When cons.eq=“TRUE”, the wIdMap is<br />

performed.<br />

This function is associated to another plotting function which allows recreating the IdMap or wIdMap but<br />

<strong>by</strong> zooming on the part of the space of interest. <strong>The</strong> function thus used is plot.IdMap, which takes the results<br />

of the previous function as a parameter. For this function, the zoom can be done <strong>by</strong> defining the new<br />

extremities on the dimensions using x1, x2, y1 and y2.<br />

7.2.2.5. References<br />

Husson, F., Lê, S., & Pagès, J. (2011). Exploratory Multivariate Analysis <strong>by</strong> Example Using R. A Chapman & Hall<br />

Book, CRC Press, London, UK.<br />

Lê, S., & Husson, F. (2008). SensoMineR: A package for sensory data analysis. Journal of Sensory Studies, 23, 14‐<br />

25. URL: http://sensominer.free.fr/<br />

Lê, S., Josse, J., & Husson. F. (2008). FactoMineR: An R Package for Multivariate Analysis. Journal of Statistical<br />

Software, 25(1). URL: http://factominer.free.fr/<br />

R Development Core Team (2011). R: A language and environment for statistical computing. R Foundation for<br />

Statistical Computing, Vienna, Austria. ISBN 3‐900051‐07‐0. URL: http://www.R‐project.org/<br />

243


Acknowledgements


Acknowledgments<br />

First of all, I would like to thank Pieter and Aimee for their kind help through these years spent in <strong>The</strong><br />

Netherlands. <strong>The</strong>y were always there for me, ready to help me whenever I would need it. This made my stay in<br />

the Netherlands very comfortable and very pleasant. Besides that, Pieter took me under his wing and helped<br />

me build my career <strong>by</strong> taking me in many different conferences and presenting me to a lot of people. He<br />

believed in me for this PhD and I will always be grateful for that.<br />

Second, I would like to thank Jérôme Pagès for all the time spent with me during my different stays in<br />

Rennes. All the various and very interesting discussions we had really helped me. Every moment spent with you<br />

was a new opportunity for me to learn something.<br />

In the mean time, I would like to thank Sébastien Lê for all his help, and all the good time spent together all<br />

around the world. His kindness and trust in me really encourage me keeping on moving forward and giving my<br />

best all the time. Without you as advisors, I probably would not have accepted doing a PhD.<br />

I really wish any student to have such wonderful mentors to help them build their career.<br />

<strong>The</strong>n, I would like to thank Halliday MacFie and Marc Danzart for accepting the hard task of reviewing my<br />

PhD documents, even if, for some unexpected reasons, you were not always in an “ideal situation”. Your<br />

comments really helped me improving this document. I also would like to thank Christopher Findlay for being<br />

part of my jury (president).<br />

Special thanks to all the staff from OP&P who crossed my path during my stay there. <strong>The</strong> friendly<br />

atmosphere at the office helped me relaxing when I needed it.<br />

Similarly, I also would like to thank all the staff from le Laboratoire de Mathématiques Appliquées, who<br />

always warmly welcomed me and would be available for me whenever I would require some help.<br />

Many thanks to the Logic8 team, and in particular Rignald and Gerben for welcoming me through the years<br />

and trusting me with their data analysis. By working temporarily with you, in such a wonderful atmosphere, I<br />

had the chance to learn a lot and extend my capacities.<br />

Of course, I cannot forget my family, without whom I would not be here. Many thanks to my parents,<br />

Dominique and André, and my sister and brothers: Viviane, Daniel and Antony, who where always there to<br />

support me and encourage me, even if they are not always aware of where I am precisely…We don’t see each<br />

other as much as I wish, but if “le p’ti dernier” is here now, it is mainly thanks to you! I also would like to thank<br />

Marion, for the beautiful illustration.<br />

I cannot forget all my friends from Alsace (Quentin, Ben, Nico, etc.), from Rennes (Mériem, Pierre et Eline,<br />

Audrey, Mag et Steph etc.), as well as in Holland (my basketball teams, and in particular Joost, Sas’, Bart etc.)<br />

who where always there to support me. <strong>The</strong>y understood that sometimes I was busy, but would also be there<br />

and helped me disconnect whenever I would need it.<br />

Of course, I cannot forget Betina, Virginie and Christian, my “symposium” friends who turned to be<br />

excellent “symposium spree” friends. All these official and unofficial meetings throughout Europe were an<br />

excellent way to disconnect <strong>by</strong> still having very interesting talks among “students”…let’s hope the next one will<br />

come soon again.<br />

And among all of them, special thanks to Raymond for these countless talks and encouragements during all<br />

these years. Without your enthusiasm, it would not have been the same…<br />

Finally, last but definitely not least: to B. Thanks for helping me being better every day, thanks for these<br />

countless moments together, helping me and supporting me with my PhD and with all the rest… or simply:<br />

thanks for being you……<br />

247

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!