11 Appendix 4 Workplan for evaluati<strong>on</strong>UABActivity S-5: Compilati<strong>on</strong> <strong>of</strong> l<strong>on</strong>g questi<strong>on</strong>nairesData obtained from l<strong>on</strong>g questi<strong>on</strong>naires <strong>on</strong> <strong>the</strong> viewers’ habits and general opini<strong>on</strong>sregarding subtitling will be compiled and processed (Spain, France, UK, Belgium, Italy,Greece and Denmark).Internal deliverable S5: report <strong>on</strong> S-5 (m<strong>on</strong>th 16)M<strong>on</strong>ths: 5-6-7-8-9-10-11-12-13-14-15-16Participants: UK; Italy; Spain; Belgium; Denmark; France; GreeceTest: Compilati<strong>on</strong> <strong>of</strong> l<strong>on</strong>g questi<strong>on</strong>nairesTeam Leader: Stavroula SokoliDisseminati<strong>on</strong>: Results to be presented at <strong>the</strong> CESyA c<strong>on</strong>ference in June 2009At this stage, a view <strong>of</strong> <strong>the</strong> (subjective) preference <strong>of</strong> viewers from different Europeancountries regarding SDH (resulting both from <strong>the</strong> tests and <strong>the</strong> l<strong>on</strong>g questi<strong>on</strong>naires) willbe emerging. The next stage is to test this empirically using eye-tracking technology.Internal milest<strong>on</strong>e 1: <str<strong>on</strong>g>Report</str<strong>on</strong>g> <strong>on</strong> <strong>the</strong> subjective preference <strong>of</strong> viewers from differentEuropean countries regarding SDH (resulting from both <strong>the</strong> tests and <strong>the</strong> l<strong>on</strong>gquesti<strong>on</strong>naires) - Participants: Spain, France, UK, Belgium, Italy, Greece and Denmark(m<strong>on</strong>th 16)Activity AD-2: Pear Stories 2Activity AD2.1: A preliminary comparis<strong>on</strong> <strong>of</strong> transcripts according to Tannen'sfeatures.Delivery <strong>of</strong> <strong>the</strong> whole corpus ga<strong>the</strong>red with <strong>the</strong> Pear Tree projects with back translati<strong>on</strong>sand analysis <strong>of</strong> <strong>the</strong> data.Disseminati<strong>on</strong>: Project setup to be presented at <strong>the</strong> Internati<strong>on</strong>al c<strong>on</strong>ference Latraducti<strong>on</strong> audiovisuelle: approches pluridisciplinaires (M<strong>on</strong>tpellier, June 2008)Activity AD2.2: An in-depth comparis<strong>on</strong> <strong>of</strong> how transcripts select and presentinformati<strong>on</strong> about <strong>the</strong> Pear Story film.Internal deliverable AD2: report (m<strong>on</strong>th 10)M<strong>on</strong>ths: 1-2-3-4-5-6-7-8-9-10Instituti<strong>on</strong>s: AllTest: analysing <strong>the</strong> recepti<strong>on</strong> <strong>of</strong> <strong>the</strong> same film by different culturesTeam leader: Andrew SalwayDisseminati<strong>on</strong>: Results to be presented at <strong>the</strong> CESyA c<strong>on</strong>ference in June 2009Page 50
WP 2.4 Implementati<strong>on</strong> <strong>of</strong> <strong>Pilot</strong> Evaluati<strong>on</strong>Data ga<strong>the</strong>red in this task will be used to identify obstacles and c<strong>on</strong>straints to <strong>the</strong>introducti<strong>on</strong> <strong>of</strong> sustainable access operati<strong>on</strong>s <strong>of</strong> a technical, organisati<strong>on</strong>al, legal,cultural and c<strong>on</strong>text-specific nature. As <strong>the</strong> evaluati<strong>on</strong> seeks to generate inputs to helpoptimise mature services, data <strong>on</strong> <strong>the</strong> effectiveness and efficiency <strong>of</strong> existing servicesbased am<strong>on</strong>gst o<strong>the</strong>r things <strong>on</strong> <strong>the</strong> outcomes <strong>of</strong> evaluati<strong>on</strong> by user groups will also becollected and collated. The deliverable here will be a draft report for each <strong>of</strong> <strong>the</strong> fourterritories <strong>of</strong> <strong>the</strong> pilot and will include generic results <strong>of</strong> relevance throughout Europe.subtitlingThe results <strong>of</strong> tests carried out with deaf, hard-<strong>of</strong>-hearing and hearing participantsacross three countries, Belgium, Spain, and Italy will be compiled. The tests will obtainviewers’ opini<strong>on</strong>s <strong>on</strong> five formal subtitling parameters: f<strong>on</strong>t, size, positi<strong>on</strong>, justificati<strong>on</strong>,character identificati<strong>on</strong>, and <strong>the</strong> use <strong>of</strong> boxes, borders, shadows, ic<strong>on</strong>s and emotic<strong>on</strong>s insubtitles. To validate <strong>the</strong> data obtained, <strong>the</strong> results <strong>of</strong> comprehensi<strong>on</strong> tests andvalidati<strong>on</strong> tests using eye-tracking technology will be collated to produce empiricalevidence <strong>of</strong> <strong>the</strong> formal subtitling parameters preferred by <strong>the</strong> viewers.The results <strong>of</strong> tests about <strong>the</strong> viewers’ comprehensi<strong>on</strong> <strong>of</strong> subtitles across sevencountries: Spain, France, Belgium, Italy, Greece, and Denmark, will be compiled. Thetests will include <strong>the</strong> viewers’ opini<strong>on</strong>s <strong>on</strong> three different subtitle formats (verbatim,standard, and adapted to sign language) and will provide data about <strong>the</strong>ircomprehensi<strong>on</strong> <strong>of</strong> <strong>the</strong> different formats.Activity S-1: Testing <strong>of</strong> formal subtitle parameters (1): LayoutTests will be carried out with Deaf, hard-<strong>of</strong>-hearing and hearing participants acrossthree countries: Spain, UK and Italy. The tests will ga<strong>the</strong>r <strong>the</strong> viewers’ opini<strong>on</strong>s <strong>on</strong> fiveformal subtitling parameters: f<strong>on</strong>t, size, positi<strong>on</strong>, justificati<strong>on</strong>, and characteridentificati<strong>on</strong>.Internal deliverable S1: report <strong>on</strong> activity S-1 and article (published by Peter Lang) <strong>on</strong>viewers' opini<strong>on</strong>s about subtitling layout (f<strong>on</strong>t, size, positi<strong>on</strong> and characteridentificati<strong>on</strong>) (M<strong>on</strong>th 5)M<strong>on</strong>ths: 1-2-3-4-5Participants: UK; Italy; SpainTest: Testing <strong>of</strong> formal subtitle parameters (1): LayoutTeam Leader: Carlo EugeniDisseminati<strong>on</strong>: Presentati<strong>on</strong>s <strong>of</strong> set-up and scope in La traducti<strong>on</strong> audiovisuelle:Approches pluridisciplinaires (M<strong>on</strong>tpellier, June 19-21).Activity S-2: Testing <strong>of</strong> formal subtitle parameters (2): LegibilityS2.1 Tests will be carried out with Deaf, hard-<strong>of</strong>-hearing and hearing participants across<strong>on</strong>e more country: Belgium. Once again, <strong>the</strong> tests will cover f<strong>on</strong>t, size, positi<strong>on</strong>,justificati<strong>on</strong> and character identificati<strong>on</strong>.S2.2. Tests will be carried out in Belgium and Spain <strong>on</strong> <strong>the</strong> use <strong>of</strong> boxes, borders andshadows in subtitles. (Spain will join this phase as a c<strong>on</strong>trol group.)Page 51