DEliverable 2.3 - the School of Engineering and Design - Brunel ...

27.12.2014 Views
ICT Project 3D VIVANT– Deliverable 2.3 Contract no.: 248420 User Acceptance Validation Plan • Sound colouration: Possible degradations of the perceived audio quality will be tested using a MUSHRA-like test. The stimuli will consist of a virtual sound source created by the playback system, a real sound source located on the same position and another virtual sound source created using stereophonic playback. Speech, noise and other audio signals known to be prone to sound colouration artefacts will be used. As the overall experience of the three stimuli will be totally different - because various playback principles are used. The test subjects will be instructed to only consider sound colouration or other notable artefacts. Therefore a training session will be needed before the actual listening test to familiarize the test subjects with the scope of the test. • Quality of localisation: Test subjects will be asked to localize virtual sound sources generated by the playback system. Again, the pointing method (#2.4.2) will be used. Both criteria will be tested from multiple listening positions to determine the size of the possible listening area of the new playback system. 4.2 INTERACTIVE EXPERIENCE There are two interactive features developed in 3D VIVANT, namely a Video Hyperlinking Environment and an Object Search and Retrieval Framework. While the first is to be used primarily by end users, the latter will only be used by professionals as part of the editing process of the video hyperlinks. 4.2.1 Video Hyperlinking Environment The object-based online video hyperlinking developed in 3D VIVANT will allow online users to interact with 3D objects in a video by clicking on them. Through clicking the hyperlinked objects users will be able to access additional content. Basic user acceptance factors can be defined as follows: • Navigation and interaction – Users will expect the navigation through the user interface to be intuitive and usable. Furthermore, the chosen method of navigation and interaction has to be suitable and effective for the display device and the content displayed. A computer mouse, as users are accustomed to, for example, on a PC would probably not be suitable for a 3D environment because it is basically a 2D input device. In addition to understanding how to interact with the service, users need to understand the navigation architecture of the service, i.e., they need to understand how to access the content they require and how to return to previous content. • Recognition of clickable objects – To be able to follow hyperlinks, users will have to click on linked objects. Thus, the user interface should provide some kind of highlighting of linked objects, which allows the users to recognise linked objects and distinguish them from other objects. At the same time, the highlights should not distract too much from the video itself. The object and highlighting will also need to be displayed for a sufficient duration to allow users enough time to interact with it. • Responsiveness - The performance of the hyperlinking system is a critical point. Users typically have high expectations with regard to responsiveness to their commands. They expect an immediate response of some sort and become irritated if this does not happen. It is, therefore, essential that the system reacts quickly enough and provides the user with some sort of instant feedback about what the system is doing and that their request is being processed or has been completed. 01.09.11 20

ICT Project 3D VIVANT– Deliverable 2.3 Contract no.: 248420 User Acceptance Validation Plan • Service acceptance – As the hyperlinking of single moving objects in a videostream is a new video service scenario, the general acceptance of such a service by users has to be validated. The acceptance issues to be considered will include: did the end-users understand the concept of the service, did it fulfil their expectations, could they imagine using it, would they recommend it to their friends, what are the perceived benefits, what did they like/dislike about it, etc. 4.2.2 Search and Retrieval Framework Another functionality that the 3D VIVANT system will support is the retrieval of objects similar to samples given by users. This functionality is expected to be used by professional rather than by endusers. Professional users will want to exploit this functionality, especially during 3D scene composition, when they want to change the scene and replace certain objects with similar ones. It might be interesting for end-users to use this functionality to surf through or retrieve content from 3D holoscopic content databases. However, in the course of the project we can consider this technology as well as the availability of 3D holoscopic content as exclusive to professional users. In 3D VIVANT, validation tests will be conducted only with professional users to consider acceptance and usability issues with respect to functionality, performance and user friendliness aspects. More precisely these are as follows: • Functionality – In this case, testing aims to validate user acceptance pertaining to whether the architecture meets user expectations in terms of functionality. It associates with the completeness that the system offers regarding the defined and implemented functions. It is focused on aspects, such as the supported content types (e.g., video, picture, 3D, 2D), search methods and metadata storage procedures, without emphasising on whether these features are fast, reliable, friendly to the user, etc. • Performance – Validation testing will also consider the performance of the different functional modules in terms of retrieval accuracy, processing power requirements, storage capacity requirements and corresponding response latency. Retrieval accuracy is the core indicator of the performance of any search engine as it can provide strong evidence about its actual usefulness and effectiveness. Retrieval accuracy reveals the capability of a search engine to discriminate between relevant and irrelevant objects with respect to the query and to present only the most relevant objects. However, it is important that a search engine not only is effective, but efficient as well. Resources are usually limited and, therefore, processing power and storage requirements are critical parameters so that a search and retrieval framework may be applied in practice and exploited by end-users. Finally, a positive decision to accept a search and retrieval framework also depends on the time required to perform a retrieval request. In case that the user searches in small multimedia databases, time is not a critical parameter. However, as multimedia databases tend to grow exponentially, it becomes obvious that fast processing and system response get more and more significant. • User friendliness – Apart from the aforementioned characteristics, which refer mainly to the technical aspects of the search and retrieval framework, validation tests will also investigate the user friendliness and usability of the user interface allowing the searching of holoscopic content. These tests will be performed in the context of the general acceptance tests regarding the user interface of the 3D VIVANT system. 01.09.11 21

Page 1 and 2: ICT Project 3D VIVANT- Deliverable









Page 19: ICT Project 3D VIVANT- Deliverable






Page 33: ICT Project 3D VIVANT- Deliverable

acceptance

holoscopic

validation

content

depth

stereoscopic

methods

deliverable

assessment

viewing

engineering

brunel

dea.brunel.ac.uk

DEliverable 2.3 - the School of Engineering and Design - Brunel ...

DEliverable 2.3 - the School of Engineering and Design - Brunel ... ... View more DEliverable 2.3 - the School of Engineering and Design - Brunel ...

Delete template?

Save as template ?

DEliverable 2.3 - the School of Engineering and Design - Brunel ... DEliverable 2.3 - the School of Engineering and Design - Brunel ...