Deliverable 5.2 - the School of Engineering and Design - Brunel ...

More documents

Recommendations

Info

ICT Project 3D VIVANT– Deliverable 5.2Contract no.:248420Search & Retrieval Mechanisms &ToolsFigure 14: Results window with the retrieved similar objects.In the case that one of the retrieved results is a 3D model, the user can click and select the object for adetailed examination. In this case a new window pops up and the 3D model is loaded in a 3Drendering environment. The environment provides easy 3D model manipulation using only mousegestures. Figure 15 depicts this 3D rendering window with the 3D manipulator UI appear in red lineon top of the 3D model.Figure 15: Examining the 3D model from the relevant results4/03/2013 20
ICT Project 3D VIVANT– Deliverable 5.2Contract no.:248420Search & Retrieval Mechanisms &Tools4.2 BATCH SEARCH TARGETING HYPERLINKER ENVIRONMENTThe batch search method is targeting the hyperlinker environment. The goal of this feature is to preprocessan integral video sequence (the raw data database) and generate the whole set of ranked listsfor the available clickable objects in each frame. The output of the process is one XML file for eachintegral video frame. The XML file along with the corresponding video frame, are used as input to theHyperlinking environment tool, to enable the tool to present search results for the clickable objects.These results are presented to the user / editor to select possible hyperlinks of the object to anothermultimedia object or just a web URI.In the batch search approach the user should feed the engine with all the necessary raw data (integralimages, central viewpoints etc.) and segmentation masks and the appropriate XML files providedwith the segmented masks for each frame of a video sequence.The batch process is triggered by setting batchMode=yes in the configuration file and then clickingbuild index button. By selecting to process the sequence in batch mode the engine generates an all-toallsearch matrix. The engine uses all the database records, one at a time, as a query object to findsimilar objects inside the database. For each one of them a ranked list is generated that references thesimilar objects of the database.The difference in this mode is that the user does not need to select and perform search for all theintegral frames by hand. The automated process enables faster and less error prone results.Since the batch mode is used in the hyperlinker demo workflow the appropriate XML file for eachranked list is generated to be used as input to the hyperlinker environment. The XML files containinformation for the bounding boxes of the segmented objects for each frame and the search results ofeach bounding box if available. The schema serves as a general metadata exchange schema betweenthe hyperlinker environment and peripheral tools so the search results are optional for each boundingbox. Figure 16 presents the XML schema of the generated files.4/03/2013 21
Page 1 and 2: ICT Project 3D VIVANT- Deliverable
Page 19: ICT Project 3D VIVANT- Deliverable

Deliverable 5.2 - the School of Engineering and Design - Brunel ...

You also want an ePaper? Increase the reach of your titles

Delete template?

Save as template?