Deliverable 5.2 - the School of Engineering and Design - Brunel ...

ICT Project 3D VIVANT– Deliverable 5.2Contract no.:248420Search & Retrieval Mechanisms &Tools4.2 BATCH SEARCH TARGETING HYPERLINKER ENVIRONMENTThe batch search method is targeting the hyperlinker environment. The goal of this feature is to preprocessan integral video sequence (the raw data database) and generate the whole set of ranked listsfor the available clickable objects in each frame. The output of the process is one XML file for eachintegral video frame. The XML file along with the corresponding video frame, are used as input to theHyperlinking environment tool, to enable the tool to present search results for the clickable objects.These results are presented to the user / editor to select possible hyperlinks of the object to anothermultimedia object or just a web URI.In the batch search approach the user should feed the engine with all the necessary raw data (integralimages, central viewpoints etc.) and segmentation masks and the appropriate XML files providedwith the segmented masks for each frame of a video sequence.The batch process is triggered by setting batchMode=yes in the configuration file and then clickingbuild index button. By selecting to process the sequence in batch mode the engine generates an all-toallsearch matrix. The engine uses all the database records, one at a time, as a query object to findsimilar objects inside the database. For each one of them a ranked list is generated that references thesimilar objects of the database.The difference in this mode is that the user does not need to select and perform search for all theintegral frames by hand. The automated process enables faster and less error prone results.Since the batch mode is used in the hyperlinker demo workflow the appropriate XML file for eachranked list is generated to be used as input to the hyperlinker environment. The XML files containinformation for the bounding boxes of the segmented objects for each frame and the search results ofeach bounding box if available. The schema serves as a general metadata exchange schema betweenthe hyperlinker environment and peripheral tools so the search results are optional for each boundingbox. Figure 16 presents the XML schema of the generated files.4/03/2013 21