Supporting Disaster Response and Recovery using Intelligent ...

Supporting Disaster Response and Recoveryusing Intelligent Building ModelsAziz, ZeeshanUniversity of Salford, Manchester, UKemail: z.aziz@salford.ac.ukAbstractKey challenges in existing disaster response and recovery processes in highly engineered builtenvironments arise from poor access to the right information at the right time to support criticaldecision making. The role of Building Information Modelling (BIM) technologies in supportingconstruction, operations and maintenance of a building is now well documented. This paper focuseson use of BIM-based technologies to serve the information needs during response and recoveryoperations in urban emergencies. Key literature and emerging technologies are reviewed, followed bypresentation of a conceptual architecture. First responders operating in a dynamic disaster responsesituation need immediate access to relevant information. A key challenge in effective utilisation ofBIM during disaster response and recovery is integration of such models with context of the enduser.Context specific access to virtual building models can prevent information overload orinformation starvation. The paper concludes that integration of context-awareness with BIM has thepotential to enhance building information delivery during disaster response and recovery operationsby saving valuable time and improving efficiency.Keywords: Building Information Modelling, Context Awareness, Augmented Reality

1. IntroductionMany challenges in existing disaster response and recovery processes in highly engineered builtenvironments arise from poor access to the right information at the right time to support criticaldecision making, lack of co-ordination and poor communications (Son et al., 2008). Buildingdrawings and operational data is often held in unstructured format and in disparate platforms (e.g. 2DCAD drawings, hand sketches of as-built conditions, 3 Dimensional (3D) building models, buildingphotographs, satellite imagery, spreadsheets, Laser point clouds indicating as-built building). Suchinformation is often difficult to access or manage, resulting in considerable time being spent to accessand retrieve relevant information. Despite recent technological improvements, managing a seamlessinformation flow between multiple stakeholders involved in disaster response and recovery (e.g. localauthorities, residents, professional engineers, communities, contractors, etc.) is still a key challengeand often result in poor management of dynamic work demand resulting from disasters. Constructionwork in recovery phase is often characterised by errors, rework, lack of understanding of the projectand processes, and conflicts. Rapid and convenient access to relevant building/infrastructureinformation, through improved awareness of user context can lead to significant cost and timesavings due to the accuracy and immediacy with which relevant building information can be madeavailable (Aziz et al., 2005).In recent years, the use of parametric modelling based Building Information Models (BIM) and theirpotential to work as a single repository of building data throughout the life-cycle of a buildingfacilities has been established (Building Smart Alliance, 2011; Eastman et al., 2008; Anumba &Aziz., 2008). A variety of BIM-based applications have been documented in literature that allow foruse of virtual building models as a single information repository for supporting design, constructionand operations. In such applications, project data, building plans, technical drawings, 3Dvisualizations, Quantity take-offs, simulations etc are directly derived from the virtual buildingmodel. Such data and information stored within the virtual building model can be used to supportcritical decision making during disaster response and recovery operations. For instance, in large scaledisasters where several thousand buildings may be affected, developing an accurate picture of thescale of disaster requires a lot of time and personnel. Several important decisions related to resourceallocation and recovery/ redevelopment strategies after large scale disasters rely heavily uponindividual building assessments. Several responders trained in structural assessment, hazardassessment, fire-fighting, etc. collaborate at the disaster site to ensure safety of victims and recoveryfrom disaster. Information about status of search and rescue operations at every affected building andthe evaluation of the possibilities of further collapse are critical to an effective collaboration. Also,information from multiple sources need to be collated to ensure speedy recovery of building to itsnormal usage. Virtual building models can serve as a critical information resource to satisfy suchinformation needs. For instance, first responders can have immediate access to accurate floor plansand detailed spatial information of various facilities within a building. Time is of essence duringdisaster response operations and information availability such as spatial location of water, gas andelectric shut-offs, fire extinguishing equipment and fire exit routes can greatly facilitate responseoperations. Many municipalities are investigating the potential of using Building InformationModelling technologies to make their ability to make their ability to access building emergency

equipment faster (Hardin, 2008). Likewise, during disaster recovery operations, virtual buildingmodels can play a key role in enhancing communication and co-ordination between multiple projectstakeholders including local councils, regulatory bodies, contractors, fabricators, project managers ,etc. For instance, using a visual 3D interface, off-site manufacturers and fabricators can betterperceive the design intent, resulting in reduction in the number of iterations involved in designapprovals. Likewise, the visual nature of the prototypes could facilitate on-site production processes.Ability to integrate models from multiple disciplines allows for better trade co-ordination and moreefficient work flows.A key challenge in effective utilisation of virtual building models during disaster response andrecovery is integration of such models with context of the end-user (e.g. first responder, fire men,civil engineer, etc). Operational context of a person operating in a dynamic disaster response situationis much different than from an office based worker (e.g. a facilities or buildings operation manger).Context specific access to virtual building models can prevent information overload (where somepeople are provided with more information than they need) and information starvation (where thebuilding model does not provide other people with the information that they do need). Thus, theoptimal utilisation of virtual building models to support disaster response and recovery is functionallydependant on the perspective of the end user, which changes from time to time in line with changesresulting from dynamic work load as completer scale of disaster unfolds and the user context. Thus,the effective use of virtual building models in support of building operations need to take intoaccount the context of the user (such as having a knowledge of who they are, where they are located,what tasks they are involved in, what stages/aspects of the model they are interested in or responsiblefor, etc.) and to deliver the relevant information on an as-needed basis. Thus, virtual building modelcan serve the information needs of professionals from multiple disciplines to ensure an effective, wellco-ordinated and integrated response to challenges to built environment posed by disasters.Also, given the mobile and dynamic nature of disaster response and recovery processes, there is aneed to integrate advances in mobile computing in the work environment to provide user-friendly andmobile access to building model. Using commercially available widescreen mobile devices such asiPhone or Google android based HTCs, it is possible to access full design libraries, constructiondocuments and zoom in and out of drawings and Virtual Building Models, for the finest detail or abroader overview. Also, mobile Augmented Reality (AR) applications have begun to be developedfor smart phones. This enable a display of augmented information such as a 3D model, overlaid on alive camera view of the mobile device. Users can define virtual tags to identify key locations basedon their personal interest using commercially available augmented reality browsers.This paper investigates the scope and potential for integrating intelligent context-aware interfaceswith sophisticated Virtual Building Models, to provide highly relevant and context-specific buildinginformation during disaster response and recovery operations. Rest of the paper is organised asbelow. The following Section reviews key enabling technologies and relevant literature. This is usedas a basis to present a System Architecture. Conclusions are drawn about the possible future impactof emerging building modelling related technologies to ensure safe and secure built environment.

2. Review of Enabling Technologies and Related WorkBuilding Information Modelling (BIM) is a new approach to design, construction, and facilitymanagement in which a digital model of the building is used to facilitate the exchange andinteroperability of information in digital format. Currently a variety of software vendors supportproduction of virtual building models including Autodesk Revit, Bentley Architecture and Structures,VicoSoftware Constructor and Graphisoft ArchiCAD. Also, a large number of software packages areavailable for further analysis of virtual building models, such as structural analysis, checking quantitytake-off and cost estimation, acoustics and energy analysis, code compliance checking etc. The abilityto manipulate and analyse data stored in the BIM is one key factor distinguishing it from use oftraditional 3D modelling software, which are used primarily for illustration purposes. During urbansearch and rescue operations there is little time for a rigorous structural analysis and to decide theremaining stability of the building and/or the temporally shoring measures required (McGuigan,2002). Availability of an analytical building model, that can server as a single repository of buildingrelated information, could greatly facilitate response and recovery efforts.In disaster response and recovery scenarios, it is highly probable that virtual building model does notexist. In such situations, it is important to make use of rapid 3D building modelling approaches toprovide a building model that can serve as a single repository of information to coordinate recoveryefforts. Recent approaches being developed by major software vendors including Autodesk andMicrosoft, allow for the use of consumer grade camera to develop rich 3D point clouds, that can befurther refined to rapidly develop 3D building models. Various web-services such as MicrosoftPhotsynth (2011) and Autodesk Photofly (2011) allow a simple workflow of point, shoot, upload andgenerate 3D point cloud using computer vision and photogrammtry approaches. This allowsgeometric extraction of 3D building models from digital photographs using power of the cloudcomputing. Once the digital photographs of buildings have been updated, the web-services extractkey feature of the building, match key features and help reconstruct 3D point clouds that can beimported to AutoCAD for model building. Traditionally such model production was only possibleusing 3D laser scanner, which are expensive items costing on average between $50,000 to $100,000.High cost, coupled with intense on-site data processing requirements make broad deployment of suchtechnologies to capture post-disaster building damage difficult. 3D laser scanning technologies havepreviously been employed to capture real-time building information during the response phase ofdisasters. Captured cloud data is used to generate a building model (an analytical 3D model or finiteelement model). A key limitation of using 3D laser scanners includes prohibitive cost of LaserScanners, heavy demand of computer processing requirements to manage the large quantities of data,and also the time-consuming process of its scanning. Various solutions available in commercialdomain provide rapid response mapping using techniques such as photogrammetry, LiDAR andThermal Mapping.Figure 1 illustrates one such rapid modelling approach popularised by Autodesk. The first step is tocapture good quality building images using digital cameras or using satellite imagery. Digital imagesare calibrated to 3D wire-frame model using a user-defined co-ordinate system. Exterior envelope ofthe building is modelled on top of the calibrated geometry to produce an accurate 3D building model,taking into account shape, size, location and orientation of the building. As 3D models have an

analytical basis, multiple disciplines can analyse and simulate to explore different what-if scenariosand see the detailed impact of various decision options. Using building automation systems, variousbuilding control sensors, metres can be integrated with Building Model to develop a comprehensiveoperating picture of the building. Such an networked building model could provide to be a useful toolfor managing building operations and invaluable source of information for disaster preparedness,response and recovery.Figure 1: Auto-desk approach to rapid modelling (Autodesk, 2011)Integration of context-aware interfaces with building information models has the potential to enhancecommunications and collaboration by providing a mechanism to determine building relatedinformation relevant to a particular context. Context-aware computing involves the use ofenvironmental characteristics such as the user’s location, time, identity, profile and activity to informthe computing device so that it may provide information to the user that is relevant to the currentcontext (Burrell and Gay, 2001). Pashtan (2005) described four key partitions of context parameters,including user static context (includes user profile, user interests, user preferences), user dynamiccontext (includes user location, user current task, and vicinity to other people or objects), networkconnectivity (includes network characteristics, mobile terminal capabilities, available bandwidth andquality of service) and environmental context (includes time of day, noise, weather, etc.).Augmented Reality is a relatively new form of Context-Aware Interface that allows placing the userin a real environment augmented with additional information generated by computer. Using ARbasedtechnologies, virtual models of a building can be superimposed on display of a real-worldimage in real time using different types of display devices such as smart phones, tablet computers or3D stereographic head mounted displays. This can support delivery of highly specific data andinformation to users to support site-based workflows and processes. Recent developments in mobileprocessing units, camera quality, different sensors, wireless infrastructure and tracking technologyenable AR applications to be implemented even in demanding mobile environments such as disasterresponse and recovery. Many of the commercially available Apple and Android smart-phonescurrently support augmented reality applications such as facial recognition, assisted direction and ARtourism, using compass, camera, and GPS system. Some of the recent research projects have exploreduse of such technologies to support construction processes. Webster (1996) has designed an ARbased system to guide construction workers in the space frame structure assembly. Schwald andLaval (2003) focused on supporting technicians working on complex maintenance operations andproviding hands-on training using equipment in its natural environment. Junghanns et al (2008)developed a location-aware handheld augmented reality to assist utilities field-personnel. VTT-basedAR4BC project developed a prototype application to provide user mobile view of construction site

augmented with BIM and feedback from mobile device back to BIM. Shen et al (2010) presented aframework to support concurrent collaborative product design among members of a multidisciplinaryteam, by highlighting how AR environments allows multiple users to interact andcomment, thus achieving higher levels of collaboration. In recent years, the AR technology has alsobeen popularised by the launch of XBOX 360, which includes a motion tracking sensor, capable oftracking gestures and user location and body shapes. Different prototype applications have recentlybeen developed using a combination of the Augmented Reality (using Kinetic sensors) and VRglasses to provide users with full immersion of virtual environment.3. System ArchitectureThis Section provides details of a tiered architecture that integrates the context awareness (of bothusers and the real-time post-disaster situation) with Virtual Building Model as a key repository ofbuilding data, in order to ensure the delivery of relevant information for effective response andrecovery operations. The client layer provides users with system access. A variety of wireless devicesare supported. The integration of mobile augmented reality based context-awareness with VirtualBuilding Models, building sensors, utility meters etc. will provide users with relevant building dataand information. Standarised context-parameters can be incorporated in such a system, to effectivelyserve information needs during normal operations and during response and recovery work.Integration of context with virtual building model can be done at several levels. Firstly, the contextcould relate to the user’s profile (e.g. Facilities Manager, Fire men, Civil Engineer, First responder,etc.) to enable the navigation of the virtual building model based on highlighting and visualizingfeatures of the model that are relevant to that particular context. For example, a ‘walk-through’ of agiven floor could highlight the structural elements to the structural engineer and the finishes to thearchitect. A more sophisticated implementation of context awareness with virtual building modelwould enable embedding within the virtual building model of appropriate context triggers that enableuser’s context to be captured and interpreted in real time and the visual representation to be modifiedto reflect any changes.The Access Tier provides the vital communication link between the wireless front end and wiredback bone. Both push and pull modes of data provisioning are supported. Positioning Tier helps inreal-time location determination. In a recent implementation, the author used a WLAN-based locationtracking system for integrating context information with other information provisioning mechanisms.A key benefit of using WLAN-based positioning system is that it does not require additionalinfrastructure provided good accuracy could be achieved through existing WLAN deployment. Also,WLAN provided considerably higher bandwidth of up to 54 mbps enough to support data, voicecommunications and tracking features. In the implementation, user context was used as a filteringmechanism to deliver relevant applications and services to users. The WLAN-based tracking systemfrom Ekahau (2011) was used to track user location. This system makes use of the signal strength todetermine the actual position of the target device, and then reports the tag coordinates as well as area,

direction, and speed within the WLAN coverage area. It consisted of several software componentsincluding a client component which is a small program that runs on a WLAN enabled client device(PC laptop, PDAs, Wi-Fi Tag, etc.) and send positioning information to the server, a positioningengine that runs on a server and calculates the client device location. It provides location coordinatesand relevant information to other applications through a Java-based API. A manager application wasused for recording the calibration data for a positioning model, trackingContext broker enable tracking changes in context and trigger the appropriate response from thevirtual prototype by retrieving relevant data and/or invoking any required Web Service. Ontologieshelp to provide a common understanding of key concepts such that reasoning can be undertakenbased on the interpreted context and intelligent action taken. This understanding of the semanticsbetween engineering applications and services is critical for ensuring interoperability. For example,as the user moves from exploring the model from a design point of view to a constructionperspective, the information provided could be modified to reflect the relationship between the ‘asbuilt’facility and the virtual model. There is also considerable scope to make linkages betweencontext triggers in the physical world and those in the virtual environment. Thus, contextual changesin the physical environment can trigger modifications to the virtual model and vice-versa. Thisrequires novel and effective mechanisms for bi-directional consistency evaluations, with the degree towhich automatic updates to the model would be allowed explicitly defined by the project team. Giventhe recent push towards use of virtual building models throughout the project lifecycle, enhancedcapabilities for interoperation with a variety of engineering services and applications are essential forintelligent collaboration and information exchange within the construction supply chain.4. Discussion and ConclusionsThis paper concludes that integration of context-aware technologies with virtual building prototypeshas the potential to enhance the building related information support during disaster response andrecovery operationg, thereby, saving valuable time and improving efficiency and productivity. Byenabling a two way information flow between disaster reponders and Virtual Building Models usingnovel interfaces, the potential gains from using a single building source of information are enormous.For instance, during building emergency response operations, fire-fighters can access floor planlayouts directly from BIM database. Using AR-based context-aware access, fire fighters can locateprecise position for locating fire shutoff points, fire hose cabinets, and extinguishers. Availability ofsuch filtered and precise information could facilitate decision making and potentially could savelives. By superimposing VP data on real-world imagery using Augmented Reality tools, multipleapplication scenarios are possible. For instance, using AR-based displays designers can exploremultiple options and what-if scenarios to capture critical feedback. During the construction phase forinstance, the relevant views from the design models can be spatially aligned and super-imposed onthe construction site image or video to support various construction site based processes. A visualfeedback system linked to the virtual building model can be developed, to include photographs, timestampsand audio-video annotations. Intuitive and visual nature of the process has the potential toimprove the workflow and processes. Such AR-based interfaces can effectively be used during theFacilities Management stage. The ability to super-impose data from the building model on the

uilding image/video can effectively be used to support building maintenance and operations staff.For instance, building services providers can see the fixtures on ceilings without actually opening upthe ceiling. Effective visualisation and availability of relevant information can be used to enhanceworkflows during the design and construction process. However, there is a need to address keychallenges related to technological complexity, cost, user needs and inter-operability. A keychallenge is effective integration of various technology enabling elements with methodological,cultural, social and organisational aspects specific to the construction industry. Also, to encouragewidespread adoption, there is a need for successful industrial case studies. There are numerouspotential benefits in providing a context-aware virtual prototyping infrastructure for the constructionindustry and it needs to make the necessary investments to realise these.REFERENCES:Anumba C.J. and Aziz, Z. (2008) "Context Aware Virtual Prototyping" in Virtual Futures for Design,Construction and Procurement, Peter S. Brandon (Editor), Tuba Kocatürk (Editor), Chapter 12,Blackwell Science, Oxford, 2008, ISBN 978-1-4051-7024-6, pp: 147-157.Aziz, Z. (2005) “Context Aware Information Delivery for Mobile Construction Workers”, PhDThesis, Loughborough UniversityAziz, Z., Anumba, A and Peña-Mora, F. (2009) “A Road-Map To Personalized Context-AwareServices Delivery In Construction”, Journal of Information Technology in Construction (IT-CON),Special Issue on Next Generation Construction IT: Technology Foresight, Future Studies, Roadmapping,and Scenario Planning, ISSN 1874-4753 pp. 461-472 [Online]http://www.itcon.org/2009/30Building Smart Alliance (2011) (available online http://www.buildingsmartalliance.org/ [accessedon 29/04/2011])Burrell, J. & Gay, K. (2001): „Collectively Defining Context in a Mobile, Networked ComputingEnvironment,‟ Short talk summary in CHI 2001 Extended abstracts, May 2001.Eastman, C., Teicholz, P., Sacks, R. and Liston, K. (2008) “BIM Handbook: A Guide to BuildingInformation Modeling for Owners, Managers, Designers, Engineers and Contractors”, John Wiley &Sons, Inc., New Jersey.Ekahau (2011). W-LAN based Positioning Engine. (available online http://www.ekahau.com[accessed on 29/04/2011])Hardin, B. (2008). “BIM and Construction Management”, Sybex.

Junghanns, S., Schall, G. & Schmalstieg, D. (2008): Employing location-aware handheld augmentedreality to assist utilities field personnel LBS 2008 Tele-Cartography, 5th International Symposium onLBS and TeleCartography, 26 - 28 November 2008, Salzburg, Austria.McGuigan, D. M. (2002) Urban Search and Rescue and the role of the engineer. M.S. thesis,University of Canterbury, New ZealandPashtan, A. (2005): Mobile Web Services. Cambridge University Press.Photofly (2011) (available online http://labs.autodesk.com/technologies/photofly/ [accessed on29/04/2011])Schwald, B., & de Laval, B. (2003). An Augmented Reality System for Training and Assistance toMaintenance in the Industrial Context. Journal of WSCG‟2003, 11 (3), 425-43Shen, Y., Ong, S.K., Nee, A.Y.C., (2010) Augmented reality for collaborative product design anddevelopment, Department of Mechanical Engineering, National University of Singapore.Son, J., Aziz, Z., and Peña-Mora, F. (2008) “Supporting Collaborative Decision Making In DisasterResponse And Recovery Through Improved Situation Awareness”, Special Issue of Structural Surveyon the role of the built environment professional in disaster management, Vol 26, Issue 5, Page: 411-425, ISSN:0263-080X.Webster, A., Feiner, S., MacIntyre,B., Massie, W and Krueger, T., (1996) "Augmented Reality inArchitectural Construction, Inspection and Renovation". In Proc. ASCE Third Congress onComputing in Civil Engineering, pages 913–919, Anaheim, CA, June 1996.