01.05.2013 Views

Download the .pdf - Metaio

Download the .pdf - Metaio

Download the .pdf - Metaio

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

The Augmented Reality Magazine No. 3 | February 2013<br />

Spotlight on <strong>Metaio</strong> Creator<br />

The Difficulties of being Droid<br />

AR in <strong>the</strong> Construction Industry


2<br />

The Augmented Reality Magazine No. 3 | February 2013<br />

Augmented Reality in Construction<br />

13<br />

LEGO Digital Box<br />

10<br />

4<br />

The <strong>Metaio</strong> AREngine<br />

6<br />

The <strong>Metaio</strong> Creator<br />

14<br />

Enterprise Solutions<br />

12<br />

Android Fragmentation<br />

3 4 5 6 7 8 9 10 11 12 13 14 15<br />

in this issue<br />

forum<br />

The World’s First AR<br />

Processing Unit 3<br />

focus<br />

The <strong>Metaio</strong> AREngine 4<br />

features<br />

The <strong>Metaio</strong> Creator 6<br />

AR in Minutes 7<br />

AR Excitement for 2013 8<br />

Global Mobile Awards 2013 9<br />

AR in Construction 10<br />

Android Fragmentation 12<br />

fragments<br />

LEGO Digital Box 13<br />

<strong>Metaio</strong> Enterprise Solutions 14<br />

events<br />

InsideAR: The Augmented<br />

Reality Conference 15<br />

CeBIT 15<br />

ISMAR 15<br />

insideAR Team<br />

Editor:<br />

Daniel Gelder<br />

Creative Director:<br />

Christopher Zak<br />

Communications Director:<br />

Trak Lord<br />

Copy Editors:<br />

Matthias Greiner<br />

Nikoleta Notova<br />

Design and Layouts:<br />

María Barrena<br />

metaio GmbH<br />

Infanteriestrasse 19, Haus 4B<br />

80797 München, Germany<br />

+49 89 5480 198 0<br />

metaio, Inc.<br />

375 Alabama Street<br />

San Francisco, CA 94110<br />

+1 415 814 3376<br />

www.metaio.com


Press Release<br />

<strong>Metaio</strong> brings world’s first Augmented Reality<br />

Accelerated chipset to market, signs agreement with<br />

ST-Ericsson to integrate future mobile platforms<br />

SAN FRANCISCO – FEBRUARY 21, 2013: <strong>Metaio</strong> today announces an agreement with ST-Ericsson, a leader<br />

in wireless platforms and semiconductors. Under <strong>the</strong> terms of <strong>the</strong> agreement, ST-Ericsson will integrate<br />

<strong>Metaio</strong>’s Augmented Reality hardware IP, <strong>the</strong> so-called “AREngine,” into <strong>the</strong> next generation of ST-Ericsson<br />

mobile platforms resulting in <strong>the</strong> first application processor accelerating Augmented Reality performance<br />

on mobile devices.<br />

<strong>Metaio</strong>’s cutting-edge technology inserts nearly any 3-D and virtual content into <strong>the</strong> real world by recognizing images,<br />

objects and entire environments. In a mobile future that clearly requires smart devices to be ‘always on’ and<br />

connected, <strong>the</strong> <strong>Metaio</strong> AREngine drastically reduces power consumption making all-day AR experiences possible.<br />

This first-of-its-kind collaboration will improve nearly all aspects of an Augmented Reality experience, yielding performance<br />

increases in speed, precision and power consumption, with up to 60 times faster initialization, more than<br />

an AR app running on existing platforms – <strong>the</strong> highest to date in <strong>the</strong> mobile industry. Both <strong>Metaio</strong> and ST-Ericsson<br />

strongly believe that working toge<strong>the</strong>r will accelerate <strong>the</strong> adoption of Augmented Reality as a consumer technology.<br />

“The AREngine will do for Augmented Reality what <strong>the</strong> GPU did years ago for <strong>the</strong> gaming industry,” said <strong>Metaio</strong><br />

CTO Peter Meier. “This is a great leap in <strong>the</strong> AR space, and we strongly believe that <strong>the</strong> AR Engine working with<br />

ST-Ericsson platforms will help realize <strong>the</strong> Augmented City - <strong>the</strong> idea of a completely connected environment<br />

powered by Augmented Reality and made possible with next-gen, optimized mobile platforms.”<br />

“Working toge<strong>the</strong>r, this will be <strong>the</strong> first ever integration of dedicated AR hardware IP on silicon,” said Björn Ekelund,<br />

head of Ecosystem Research and Innovation for ST-Ericsson. “By continuing our relationship with <strong>Metaio</strong>, this<br />

agreement will provide a competitive advantage to both companies and our customers in <strong>the</strong> smartphone and<br />

AR space, where people are looking for differentiating factors when making <strong>the</strong>ir purchase decisions. AR will no<br />

longer be limited to simple 2-D images - with <strong>Metaio</strong>’s AREngine, <strong>the</strong> future possibilities are endless.”<br />

Visitors to <strong>the</strong> 2013 Mobile World Congress in Barcelona will be treated to live demonstrations of <strong>Metaio</strong>’s technology<br />

and <strong>the</strong> benefits of Augmented Reality hardware integration. For more information, visit www.metaio.com/mwc<br />

Watch <strong>the</strong> AREngine video: http://youtu.be/6br7NreTwD4<br />

###<br />

About <strong>Metaio</strong><br />

The worldwide leader in Augmented Reality (AR) research and technology, <strong>Metaio</strong> develops software products<br />

for visually interactive solutions between <strong>the</strong> real and <strong>the</strong> virtual world. Based on <strong>the</strong> <strong>Metaio</strong> Augmented Reality<br />

platform, digital and 3-D content can be integrated seamlessly into <strong>the</strong> user’s camera view looking upon <strong>the</strong> real<br />

world. Powering over 1,000 apps for enterprise, marketing, retail, publishing and industrial cases, over 30 Million<br />

consumers use <strong>Metaio</strong>’s AR software. Learn more at www.metaio.com<br />

About ST-Ericsson<br />

ST-Ericsson is a world leader in developing and delivering a complete portfolio of innovative mobile platforms and<br />

cutting-edge wireless semiconductor solutions across <strong>the</strong> broad spectrum of mobile technologies. ST-Ericsson<br />

was established as a 50/50 joint venture by STMicroelectronics (NYSE:STM) and Ericsson (NASDAQ:ERIC) in<br />

February 2009, with headquarters in Geneva, Switzerland.<br />

3 4 5 6 7 8 9 10 11 12 13 14 15<br />

forum The World’s First AR Processing Unit<br />

3


focus The <strong>Metaio</strong> AREngine<br />

Accelerating Augmented Reality: The <strong>Metaio</strong> AREngine<br />

The AREngine and <strong>the</strong> journey to<br />

<strong>the</strong> first AR-ready smartphone<br />

Nearly a decade ago, to <strong>the</strong> day, Thomas Alt and Peter<br />

Meier founded <strong>Metaio</strong> with <strong>the</strong> intent of advancing<br />

Augmented Reality (AR) as <strong>the</strong> primary interface for<br />

experiencing <strong>the</strong> digital and online worlds. This was a<br />

time when <strong>the</strong> most popular mobile device’s (<strong>the</strong> Nokia<br />

1100) features were limited to SMS and a calculator.<br />

The dawn of <strong>the</strong> era of <strong>the</strong> smartphone really did<br />

change everything for <strong>the</strong> Augmented Reality industry,<br />

as suddenly <strong>the</strong> average user could experience through<br />

mobile cameras <strong>the</strong> same visual elements formerly<br />

restricted to factory-floor AR installations running on<br />

offline high-powered PCs.<br />

Back <strong>the</strong>n it was clear that computer vision and<br />

Augmented Reality experiences would greatly benefit<br />

from optimizing <strong>the</strong> software for individual handsets and<br />

chipset platforms. It was <strong>the</strong>n that <strong>Metaio</strong> embarked on<br />

developing relationships with OEMs, handset manufacturers<br />

and chipset platforms in order to one day realize a<br />

fully optimized device, ready for Augmented Reality from<br />

<strong>the</strong> moment <strong>the</strong> consumer removes it from <strong>the</strong> shelf.<br />

Despite hardware limitations, <strong>Metaio</strong> was able to make<br />

leaps and bounds with applied research and lowlevel<br />

optimizations. Their award-winning R&D team<br />

was responsible for <strong>the</strong> first commercial deployment<br />

of 3-D tracking and recognition on a mobile device.<br />

<strong>Metaio</strong>’s engineers were also <strong>the</strong> first to align a given<br />

4<br />

smartphone camera with gravity, educating <strong>the</strong> sensor<br />

on how to better perceive its surroundings like <strong>the</strong> human<br />

eye. In fact, <strong>Metaio</strong> has made incredible software<br />

developments in 2012 alone.<br />

In 2009, it was no less than a technological feat to get<br />

a top-of-<strong>the</strong>-line HD camera connected to an offline<br />

desktop PC to recognize a single pre-designed image<br />

and render a single 3-D model in real-time. With <strong>the</strong><br />

latest low-level optimizations, <strong>Metaio</strong> has achieved<br />

recognizing 100 unique images and overlaying 100<br />

unique 3-D models, all on a mobile device. If <strong>Metaio</strong><br />

can accomplish <strong>the</strong>se things without having any prior<br />

access to <strong>the</strong> processors and sensors inside <strong>the</strong>se devices,<br />

imagine what mobile users could do with a fully<br />

AR-ready smartphone.<br />

Whe<strong>the</strong>r it’s Google’s Project: Glass concept or popular<br />

movies like Minority Report or Terminator, nearly all of<br />

<strong>the</strong> popular references to Augmented Reality depict an<br />

“always on” interface. The camera is constantly scanning,<br />

detecting, recognizing and overlaying information<br />

and content onto <strong>the</strong> real world. In order to achieve this<br />

vision (something <strong>Metaio</strong> refers to as <strong>the</strong> “Augmented<br />

City”) of ubiquitous interaction, it is imperative that <strong>the</strong><br />

groups developing <strong>the</strong> hardware are working with those<br />

developing <strong>the</strong> software.<br />

For this reason, <strong>Metaio</strong> began developing a piece of<br />

hardware IP now known as <strong>the</strong> “AREngine”, an architecture<br />

designed specifically to accelerate Augmented<br />

3 4 5 6 7 8 9 10 11 12 13 14 15


Reality performance in mobile hardware, and one of<br />

<strong>Metaio</strong>’s longstanding platform partners, ST-Ericsson,<br />

will be <strong>the</strong> first to adopt and deploy it on silicon. The<br />

AREngine will propel Augmented Reality into <strong>the</strong> future<br />

and will do for <strong>the</strong> industry what <strong>the</strong> addition of <strong>the</strong> GPU<br />

did for <strong>the</strong> gaming industry.<br />

Before <strong>the</strong> populace sports head mounted displays that<br />

resemble eyeglasses; before society adopts wearable<br />

computing; before contact lenses come in 16, 32 and<br />

64 gigabyte models; before we exist in an Augmented<br />

World – <strong>the</strong>re must be <strong>the</strong> first step. The future of<br />

Augmented Reality starts now with <strong>the</strong> first ever introduction<br />

and implementation of <strong>the</strong> AREngine.<br />

Always On. Always Augmented.<br />

<strong>Metaio</strong> AREngine Features<br />

→ Higher performance enables an increase in scale and volume<br />

of Augmented Reality<br />

→ Faster initialization on 3-D point clouds allows for an increase<br />

in <strong>the</strong> volume and size of <strong>the</strong> 3-D point cloud<br />

→ Dramatic reduction in power consumption will allow for Allday<br />

AR experiences<br />

→ “Always on” of Augmented Reality usage for current & future<br />

devices requiring continuous AR visualization & search<br />

→ AREngine modules can be customized to meet <strong>the</strong><br />

semiconductors requirements<br />

3 4 5 6 7 8 9 10 11 12 13 14 15<br />

<strong>Metaio</strong> and Mobile World Congress<br />

a rich history of introducing <strong>the</strong> latest advances in AR<br />

Throughout <strong>the</strong> years <strong>Metaio</strong> and its partners have served as<br />

Augmented Reality ambassadors at <strong>the</strong> Mobile World Congress,<br />

delivering insightful speaking sessions, appearing in multiple<br />

technology panels and showcasing <strong>the</strong> latest technology on <strong>the</strong><br />

show floor.<br />

2010<br />

<strong>Metaio</strong> works with Sony Ericsson to showcase<br />

<strong>the</strong> latest image recognition technology on Sony<br />

Ericsson’s newest Android device at <strong>the</strong> time.<br />

2011<br />

<strong>Metaio</strong> demonstrates breakthroughs in mobile AR<br />

with Intel – including <strong>the</strong> first 3-D object recognition<br />

and tracking – and announces <strong>the</strong> first of many strategic<br />

OEM partnerships to come with ST-Ericsson.<br />

2012<br />

<strong>Metaio</strong> releases its Augmented City platform,<br />

complete with <strong>the</strong> first 3-D object recognition<br />

and tracking, to <strong>the</strong> entire mobile community,<br />

presenting its technology at <strong>the</strong> booths of multiple<br />

prominent OEMs, including ARM, Intel, Texas<br />

Instruments and, of course, ST-Ericsson.<br />

Junaio, <strong>the</strong> most advanced mobile Augmented Reality<br />

browser app is a fast and easy way to discover your<br />

world. Find local events, offers and listings; scan QR<br />

codes to get instant access to additional information;<br />

unlock augmented content on images and objects to<br />

play games or experience new virtual interactions.<br />

Broadway<br />

0.5mi<br />

focus The <strong>Metaio</strong> AR Engine<br />

0.1mi<br />

Madame<br />

Tussauds<br />

0.4mi<br />

Times Square<br />

for iOS and Android<br />

www.junaio.com<br />

5


features The <strong>Metaio</strong> Creator<br />

Spotlight on <strong>Metaio</strong> Creator, AR in Minutes<br />

The Internet would be nothing<br />

without content.<br />

The same is true for <strong>the</strong> Augmented Reality industry.<br />

Though <strong>Metaio</strong> works regularly with industrial and automotive<br />

clients on internal projects that <strong>the</strong> public rarely<br />

sees, <strong>the</strong> consumer side of augmented reality benefits<br />

from creative and engaging content, often created by<br />

partners and developers in <strong>the</strong> mobile community.<br />

The <strong>Metaio</strong> Creator had very humble beginnings as an<br />

online companion to <strong>Metaio</strong>’s mobile augmented reality<br />

browser, Junaio, to help new AR developers publish<br />

simple experiences. As <strong>the</strong> AR ecosystem evolved, so<br />

did <strong>the</strong> product. <strong>Metaio</strong> recognized that more than just<br />

developers needed to have access to development<br />

tools. Originally intended as a solution for <strong>the</strong> print industry,<br />

it became clear to <strong>Metaio</strong> that <strong>the</strong> technology<br />

appealed to a broader audience.<br />

Even today a still growing community of artists, designers<br />

and creative professionals involved with mixed and<br />

digital media want to use Augmented Reality as <strong>the</strong> next<br />

medium – and it was for that group of people that <strong>Metaio</strong><br />

released <strong>the</strong> first iteration of <strong>the</strong> Creator tool, a simple<br />

drag & drop desktop publishing solution that removed<br />

<strong>the</strong> need for programming.<br />

In October of 2012 <strong>Metaio</strong> announced at its annual<br />

InsideAR technology conference that it would introduce<br />

scalable augmented reality software and services<br />

6<br />

to <strong>the</strong> technology community in order to aid in <strong>the</strong><br />

creation of compelling AR content. Following InsideAR<br />

2012, <strong>Metaio</strong> heeded <strong>the</strong> requests of its burgeoning<br />

network and added better 3-D content support, native<br />

app creation capability, and cloud service offerings to<br />

<strong>the</strong> Creator, in addition to a version for OS X.<br />

Now nearly anyone can create augmented reality experiences<br />

and applications in just a few minutes and <strong>the</strong><br />

opportunities and potential uses increase exponentially.<br />

A creatively-minded person could simply augment his<br />

or her business card with a virtual resume or introduction;<br />

family members could attach <strong>the</strong> latest videos<br />

or images of important events to holiday greetings; a<br />

publisher could bring <strong>the</strong> most featured editorial content<br />

to life on <strong>the</strong> cover of a magazine or newspaper; a<br />

digital marketer could turn a print campaign into a fully<br />

integrated digital masterpiece, connecting <strong>the</strong> virtual<br />

assets with every physical aspect of <strong>the</strong> experience; or<br />

he or she could use <strong>the</strong> graphical user interface (GUI)<br />

designer to build a custom mobile AR application, all<br />

with just a few clicks.<br />

3 4 5 6 7 8 9 10 11 12 13 14 15<br />

Learn more at www.metaio.com/products/creator or stop by our<br />

booth at <strong>the</strong> 2013 Mobile World Congress in App Planet, Hall 8.1,<br />

booth 8.1E39 to talk to a member of our team.


Augmented Reality in just 3 steps with <strong>the</strong> <strong>Metaio</strong> Creator<br />

The creation of Augmented Reality experiences and<br />

scenarios has been, until recently, reserved for developers<br />

and programmers. Thanks to <strong>the</strong> <strong>Metaio</strong> Creator, a<br />

new AR authoring tool, editors, designers, students, and<br />

marketing agencies can create and visualize <strong>the</strong>ir own<br />

Augmented Reality ideas, concepts and applications<br />

without any programming knowledge necessary.<br />

Get started creating an Augmented Reality scenario in<br />

minutes with <strong>the</strong>se 3 easy steps:<br />

1. Upload your trackables and your digital content<br />

(videos, 3-D and/or 2-D assets, buttons, audio,<br />

etc.) by dragging & dropping <strong>the</strong>m directly into <strong>the</strong><br />

<strong>Metaio</strong> Creator. Files are automatically converted and<br />

optimized for <strong>the</strong> Augmented Reality scenario, and<br />

<strong>the</strong> trackables are evaluated and rated based on <strong>the</strong>ir<br />

quality for image recognition during <strong>the</strong> upload.<br />

2. Create your experience with just a few clicks… Align<br />

digital elements like buttons, videos or 3-D models<br />

with <strong>the</strong> trackable by dropping elements from <strong>the</strong><br />

Resources panel right onto <strong>the</strong> trackable image or<br />

3-D map. The application logic creates itself!<br />

3. Publish your Augmented Reality experience with just<br />

one click to junaio or <strong>the</strong> metaio cloud and try it out<br />

immediately on your smartphone or tablet.<br />

metaio Creator Features<br />

3 4 5 6 7 8 9 10 11 12 13 14 15<br />

features AR in Minutes<br />

→ Easy to use software and no developer background required<br />

→ Options to share your videos, images, audio and 3-D<br />

contents with millions of AR users<br />

→ Publish to <strong>Metaio</strong>’s existing AR Browser App, Junaio, with no<br />

app submission<br />

→ Build your own Augmented Reality app, from beginning to<br />

end, with <strong>the</strong> <strong>Metaio</strong> Creator<br />

→ Instant content updates without app resubmission through <strong>the</strong><br />

<strong>Metaio</strong> Cloud<br />

→ Integrated Analytics Manager for your AR campaigns<br />

→ Connected with <strong>the</strong> newest <strong>Metaio</strong> Cloud service<br />

<strong>Download</strong> <strong>Metaio</strong> Creator for FREE!<br />

Try for yourself, start creating AR scenarios using up<br />

to 2 tracking patterns and publish <strong>the</strong>m for free on<br />

<strong>the</strong> junaio AR browser! Available for Mac OSX (version<br />

10.7 & higher) and Windows.<br />

<strong>Download</strong> <strong>the</strong> metaio Creator at:<br />

www.metaio.com/products/creator<br />

7


features AR Excitement for 2013<br />

5 reasons to get excited about Augmented Reality in 2013<br />

Originally posted on venturebeat.com, December 23, 2012<br />

Augmented reality (AR) may seem like a futuristic concept,<br />

but it will be a reality of our digital lives in 2013. AR<br />

is a new technology that blurs <strong>the</strong> line between what’s<br />

real and what’s computer generated by enhancing<br />

what we hear, see and feel. Next year, I predict that it<br />

will be everywhere. Here are my five reasons why:<br />

The glasses are coming, <strong>the</strong> glasses are coming!<br />

Whe<strong>the</strong>r it’s Google’s Project Glass or concept videos<br />

along <strong>the</strong> lines of “Sight”, <strong>the</strong> Internet can’t get<br />

enough of Terminator Vision. A few companies have<br />

however made some pretty impressive technological<br />

leaps this year: this fall, Vuzix debuted <strong>the</strong>ir monocular<br />

AR prototype for industrial use at <strong>the</strong> annual InsideAR<br />

conference; Innovega showcased <strong>the</strong>ir Augmented<br />

Reality contact lens prototype at <strong>the</strong> 2012 Consumer<br />

Electronic show, for which <strong>the</strong>y’re currently seeking<br />

FDA approval; and researchers at <strong>the</strong> University of<br />

Washington successfully displayed a single pixel on an<br />

eye (albeit, that of a rabbit).<br />

In <strong>the</strong> meantime, retails brands like Oakley and game<br />

favorite Valve were just as quick to throw <strong>the</strong>ir hats in <strong>the</strong><br />

ring alongside patent applications from tech giants Apple<br />

and Microsoft. But don’t bo<strong>the</strong>r Santa with your letters<br />

– widely available (and affordable) wearable Augmented<br />

Reality devices probably won’t hit shelves until 2014.<br />

Smartphones will be<br />

AR-equipped<br />

We might not get Paul<br />

Smith AR goggles anytime<br />

soon, but expect OEMs,<br />

handset manufacturers<br />

and carriers to integrate<br />

optimized Augmented Reality, visual display and camera<br />

performance into <strong>the</strong> next generation of smartphones,<br />

because it’s basically already happening.<br />

Premier-to-punchline-to-rising-star Nokia recently<br />

launched <strong>the</strong> City Lens app, exclusive to its Lumia<br />

suite of devices. UK-based chip designer ARM has<br />

8<br />

had its eye on AR for a while, powering and optimizing<br />

experiences for its architecture found in <strong>the</strong> Samsung<br />

Galaxy SII, SIII and Note devices. And let us not forget<br />

Telefonica and <strong>the</strong>ir mad dash to serve mobile<br />

Augmented Reality advertisements to <strong>the</strong> entirety of<br />

<strong>the</strong>ir O2 network, alongside mobile coupons and location-based<br />

services.<br />

Location, Location, Location<br />

GPS and geodata were responsible early on for bringing<br />

Augmented Reality to <strong>the</strong> forefront. Applications<br />

like Junaio and Layar made a splash in <strong>the</strong> tech world,<br />

offering location-based navigational “channels” and “layers”<br />

where UFO-like billboards bobbed on <strong>the</strong> horizon,<br />

displaying information about your surroundings. In 2013<br />

expect to see <strong>the</strong> next generation of those GPS-based<br />

experiences, incorporating not only data from on-board<br />

sensors like <strong>the</strong> gyroscope and camera, but o<strong>the</strong>r niche<br />

mobile technologies that rely on proximity such as NFC.<br />

Companies like Hover are already deeply embedded in<br />

generating and augmenting 3-D maps of urban areas,<br />

and my company (AR firm <strong>Metaio</strong>) has successfully<br />

developed “snapping algorithms” that pull this kind of<br />

data from <strong>the</strong> cloud and tightly align it to <strong>the</strong> real world.<br />

Expect your city to get a lot more augmented in 2013.<br />

The death of <strong>the</strong><br />

gimmicky app<br />

Disclaimer: <strong>the</strong>re will always<br />

be marketers that<br />

abuse useful technology<br />

for <strong>the</strong>ir own nefarious,<br />

poorly designed purposes<br />

(re: QR codes), but expect<br />

to see brands move to better, faster and stronger apps<br />

that give <strong>the</strong>ir audience clear incentives for regular use.<br />

3-D bunnies smiling at you from conference marketing<br />

material may have seemed novel at <strong>the</strong> time, but creating<br />

a new app for each one-off experience is nei<strong>the</strong>r<br />

scalable nor tolerable from a user’s perspective.<br />

The 2013 IKEA Catalog app featured an Augmented<br />

Reality viewer that visualized furniture in 3-D and<br />

served related video and digital content to readers.<br />

It was <strong>the</strong> most downloaded branded app of 2012,<br />

even after launching in July. With that kind of success<br />

as a benchmark, expect o<strong>the</strong>r companies to start<br />

managing entire product lifecycles with Augmented<br />

Reality solutions- not unlike Mitsubishi Electric with<br />

<strong>the</strong>ir enterprise MeViewAR app that visualizes heating<br />

and cooling units in <strong>the</strong> real world. Mitsubishi Electric<br />

has already moved to <strong>the</strong> next phase for 2013, intending<br />

to visualize 3-D maintenance instructions for<br />

service technicians.<br />

3 4 5 6 7 8 9 10 11 12 13 14 15


The birth of <strong>the</strong> elusive killer app<br />

It doesn’t exist, and it probably won’t. Augmented<br />

Reality is a horizontal technology, which means that<br />

<strong>the</strong> nigh-limitless applications make it a challenging endeavor<br />

to develop <strong>the</strong> Evernote/YouTube/Wordpress/<br />

Instagram of Augmented Reality. We did however see<br />

<strong>the</strong> AR Angry Birds, and even if it isn’t official it’s still a<br />

pretty clear indication that a successful AR game could<br />

lead <strong>the</strong> way for massive adoption. There are already<br />

some good examples out <strong>the</strong>re, like <strong>the</strong> new JengAR<br />

game that inserts <strong>the</strong> 3-D content into <strong>the</strong> environment<br />

itself ra<strong>the</strong>r than needing a printed image.<br />

Expect more games to take this approach in 2013 as<br />

we move toward experiences that engage users in <strong>the</strong>ir<br />

actual surroundings. But <strong>the</strong> most amazing app for<br />

which <strong>the</strong> industry could possibly hope is only peripherally<br />

related to AR. 3-D content is tough. it’s difficult,<br />

expensive and time-consuming to create, and may present<br />

<strong>the</strong> biggest barrier to producing AR experiences.<br />

Augmented Reality needs an app that easily generates<br />

3-D content and exports it in major supported formats.<br />

Think “Draw Something” meets iMovie, in 3-D. That<br />

would be something!<br />

SOUTH<br />

ENTRANCE<br />

1<br />

2<br />

5<br />

3<br />

7<br />

4<br />

6<br />

8.1<br />

8<br />

NORTH<br />

ENTRANCE<br />

<strong>Metaio</strong> Nominated for 18th Annual<br />

Global Mobile Awards<br />

We’re pleased to announce that <strong>Metaio</strong> has been<br />

nominated for <strong>the</strong> prestigious 2013 Global Mobile<br />

Awards for <strong>the</strong> 2013 Mobile World Congress in<br />

<strong>the</strong> category of Best Mobile Service or Product for<br />

Automotive. As <strong>Metaio</strong> has strong roots in AR applications<br />

for <strong>the</strong> car industry, we’re very proud to have<br />

<strong>the</strong> chance to present with our partner, Audi AG in<br />

Barcelona this year.<br />

<strong>Metaio</strong> and Audi AG worked toge<strong>the</strong>r to develop <strong>the</strong><br />

Audi eKurzinfo Augmented Reality assistant app.<br />

New Audi A1 owners can download <strong>the</strong> app for iOS<br />

devices and get introduced to <strong>the</strong>ir car in just a few<br />

minutes, with no manual necessary. Through <strong>the</strong><br />

app, <strong>the</strong> user can use <strong>Metaio</strong>’s visual search and<br />

recognition technology to identify insignia throughout<br />

<strong>the</strong> vehicle and receive immediate feedback on<br />

how to use that particular feature of <strong>the</strong> new Audi.<br />

The first iteration of <strong>the</strong> Audi eKurzinfo app was<br />

based purely on image recognition. For 2013,<br />

Audi will release <strong>the</strong> brand new version of <strong>the</strong> app<br />

featuring real-time visual graphics and advanced<br />

Augmented Reality interactions. Audi intends to roll<br />

out this service beyond <strong>the</strong> A1, starting with <strong>the</strong> A3<br />

but with <strong>the</strong> potential for future models as well.<br />

If you’re attending <strong>the</strong> Mobile World Congress in<br />

Barcelona this year, please come visit us! In addition<br />

<strong>the</strong> Awards Ceremony, <strong>Metaio</strong> will be in Hall 8.1 at<br />

<strong>the</strong> App Planet, showcasing <strong>the</strong> latest in Augmented<br />

Reality and 3-D technology. We are fortunate to<br />

also have amazing partners like Intel, Imagination<br />

Technology and ST-Ericsson, at whose booths you<br />

can see how <strong>Metaio</strong>’s technology works with some<br />

of <strong>the</strong> best chipset platforms and handsets out <strong>the</strong>re.<br />

Where to find <strong>Metaio</strong> @MWC 2013<br />

metaio ......App Planet, Hall 8.1, Stand 8.1E39<br />

Intel ........App Planet, Hall 8.1, Stand 8.1E20<br />

Imagination ..Hall 7, Stand 7I110<br />

ST-Ericsson ..Hall 7, Stand 7E111<br />

NVIDIA. .....Hall 7 Stand 7C110<br />

ARM .......Hall 6 Stand 6A31<br />

3 4 5 6 7 8 9 10 11 12 13 14 15<br />

features Global Mobile Awards 2013<br />

9


features AR in Construction<br />

Augmented Reality in <strong>the</strong> Construction Industry<br />

Augmented Reality (AR) enhances <strong>the</strong><br />

environment by allowing human senses to<br />

interact with richer and more compelling<br />

experiences through <strong>the</strong> addition of<br />

digital information to <strong>the</strong> real world.<br />

Virtual content can now coexist with <strong>the</strong> tangible world.<br />

The origins of Augmented Reality take <strong>the</strong>ir root from<br />

Ivan Su<strong>the</strong>rland 1965’s piece: “The Ultimate Display”.<br />

Since <strong>the</strong>n, <strong>the</strong> application and interest in AR has grown<br />

exponentially in various industries. While many have<br />

been quick to adopt Augmented Reality, <strong>the</strong> construction<br />

industry has been slow to embrace this new technology.<br />

In order to draw a better picture of <strong>the</strong> state of AR in<br />

<strong>the</strong> construction industry we sent 345 surveys to construction<br />

companies and received 34 responses. The<br />

majority of respondents were European with <strong>the</strong> remaining<br />

participants in North America, South America,<br />

Asia and Australia.<br />

Of <strong>the</strong> 38% already familiar with AR, 23% note <strong>the</strong><br />

technology is already implemented in <strong>the</strong> workplace,<br />

comprising only 9% of <strong>the</strong> responding companies.<br />

Surprisingly enough, nearly 90% said <strong>the</strong>y could think<br />

of ways that Augmented Reality could be useful within<br />

<strong>the</strong>ir respective workplaces.<br />

At this time, AR implementation seems to be restricted<br />

to a few large companies, while smaller building<br />

firms and architect offices are reluctant to adopt new<br />

10<br />

Survey: AR and Construction<br />

3 4 5 6 7 8 9 10 11 12 13 14 15<br />

Are you familiar with AR<br />

Does your company use AR?<br />

Would AR solve problems<br />

at your company?


technology tools due to finite resources. In addition,<br />

it is of note that 40% of those aware of AR but not<br />

yet using it in <strong>the</strong> workplace say that <strong>the</strong> technology is<br />

currently being investigated and that it could be used<br />

in <strong>the</strong> near future.<br />

A demonstration illustrating <strong>the</strong> advantages of AR in <strong>the</strong><br />

construction industry was showcased last year at <strong>the</strong><br />

InsideAR 2012 Augmented Reality conference in Munich,<br />

Germany. The aim of this demonstration was to visualize<br />

how <strong>the</strong> planning of a construction site, with <strong>the</strong> help of<br />

AR, provided significant improvements over traditional<br />

methods. The demo focused on <strong>the</strong> features of engineering<br />

and industrial based Augmented Reality and <strong>the</strong><br />

benefits it is able to bring to <strong>the</strong> construction industry.<br />

Features<br />

→ Virtual elements are augmented into <strong>the</strong> real world in real time<br />

→ Visualization of all devices and equipment involved in <strong>the</strong> project<br />

→ Crane range of motion visible through visualization of its radius<br />

→ See-through 3D radius of cranes models and range of motion<br />

→ Visualization of <strong>the</strong> various connection required to utilities<br />

→ Representation of <strong>the</strong> finished project<br />

→ Visualization of any additional information possible<br />

→ Visualization of <strong>the</strong> overall construction site’s structure and layout<br />

Benefits<br />

→ Planning takes place on site; no paper plan needed<br />

→ Determine optimal orientation and disposal of each and every unit<br />

→ Easily see how accessible <strong>the</strong> material storage and o<strong>the</strong>r<br />

necessary areas are<br />

→ Provides extensive feedback of crane interaction with<br />

surroundings in order to prevent collisions<br />

→ Base <strong>the</strong> layout of you construction site on <strong>the</strong> availability of<br />

utilities and maximize efficiency<br />

→ Instantly see how your construction project looks, interacts &<br />

impacts on <strong>the</strong> surroundings<br />

→ Superimpose <strong>the</strong> construction schedule to monitor <strong>the</strong> deadlines<br />

→ Improved coordination between delivery services and<br />

construction site logistics<br />

Quick Facts - <strong>Metaio</strong> Engineer:<br />

+ =<br />

→ Advantages of AR for Construction & Planning<br />

3 4 5 6 7 8 9 10 11 12 13 14 15<br />

features AR in Construction<br />

→ Reconstruct onsite virtual 3-D assets, materials, prototypes<br />

and environments, in real-time<br />

→ Insert and visualize objects obscured by real-world materials<br />

→ Reduce costs, test processes and simulate project conditions<br />

even in planning stages<br />

→ Visualize completed project in a real-world environment<br />

before it kicks off<br />

→ Optimize a project’s delivery with more efficient prior planning<br />

and design<br />

Learn more about <strong>Metaio</strong> Engineer!<br />

Contact us at sales@metaio.com for more information<br />

on what you can achieve with <strong>Metaio</strong> Engineer and<br />

industrial AR.<br />

www.metaio.com/products/engineer<br />

11


features Android Fragmentation<br />

The Difficulties of being Droid<br />

The first smartphone running Google’s<br />

Android mobile operating system was<br />

released in October 2008. Today, 1.3<br />

million android devices are activated<br />

daily, 70,000 of which are tablets.<br />

Due to it’s nature as an open platform, Android can<br />

be installed on any kind of device, with any kind of<br />

hardware, including different graphic capabilities,<br />

completely different and non-homogeneous screen<br />

sizes, different user inputs, on both high and low end<br />

devices. Android has even been seen running on cars,<br />

ovens and refrigerators. There are seemingly no limits<br />

when it comes to <strong>the</strong> myriad of devices and electronics<br />

that can run Android.<br />

This, however, presents a problem for companies and<br />

developers bringing applications, games, books, movies,<br />

music and magazines to <strong>the</strong> Google Play store.<br />

This problem is called fragmentation and is a result of<br />

nearly unlimited device variations and configurations, in<br />

respect to both <strong>the</strong> hardware and software.<br />

Developers want to take this fragmentation issue and<br />

make it work to <strong>the</strong>ir benefit, but clearly cannot be<br />

expected to make a single application for all Android<br />

devices and have it to work perfectly on every single<br />

one. For this reason, companies and developers are<br />

spending extra time and effort on <strong>the</strong>ir applications and<br />

optimizing <strong>the</strong> user interfaces to fit on every screen size<br />

or at <strong>the</strong> very least, <strong>the</strong> widest possible range of sizes,<br />

resolutions and combinations of screen orientations.<br />

Today, 1.3 million Android<br />

devices are activated daily<br />

Imagine great-looking app optimized for a smartphone<br />

with a smaller screen. How will it look when running on<br />

a different phone with a larger screen, or on a tablet<br />

in landscape orientation? On a higher resolution display,<br />

<strong>the</strong> interface components can be adjusted and<br />

positioned in a more visually engaging manner, or more<br />

information can be shown on <strong>the</strong> display. In regards to<br />

tablets, retaining <strong>the</strong> same layout may result in a waste<br />

of <strong>the</strong> usable screen real estate, resulting in <strong>the</strong> need<br />

to vary <strong>the</strong> user interface again or create a completely<br />

different version of <strong>the</strong> application.<br />

Introduced alongside Android 3.0 (Honeycomb), <strong>the</strong><br />

Fragments API has made it much easier to create an application,<br />

based on fragments, which is also backwards<br />

compatible with earlier Android devices. Fragments<br />

make it possible for developers to define sections of<br />

<strong>the</strong> user interface as individual units that can adjust<br />

12<br />

<strong>the</strong>ir location on screen depending on <strong>the</strong> screen size,<br />

resolution and orientation of <strong>the</strong> device. Now Android<br />

developers have <strong>the</strong> power to ensure that <strong>the</strong>ir applications<br />

offer quality user-experiences with less worry<br />

about which device <strong>the</strong> user may have in <strong>the</strong>ir hands.<br />

This is great for app development in general, and especially<br />

for Augmented Reality applications. With <strong>the</strong><br />

flexibility of <strong>the</strong> devices that <strong>the</strong> Fragments API allows<br />

developers to target, less time is necessary for user<br />

interface adjustments and backwards compatibility<br />

issues, allowing more time to be spent enhancing,<br />

perfecting and delivering <strong>the</strong> best Augmented Reality<br />

experiences possible. Augmented Reality is great for<br />

tablets and devices with larger displays, but users with<br />

smaller devices should also be able to easily experience<br />

all of <strong>the</strong> amazing AR content and applications<br />

being offered.<br />

The <strong>Metaio</strong> SDK for Android is also <strong>the</strong> only available<br />

augmented reality software with which developers can<br />

create native Android apps. In conjunction with <strong>the</strong><br />

Fragments API, developers not only have a much easier<br />

time optimizing applications for different devices, but<br />

can also rely on <strong>the</strong>ir creations to work as intended for<br />

<strong>the</strong> user or client. And one of <strong>the</strong> huge benefits of <strong>the</strong><br />

so-called fragmentation of <strong>the</strong> Android OS is that <strong>the</strong><br />

plentitude of devices running Android mean more users<br />

and more clients to reach in one of <strong>the</strong> largest mobile<br />

audiences in <strong>the</strong> world.<br />

And with Android expanding to automobiles and maybe<br />

even connected home appliances, developers will have<br />

myriad opportunities to create new experiences and interactions<br />

for all aspects of our daily lives. Windshields,<br />

mirrors, refrigerator “desktops”- and of course, Glass.<br />

Ei<strong>the</strong>r way, <strong>the</strong>y can rely on <strong>the</strong> <strong>Metaio</strong> Augmented<br />

Reality SDK to get <strong>the</strong>re.<br />

3 4 5 6 7 8 9 10 11 12 13 14 15


The LEGO Digital Box Augmented Reality Kiosk<br />

An eye-catching in-store AR solution for<br />

<strong>the</strong> most iconic toy company in <strong>the</strong> world<br />

Purchase decisions at <strong>the</strong> point of sale are mostly<br />

driven by <strong>the</strong> excitement of customers about a product.<br />

This certainly applies to <strong>the</strong> toy market.<br />

Customers tend to want to examine and interact with<br />

products before purchasing <strong>the</strong>m. Though LEGO is<br />

one of <strong>the</strong> world’s most renowned toy companies, consumers<br />

can only really interact with <strong>the</strong> product after<br />

purchasing, returning home and assembling it. LEGO<br />

wanted a way for potential consumers to engage with<br />

<strong>the</strong>ir toys ahead of time, so <strong>the</strong>y opted for an Augmented<br />

Reality point-of-sale experience to show <strong>the</strong> customer<br />

product features and to stimulate customers’ emotions<br />

towards <strong>the</strong> product.<br />

<strong>Metaio</strong> developed a custom AR application for LEGO<br />

based on <strong>the</strong> <strong>Metaio</strong> SDK - <strong>the</strong> LEGO Digital Box. The<br />

application relies on image detection and tracking to<br />

recognize <strong>the</strong> different LEGO boxes and visualize 3-D<br />

animations of <strong>the</strong> finished LEGO models directly on top<br />

of <strong>the</strong> product packaging, complete with sound effects.<br />

The application was designed modularly so that content<br />

updates can be performed painlessly. Fur<strong>the</strong>rmore,<br />

statistical evaluation has shown a positive impact on<br />

<strong>the</strong> consumer experience and o<strong>the</strong>r targets of LEGO in<br />

regards to <strong>the</strong> DIGITAL BOX.<br />

Children can now hold LEGO packaging up to <strong>the</strong><br />

DIGITAL BOX and watch a 3-D animation of <strong>the</strong> product,<br />

from any angle and in every detail - all in <strong>the</strong>ir<br />

hands. The installation not only creates a fascinating<br />

technological experience, but also gives in-store retailers<br />

a unique positioning opportunity to educate and<br />

influence purchasing decisions.<br />

“The DIGITAL BOX helps consumers get a better<br />

impression of our products,” says Torben Nielsen,<br />

Director of 3D technology from LEGO Group’s Digital<br />

Development Department, and adds: “We’ve had very<br />

positive feedback from our stores and customers.<br />

Thanks to <strong>Metaio</strong>’s technology, we can excite and inform<br />

our customers on a new level.”<br />

Quick Facts<br />

→ Start of <strong>the</strong> initial evaluation phase in November 2008<br />

→ Worldwide brand store rollout began in April 2010<br />

→ Using <strong>the</strong> <strong>Metaio</strong> SDK<br />

→ Bringing customer excitement to a new level<br />

3 4 5 6 7 8 9 10 11 12 13 14 15<br />

fragments LEGO Digital Box<br />

→ Most successful Augmented Reality application worldwide<br />

13


fragments <strong>Metaio</strong> Enterprise Solutions<br />

Mitsubishi Electric Cooling & Heating Relies on<br />

Augmented Reality Enterprise Solutions from <strong>Metaio</strong><br />

To boost adoption of its ductless air conditioning and<br />

heating products, Mitsubishi Electric Cooling & Heating<br />

needed to more effectively show consumers what an<br />

installed unit would look like in <strong>the</strong>ir home. As a result of<br />

deploying <strong>the</strong> metaio Enterprise Solution (MES), a mobile<br />

augmented reality app, to each of its sales channel<br />

representatives. Mitsubishi Electric has projected an<br />

increase of $30 million in revenue. They also forecast<br />

decreasing by millions <strong>the</strong> future costs for printing and<br />

distributing product catalogs.<br />

The latest innovations in comfort technology and energy-efficient<br />

ductless HVAC systems are provided<br />

by Mitsubishi Electric Cooling & Heating, a division of<br />

Mitsubishi Electric & Electronics USA, Inc. Ductless<br />

systems are 30% more energy-efficient than unitary<br />

HVAC and offer personalized comfort control in each<br />

room or zone.<br />

Mitsubishi Electric provides sales tools, technical support<br />

and training to contractors, distributors, engineers and<br />

architects on its award-winning line of variable refrigerant<br />

flow (VRF) and ductless systems for commercial and<br />

residential, respectively, installations. With over 25,000<br />

contractors and 1,500 distributors nationwide, Mitsubishi<br />

Electric needed a solution to streamline <strong>the</strong> delivery of<br />

information and education of its sales channel.<br />

Gabriel Weiss, head of Interactive Marketing Technologies<br />

for Mitsubishi Electric, recognized a number of issues with<br />

<strong>the</strong> company’s multi-faceted communication network.<br />

Weiss found redundancies and shortcomings, including<br />

marketing strategies that competed with each o<strong>the</strong>r.<br />

14<br />

For example, product and pricing information in print<br />

catalogs was becoming out of date before <strong>the</strong> next<br />

catalog was even drafted. They need a solution that<br />

could be updated year-round. And while product was<br />

pictured in <strong>the</strong>se print catalogs, being able to show <strong>the</strong><br />

product actually in <strong>the</strong> customer’s space would answer<br />

<strong>the</strong> most frequently asked question from customers,<br />

“What will it look like on my wall?”.<br />

Mitsubishi Electric Cooling and<br />

Heating is generating an additional<br />

$30 million in annual sales by<br />

visualizing products with <strong>the</strong><br />

metaio Enterprise Solution<br />

Weiss’ vision for Mitsubishi Electric is “Using technology<br />

to sell our technology,” so <strong>the</strong> value of having a<br />

custom-branded app through which products could be<br />

“seen” was invaluable.<br />

“Using <strong>the</strong> metaio augmented reality technology we<br />

are able to give our customers a mobile product visualization<br />

tool that is completely unique to our industry.<br />

Giving <strong>the</strong>m a competitive advantage and making <strong>the</strong><br />

sales process more efficient for <strong>the</strong>m.”<br />

To visualize a unit exactly as it would appear installed in<br />

a customer’s home, Mitsubishi Electric sales representatives<br />

simply place a 18-inch by 18-inch Post-It Note<br />

marker on <strong>the</strong> wall where <strong>the</strong> unit should appear and<br />

launch <strong>the</strong> meVIEW AR app on an iPad. When <strong>the</strong><br />

user points <strong>the</strong> iPad’s camera towards <strong>the</strong> marker, <strong>the</strong><br />

product is automatically displayed to scale where <strong>the</strong><br />

marker is on <strong>the</strong> wall. The user can <strong>the</strong>n tap to place<br />

any product on <strong>the</strong> same location and share of photo<br />

of it via email with family or project decision makers.<br />

Using this technology, products can be visualized in<br />

any location throughout a customer’s home or office.<br />

Mitsubishi Electric also opted to include social features,<br />

so that photos taken of <strong>the</strong> augmented experience can<br />

be posted to Twitter and Facebook.<br />

Learn more about <strong>Metaio</strong> AR<br />

Enterprise Solutions<br />

Contact sales@metaio.com for more information<br />

on how <strong>Metaio</strong> Enterprise Solutions can solve your<br />

Augmented Reality needs.<br />

www.metaio.com/enterprise<br />

3 4 5 6 7 8 9 10 11 12 13 14 15


InsideAR: The Augmented Reality Conference<br />

Meet <strong>Metaio</strong> all over <strong>the</strong> world<br />

GPU Technology Conference<br />

March 18-21, 2013 – San Jose, California<br />

http://www.gputechconf.com/page/home.html<br />

Game Developers Conference<br />

March 25-29, 2013 – San Francisco, CA<br />

http://www.gdconf.com/<br />

Gartner CIO Leadership Forum<br />

March 17-19, 2013 - Huntington Beach, CA<br />

http://www.gartner.com/technology/summits/na/cio/<br />

South By Southwest Interactive<br />

March 8-12, 2013 - Austin, TX<br />

http://sxsw.com/<br />

PAX East<br />

March 22-24, 2103 – Boston, MA<br />

http://east.paxsite.com/<br />

Augmented World Expo<br />

June 4-5, 2013 - Santa Clara, CA<br />

http://augmentedworldexpo.com/<br />

events<br />

October 2013 - Munich, Germany<br />

Discover <strong>the</strong> future of Augmented Reality at <strong>the</strong> annual InsideAR Augmented Reality Conference, hosted<br />

by <strong>Metaio</strong>. Visit <strong>the</strong> AR Live-expo and experience Augmented Reality hands-on with exhibits and demos<br />

presented by, <strong>Metaio</strong>, <strong>the</strong>ir partners and <strong>the</strong> growing community of certified developers. Keynotes and presentations<br />

from industry experts will take place during <strong>the</strong> conference, giving you insight into <strong>the</strong> numerous ways<br />

Augmented Reality is changing <strong>the</strong> world we know.<br />

For more information visit www.metaio.com/insideAR<br />

CeBIT ISMAR<br />

March 5-9, 2013 - Hannover, Germany<br />

CeBIT is <strong>the</strong> world’s largest trade fair showcasing<br />

digital IT (information technology) and telecommunications<br />

solutions for home and work environments.<br />

The key target groups are users from industry, <strong>the</strong><br />

wholesale and retail sectors, skilled trades, banks,<br />

<strong>the</strong> services sector, government agencies, science<br />

and all users passionate about technology.<br />

Learn More at http://www.cebit.de/<br />

3 4 5 6 7 8 9 10 11 12 13 14 15<br />

October 1-4, 2013 - Adelaide, SA, Australia<br />

The 2013 ISMAR (International Symposium on<br />

Mixed and Augmented Reality) conference showcases<br />

<strong>the</strong> diversity and quality of work in Mixed and<br />

Augmented Reality, with a top-quality collection of<br />

workshops, tutorials, panels, papers, posters, and<br />

late advances in Science & Technology and Art,<br />

Media and Humanities programs.<br />

Learn More at http://ismar.vgtc.org/<br />

15


The Augmented Reality Magazine<br />

www.metaio.com

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!