Download the .pdf - Metaio
Download the .pdf - Metaio
Download the .pdf - Metaio
You also want an ePaper? Increase the reach of your titles
YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.
The Augmented Reality Magazine No. 3 | February 2013<br />
Spotlight on <strong>Metaio</strong> Creator<br />
The Difficulties of being Droid<br />
AR in <strong>the</strong> Construction Industry
2<br />
The Augmented Reality Magazine No. 3 | February 2013<br />
Augmented Reality in Construction<br />
13<br />
LEGO Digital Box<br />
10<br />
4<br />
The <strong>Metaio</strong> AREngine<br />
6<br />
The <strong>Metaio</strong> Creator<br />
14<br />
Enterprise Solutions<br />
12<br />
Android Fragmentation<br />
3 4 5 6 7 8 9 10 11 12 13 14 15<br />
in this issue<br />
forum<br />
The World’s First AR<br />
Processing Unit 3<br />
focus<br />
The <strong>Metaio</strong> AREngine 4<br />
features<br />
The <strong>Metaio</strong> Creator 6<br />
AR in Minutes 7<br />
AR Excitement for 2013 8<br />
Global Mobile Awards 2013 9<br />
AR in Construction 10<br />
Android Fragmentation 12<br />
fragments<br />
LEGO Digital Box 13<br />
<strong>Metaio</strong> Enterprise Solutions 14<br />
events<br />
InsideAR: The Augmented<br />
Reality Conference 15<br />
CeBIT 15<br />
ISMAR 15<br />
insideAR Team<br />
Editor:<br />
Daniel Gelder<br />
Creative Director:<br />
Christopher Zak<br />
Communications Director:<br />
Trak Lord<br />
Copy Editors:<br />
Matthias Greiner<br />
Nikoleta Notova<br />
Design and Layouts:<br />
María Barrena<br />
metaio GmbH<br />
Infanteriestrasse 19, Haus 4B<br />
80797 München, Germany<br />
+49 89 5480 198 0<br />
metaio, Inc.<br />
375 Alabama Street<br />
San Francisco, CA 94110<br />
+1 415 814 3376<br />
www.metaio.com
Press Release<br />
<strong>Metaio</strong> brings world’s first Augmented Reality<br />
Accelerated chipset to market, signs agreement with<br />
ST-Ericsson to integrate future mobile platforms<br />
SAN FRANCISCO – FEBRUARY 21, 2013: <strong>Metaio</strong> today announces an agreement with ST-Ericsson, a leader<br />
in wireless platforms and semiconductors. Under <strong>the</strong> terms of <strong>the</strong> agreement, ST-Ericsson will integrate<br />
<strong>Metaio</strong>’s Augmented Reality hardware IP, <strong>the</strong> so-called “AREngine,” into <strong>the</strong> next generation of ST-Ericsson<br />
mobile platforms resulting in <strong>the</strong> first application processor accelerating Augmented Reality performance<br />
on mobile devices.<br />
<strong>Metaio</strong>’s cutting-edge technology inserts nearly any 3-D and virtual content into <strong>the</strong> real world by recognizing images,<br />
objects and entire environments. In a mobile future that clearly requires smart devices to be ‘always on’ and<br />
connected, <strong>the</strong> <strong>Metaio</strong> AREngine drastically reduces power consumption making all-day AR experiences possible.<br />
This first-of-its-kind collaboration will improve nearly all aspects of an Augmented Reality experience, yielding performance<br />
increases in speed, precision and power consumption, with up to 60 times faster initialization, more than<br />
an AR app running on existing platforms – <strong>the</strong> highest to date in <strong>the</strong> mobile industry. Both <strong>Metaio</strong> and ST-Ericsson<br />
strongly believe that working toge<strong>the</strong>r will accelerate <strong>the</strong> adoption of Augmented Reality as a consumer technology.<br />
“The AREngine will do for Augmented Reality what <strong>the</strong> GPU did years ago for <strong>the</strong> gaming industry,” said <strong>Metaio</strong><br />
CTO Peter Meier. “This is a great leap in <strong>the</strong> AR space, and we strongly believe that <strong>the</strong> AR Engine working with<br />
ST-Ericsson platforms will help realize <strong>the</strong> Augmented City - <strong>the</strong> idea of a completely connected environment<br />
powered by Augmented Reality and made possible with next-gen, optimized mobile platforms.”<br />
“Working toge<strong>the</strong>r, this will be <strong>the</strong> first ever integration of dedicated AR hardware IP on silicon,” said Björn Ekelund,<br />
head of Ecosystem Research and Innovation for ST-Ericsson. “By continuing our relationship with <strong>Metaio</strong>, this<br />
agreement will provide a competitive advantage to both companies and our customers in <strong>the</strong> smartphone and<br />
AR space, where people are looking for differentiating factors when making <strong>the</strong>ir purchase decisions. AR will no<br />
longer be limited to simple 2-D images - with <strong>Metaio</strong>’s AREngine, <strong>the</strong> future possibilities are endless.”<br />
Visitors to <strong>the</strong> 2013 Mobile World Congress in Barcelona will be treated to live demonstrations of <strong>Metaio</strong>’s technology<br />
and <strong>the</strong> benefits of Augmented Reality hardware integration. For more information, visit www.metaio.com/mwc<br />
Watch <strong>the</strong> AREngine video: http://youtu.be/6br7NreTwD4<br />
###<br />
About <strong>Metaio</strong><br />
The worldwide leader in Augmented Reality (AR) research and technology, <strong>Metaio</strong> develops software products<br />
for visually interactive solutions between <strong>the</strong> real and <strong>the</strong> virtual world. Based on <strong>the</strong> <strong>Metaio</strong> Augmented Reality<br />
platform, digital and 3-D content can be integrated seamlessly into <strong>the</strong> user’s camera view looking upon <strong>the</strong> real<br />
world. Powering over 1,000 apps for enterprise, marketing, retail, publishing and industrial cases, over 30 Million<br />
consumers use <strong>Metaio</strong>’s AR software. Learn more at www.metaio.com<br />
About ST-Ericsson<br />
ST-Ericsson is a world leader in developing and delivering a complete portfolio of innovative mobile platforms and<br />
cutting-edge wireless semiconductor solutions across <strong>the</strong> broad spectrum of mobile technologies. ST-Ericsson<br />
was established as a 50/50 joint venture by STMicroelectronics (NYSE:STM) and Ericsson (NASDAQ:ERIC) in<br />
February 2009, with headquarters in Geneva, Switzerland.<br />
3 4 5 6 7 8 9 10 11 12 13 14 15<br />
forum The World’s First AR Processing Unit<br />
3
focus The <strong>Metaio</strong> AREngine<br />
Accelerating Augmented Reality: The <strong>Metaio</strong> AREngine<br />
The AREngine and <strong>the</strong> journey to<br />
<strong>the</strong> first AR-ready smartphone<br />
Nearly a decade ago, to <strong>the</strong> day, Thomas Alt and Peter<br />
Meier founded <strong>Metaio</strong> with <strong>the</strong> intent of advancing<br />
Augmented Reality (AR) as <strong>the</strong> primary interface for<br />
experiencing <strong>the</strong> digital and online worlds. This was a<br />
time when <strong>the</strong> most popular mobile device’s (<strong>the</strong> Nokia<br />
1100) features were limited to SMS and a calculator.<br />
The dawn of <strong>the</strong> era of <strong>the</strong> smartphone really did<br />
change everything for <strong>the</strong> Augmented Reality industry,<br />
as suddenly <strong>the</strong> average user could experience through<br />
mobile cameras <strong>the</strong> same visual elements formerly<br />
restricted to factory-floor AR installations running on<br />
offline high-powered PCs.<br />
Back <strong>the</strong>n it was clear that computer vision and<br />
Augmented Reality experiences would greatly benefit<br />
from optimizing <strong>the</strong> software for individual handsets and<br />
chipset platforms. It was <strong>the</strong>n that <strong>Metaio</strong> embarked on<br />
developing relationships with OEMs, handset manufacturers<br />
and chipset platforms in order to one day realize a<br />
fully optimized device, ready for Augmented Reality from<br />
<strong>the</strong> moment <strong>the</strong> consumer removes it from <strong>the</strong> shelf.<br />
Despite hardware limitations, <strong>Metaio</strong> was able to make<br />
leaps and bounds with applied research and lowlevel<br />
optimizations. Their award-winning R&D team<br />
was responsible for <strong>the</strong> first commercial deployment<br />
of 3-D tracking and recognition on a mobile device.<br />
<strong>Metaio</strong>’s engineers were also <strong>the</strong> first to align a given<br />
4<br />
smartphone camera with gravity, educating <strong>the</strong> sensor<br />
on how to better perceive its surroundings like <strong>the</strong> human<br />
eye. In fact, <strong>Metaio</strong> has made incredible software<br />
developments in 2012 alone.<br />
In 2009, it was no less than a technological feat to get<br />
a top-of-<strong>the</strong>-line HD camera connected to an offline<br />
desktop PC to recognize a single pre-designed image<br />
and render a single 3-D model in real-time. With <strong>the</strong><br />
latest low-level optimizations, <strong>Metaio</strong> has achieved<br />
recognizing 100 unique images and overlaying 100<br />
unique 3-D models, all on a mobile device. If <strong>Metaio</strong><br />
can accomplish <strong>the</strong>se things without having any prior<br />
access to <strong>the</strong> processors and sensors inside <strong>the</strong>se devices,<br />
imagine what mobile users could do with a fully<br />
AR-ready smartphone.<br />
Whe<strong>the</strong>r it’s Google’s Project: Glass concept or popular<br />
movies like Minority Report or Terminator, nearly all of<br />
<strong>the</strong> popular references to Augmented Reality depict an<br />
“always on” interface. The camera is constantly scanning,<br />
detecting, recognizing and overlaying information<br />
and content onto <strong>the</strong> real world. In order to achieve this<br />
vision (something <strong>Metaio</strong> refers to as <strong>the</strong> “Augmented<br />
City”) of ubiquitous interaction, it is imperative that <strong>the</strong><br />
groups developing <strong>the</strong> hardware are working with those<br />
developing <strong>the</strong> software.<br />
For this reason, <strong>Metaio</strong> began developing a piece of<br />
hardware IP now known as <strong>the</strong> “AREngine”, an architecture<br />
designed specifically to accelerate Augmented<br />
3 4 5 6 7 8 9 10 11 12 13 14 15
Reality performance in mobile hardware, and one of<br />
<strong>Metaio</strong>’s longstanding platform partners, ST-Ericsson,<br />
will be <strong>the</strong> first to adopt and deploy it on silicon. The<br />
AREngine will propel Augmented Reality into <strong>the</strong> future<br />
and will do for <strong>the</strong> industry what <strong>the</strong> addition of <strong>the</strong> GPU<br />
did for <strong>the</strong> gaming industry.<br />
Before <strong>the</strong> populace sports head mounted displays that<br />
resemble eyeglasses; before society adopts wearable<br />
computing; before contact lenses come in 16, 32 and<br />
64 gigabyte models; before we exist in an Augmented<br />
World – <strong>the</strong>re must be <strong>the</strong> first step. The future of<br />
Augmented Reality starts now with <strong>the</strong> first ever introduction<br />
and implementation of <strong>the</strong> AREngine.<br />
Always On. Always Augmented.<br />
<strong>Metaio</strong> AREngine Features<br />
→ Higher performance enables an increase in scale and volume<br />
of Augmented Reality<br />
→ Faster initialization on 3-D point clouds allows for an increase<br />
in <strong>the</strong> volume and size of <strong>the</strong> 3-D point cloud<br />
→ Dramatic reduction in power consumption will allow for Allday<br />
AR experiences<br />
→ “Always on” of Augmented Reality usage for current & future<br />
devices requiring continuous AR visualization & search<br />
→ AREngine modules can be customized to meet <strong>the</strong><br />
semiconductors requirements<br />
3 4 5 6 7 8 9 10 11 12 13 14 15<br />
<strong>Metaio</strong> and Mobile World Congress<br />
a rich history of introducing <strong>the</strong> latest advances in AR<br />
Throughout <strong>the</strong> years <strong>Metaio</strong> and its partners have served as<br />
Augmented Reality ambassadors at <strong>the</strong> Mobile World Congress,<br />
delivering insightful speaking sessions, appearing in multiple<br />
technology panels and showcasing <strong>the</strong> latest technology on <strong>the</strong><br />
show floor.<br />
2010<br />
<strong>Metaio</strong> works with Sony Ericsson to showcase<br />
<strong>the</strong> latest image recognition technology on Sony<br />
Ericsson’s newest Android device at <strong>the</strong> time.<br />
2011<br />
<strong>Metaio</strong> demonstrates breakthroughs in mobile AR<br />
with Intel – including <strong>the</strong> first 3-D object recognition<br />
and tracking – and announces <strong>the</strong> first of many strategic<br />
OEM partnerships to come with ST-Ericsson.<br />
2012<br />
<strong>Metaio</strong> releases its Augmented City platform,<br />
complete with <strong>the</strong> first 3-D object recognition<br />
and tracking, to <strong>the</strong> entire mobile community,<br />
presenting its technology at <strong>the</strong> booths of multiple<br />
prominent OEMs, including ARM, Intel, Texas<br />
Instruments and, of course, ST-Ericsson.<br />
Junaio, <strong>the</strong> most advanced mobile Augmented Reality<br />
browser app is a fast and easy way to discover your<br />
world. Find local events, offers and listings; scan QR<br />
codes to get instant access to additional information;<br />
unlock augmented content on images and objects to<br />
play games or experience new virtual interactions.<br />
Broadway<br />
0.5mi<br />
focus The <strong>Metaio</strong> AR Engine<br />
0.1mi<br />
Madame<br />
Tussauds<br />
0.4mi<br />
Times Square<br />
for iOS and Android<br />
www.junaio.com<br />
5
features The <strong>Metaio</strong> Creator<br />
Spotlight on <strong>Metaio</strong> Creator, AR in Minutes<br />
The Internet would be nothing<br />
without content.<br />
The same is true for <strong>the</strong> Augmented Reality industry.<br />
Though <strong>Metaio</strong> works regularly with industrial and automotive<br />
clients on internal projects that <strong>the</strong> public rarely<br />
sees, <strong>the</strong> consumer side of augmented reality benefits<br />
from creative and engaging content, often created by<br />
partners and developers in <strong>the</strong> mobile community.<br />
The <strong>Metaio</strong> Creator had very humble beginnings as an<br />
online companion to <strong>Metaio</strong>’s mobile augmented reality<br />
browser, Junaio, to help new AR developers publish<br />
simple experiences. As <strong>the</strong> AR ecosystem evolved, so<br />
did <strong>the</strong> product. <strong>Metaio</strong> recognized that more than just<br />
developers needed to have access to development<br />
tools. Originally intended as a solution for <strong>the</strong> print industry,<br />
it became clear to <strong>Metaio</strong> that <strong>the</strong> technology<br />
appealed to a broader audience.<br />
Even today a still growing community of artists, designers<br />
and creative professionals involved with mixed and<br />
digital media want to use Augmented Reality as <strong>the</strong> next<br />
medium – and it was for that group of people that <strong>Metaio</strong><br />
released <strong>the</strong> first iteration of <strong>the</strong> Creator tool, a simple<br />
drag & drop desktop publishing solution that removed<br />
<strong>the</strong> need for programming.<br />
In October of 2012 <strong>Metaio</strong> announced at its annual<br />
InsideAR technology conference that it would introduce<br />
scalable augmented reality software and services<br />
6<br />
to <strong>the</strong> technology community in order to aid in <strong>the</strong><br />
creation of compelling AR content. Following InsideAR<br />
2012, <strong>Metaio</strong> heeded <strong>the</strong> requests of its burgeoning<br />
network and added better 3-D content support, native<br />
app creation capability, and cloud service offerings to<br />
<strong>the</strong> Creator, in addition to a version for OS X.<br />
Now nearly anyone can create augmented reality experiences<br />
and applications in just a few minutes and <strong>the</strong><br />
opportunities and potential uses increase exponentially.<br />
A creatively-minded person could simply augment his<br />
or her business card with a virtual resume or introduction;<br />
family members could attach <strong>the</strong> latest videos<br />
or images of important events to holiday greetings; a<br />
publisher could bring <strong>the</strong> most featured editorial content<br />
to life on <strong>the</strong> cover of a magazine or newspaper; a<br />
digital marketer could turn a print campaign into a fully<br />
integrated digital masterpiece, connecting <strong>the</strong> virtual<br />
assets with every physical aspect of <strong>the</strong> experience; or<br />
he or she could use <strong>the</strong> graphical user interface (GUI)<br />
designer to build a custom mobile AR application, all<br />
with just a few clicks.<br />
3 4 5 6 7 8 9 10 11 12 13 14 15<br />
Learn more at www.metaio.com/products/creator or stop by our<br />
booth at <strong>the</strong> 2013 Mobile World Congress in App Planet, Hall 8.1,<br />
booth 8.1E39 to talk to a member of our team.
Augmented Reality in just 3 steps with <strong>the</strong> <strong>Metaio</strong> Creator<br />
The creation of Augmented Reality experiences and<br />
scenarios has been, until recently, reserved for developers<br />
and programmers. Thanks to <strong>the</strong> <strong>Metaio</strong> Creator, a<br />
new AR authoring tool, editors, designers, students, and<br />
marketing agencies can create and visualize <strong>the</strong>ir own<br />
Augmented Reality ideas, concepts and applications<br />
without any programming knowledge necessary.<br />
Get started creating an Augmented Reality scenario in<br />
minutes with <strong>the</strong>se 3 easy steps:<br />
1. Upload your trackables and your digital content<br />
(videos, 3-D and/or 2-D assets, buttons, audio,<br />
etc.) by dragging & dropping <strong>the</strong>m directly into <strong>the</strong><br />
<strong>Metaio</strong> Creator. Files are automatically converted and<br />
optimized for <strong>the</strong> Augmented Reality scenario, and<br />
<strong>the</strong> trackables are evaluated and rated based on <strong>the</strong>ir<br />
quality for image recognition during <strong>the</strong> upload.<br />
2. Create your experience with just a few clicks… Align<br />
digital elements like buttons, videos or 3-D models<br />
with <strong>the</strong> trackable by dropping elements from <strong>the</strong><br />
Resources panel right onto <strong>the</strong> trackable image or<br />
3-D map. The application logic creates itself!<br />
3. Publish your Augmented Reality experience with just<br />
one click to junaio or <strong>the</strong> metaio cloud and try it out<br />
immediately on your smartphone or tablet.<br />
metaio Creator Features<br />
3 4 5 6 7 8 9 10 11 12 13 14 15<br />
features AR in Minutes<br />
→ Easy to use software and no developer background required<br />
→ Options to share your videos, images, audio and 3-D<br />
contents with millions of AR users<br />
→ Publish to <strong>Metaio</strong>’s existing AR Browser App, Junaio, with no<br />
app submission<br />
→ Build your own Augmented Reality app, from beginning to<br />
end, with <strong>the</strong> <strong>Metaio</strong> Creator<br />
→ Instant content updates without app resubmission through <strong>the</strong><br />
<strong>Metaio</strong> Cloud<br />
→ Integrated Analytics Manager for your AR campaigns<br />
→ Connected with <strong>the</strong> newest <strong>Metaio</strong> Cloud service<br />
<strong>Download</strong> <strong>Metaio</strong> Creator for FREE!<br />
Try for yourself, start creating AR scenarios using up<br />
to 2 tracking patterns and publish <strong>the</strong>m for free on<br />
<strong>the</strong> junaio AR browser! Available for Mac OSX (version<br />
10.7 & higher) and Windows.<br />
<strong>Download</strong> <strong>the</strong> metaio Creator at:<br />
www.metaio.com/products/creator<br />
7
features AR Excitement for 2013<br />
5 reasons to get excited about Augmented Reality in 2013<br />
Originally posted on venturebeat.com, December 23, 2012<br />
Augmented reality (AR) may seem like a futuristic concept,<br />
but it will be a reality of our digital lives in 2013. AR<br />
is a new technology that blurs <strong>the</strong> line between what’s<br />
real and what’s computer generated by enhancing<br />
what we hear, see and feel. Next year, I predict that it<br />
will be everywhere. Here are my five reasons why:<br />
The glasses are coming, <strong>the</strong> glasses are coming!<br />
Whe<strong>the</strong>r it’s Google’s Project Glass or concept videos<br />
along <strong>the</strong> lines of “Sight”, <strong>the</strong> Internet can’t get<br />
enough of Terminator Vision. A few companies have<br />
however made some pretty impressive technological<br />
leaps this year: this fall, Vuzix debuted <strong>the</strong>ir monocular<br />
AR prototype for industrial use at <strong>the</strong> annual InsideAR<br />
conference; Innovega showcased <strong>the</strong>ir Augmented<br />
Reality contact lens prototype at <strong>the</strong> 2012 Consumer<br />
Electronic show, for which <strong>the</strong>y’re currently seeking<br />
FDA approval; and researchers at <strong>the</strong> University of<br />
Washington successfully displayed a single pixel on an<br />
eye (albeit, that of a rabbit).<br />
In <strong>the</strong> meantime, retails brands like Oakley and game<br />
favorite Valve were just as quick to throw <strong>the</strong>ir hats in <strong>the</strong><br />
ring alongside patent applications from tech giants Apple<br />
and Microsoft. But don’t bo<strong>the</strong>r Santa with your letters<br />
– widely available (and affordable) wearable Augmented<br />
Reality devices probably won’t hit shelves until 2014.<br />
Smartphones will be<br />
AR-equipped<br />
We might not get Paul<br />
Smith AR goggles anytime<br />
soon, but expect OEMs,<br />
handset manufacturers<br />
and carriers to integrate<br />
optimized Augmented Reality, visual display and camera<br />
performance into <strong>the</strong> next generation of smartphones,<br />
because it’s basically already happening.<br />
Premier-to-punchline-to-rising-star Nokia recently<br />
launched <strong>the</strong> City Lens app, exclusive to its Lumia<br />
suite of devices. UK-based chip designer ARM has<br />
8<br />
had its eye on AR for a while, powering and optimizing<br />
experiences for its architecture found in <strong>the</strong> Samsung<br />
Galaxy SII, SIII and Note devices. And let us not forget<br />
Telefonica and <strong>the</strong>ir mad dash to serve mobile<br />
Augmented Reality advertisements to <strong>the</strong> entirety of<br />
<strong>the</strong>ir O2 network, alongside mobile coupons and location-based<br />
services.<br />
Location, Location, Location<br />
GPS and geodata were responsible early on for bringing<br />
Augmented Reality to <strong>the</strong> forefront. Applications<br />
like Junaio and Layar made a splash in <strong>the</strong> tech world,<br />
offering location-based navigational “channels” and “layers”<br />
where UFO-like billboards bobbed on <strong>the</strong> horizon,<br />
displaying information about your surroundings. In 2013<br />
expect to see <strong>the</strong> next generation of those GPS-based<br />
experiences, incorporating not only data from on-board<br />
sensors like <strong>the</strong> gyroscope and camera, but o<strong>the</strong>r niche<br />
mobile technologies that rely on proximity such as NFC.<br />
Companies like Hover are already deeply embedded in<br />
generating and augmenting 3-D maps of urban areas,<br />
and my company (AR firm <strong>Metaio</strong>) has successfully<br />
developed “snapping algorithms” that pull this kind of<br />
data from <strong>the</strong> cloud and tightly align it to <strong>the</strong> real world.<br />
Expect your city to get a lot more augmented in 2013.<br />
The death of <strong>the</strong><br />
gimmicky app<br />
Disclaimer: <strong>the</strong>re will always<br />
be marketers that<br />
abuse useful technology<br />
for <strong>the</strong>ir own nefarious,<br />
poorly designed purposes<br />
(re: QR codes), but expect<br />
to see brands move to better, faster and stronger apps<br />
that give <strong>the</strong>ir audience clear incentives for regular use.<br />
3-D bunnies smiling at you from conference marketing<br />
material may have seemed novel at <strong>the</strong> time, but creating<br />
a new app for each one-off experience is nei<strong>the</strong>r<br />
scalable nor tolerable from a user’s perspective.<br />
The 2013 IKEA Catalog app featured an Augmented<br />
Reality viewer that visualized furniture in 3-D and<br />
served related video and digital content to readers.<br />
It was <strong>the</strong> most downloaded branded app of 2012,<br />
even after launching in July. With that kind of success<br />
as a benchmark, expect o<strong>the</strong>r companies to start<br />
managing entire product lifecycles with Augmented<br />
Reality solutions- not unlike Mitsubishi Electric with<br />
<strong>the</strong>ir enterprise MeViewAR app that visualizes heating<br />
and cooling units in <strong>the</strong> real world. Mitsubishi Electric<br />
has already moved to <strong>the</strong> next phase for 2013, intending<br />
to visualize 3-D maintenance instructions for<br />
service technicians.<br />
3 4 5 6 7 8 9 10 11 12 13 14 15
The birth of <strong>the</strong> elusive killer app<br />
It doesn’t exist, and it probably won’t. Augmented<br />
Reality is a horizontal technology, which means that<br />
<strong>the</strong> nigh-limitless applications make it a challenging endeavor<br />
to develop <strong>the</strong> Evernote/YouTube/Wordpress/<br />
Instagram of Augmented Reality. We did however see<br />
<strong>the</strong> AR Angry Birds, and even if it isn’t official it’s still a<br />
pretty clear indication that a successful AR game could<br />
lead <strong>the</strong> way for massive adoption. There are already<br />
some good examples out <strong>the</strong>re, like <strong>the</strong> new JengAR<br />
game that inserts <strong>the</strong> 3-D content into <strong>the</strong> environment<br />
itself ra<strong>the</strong>r than needing a printed image.<br />
Expect more games to take this approach in 2013 as<br />
we move toward experiences that engage users in <strong>the</strong>ir<br />
actual surroundings. But <strong>the</strong> most amazing app for<br />
which <strong>the</strong> industry could possibly hope is only peripherally<br />
related to AR. 3-D content is tough. it’s difficult,<br />
expensive and time-consuming to create, and may present<br />
<strong>the</strong> biggest barrier to producing AR experiences.<br />
Augmented Reality needs an app that easily generates<br />
3-D content and exports it in major supported formats.<br />
Think “Draw Something” meets iMovie, in 3-D. That<br />
would be something!<br />
SOUTH<br />
ENTRANCE<br />
1<br />
2<br />
5<br />
3<br />
7<br />
4<br />
6<br />
8.1<br />
8<br />
NORTH<br />
ENTRANCE<br />
<strong>Metaio</strong> Nominated for 18th Annual<br />
Global Mobile Awards<br />
We’re pleased to announce that <strong>Metaio</strong> has been<br />
nominated for <strong>the</strong> prestigious 2013 Global Mobile<br />
Awards for <strong>the</strong> 2013 Mobile World Congress in<br />
<strong>the</strong> category of Best Mobile Service or Product for<br />
Automotive. As <strong>Metaio</strong> has strong roots in AR applications<br />
for <strong>the</strong> car industry, we’re very proud to have<br />
<strong>the</strong> chance to present with our partner, Audi AG in<br />
Barcelona this year.<br />
<strong>Metaio</strong> and Audi AG worked toge<strong>the</strong>r to develop <strong>the</strong><br />
Audi eKurzinfo Augmented Reality assistant app.<br />
New Audi A1 owners can download <strong>the</strong> app for iOS<br />
devices and get introduced to <strong>the</strong>ir car in just a few<br />
minutes, with no manual necessary. Through <strong>the</strong><br />
app, <strong>the</strong> user can use <strong>Metaio</strong>’s visual search and<br />
recognition technology to identify insignia throughout<br />
<strong>the</strong> vehicle and receive immediate feedback on<br />
how to use that particular feature of <strong>the</strong> new Audi.<br />
The first iteration of <strong>the</strong> Audi eKurzinfo app was<br />
based purely on image recognition. For 2013,<br />
Audi will release <strong>the</strong> brand new version of <strong>the</strong> app<br />
featuring real-time visual graphics and advanced<br />
Augmented Reality interactions. Audi intends to roll<br />
out this service beyond <strong>the</strong> A1, starting with <strong>the</strong> A3<br />
but with <strong>the</strong> potential for future models as well.<br />
If you’re attending <strong>the</strong> Mobile World Congress in<br />
Barcelona this year, please come visit us! In addition<br />
<strong>the</strong> Awards Ceremony, <strong>Metaio</strong> will be in Hall 8.1 at<br />
<strong>the</strong> App Planet, showcasing <strong>the</strong> latest in Augmented<br />
Reality and 3-D technology. We are fortunate to<br />
also have amazing partners like Intel, Imagination<br />
Technology and ST-Ericsson, at whose booths you<br />
can see how <strong>Metaio</strong>’s technology works with some<br />
of <strong>the</strong> best chipset platforms and handsets out <strong>the</strong>re.<br />
Where to find <strong>Metaio</strong> @MWC 2013<br />
metaio ......App Planet, Hall 8.1, Stand 8.1E39<br />
Intel ........App Planet, Hall 8.1, Stand 8.1E20<br />
Imagination ..Hall 7, Stand 7I110<br />
ST-Ericsson ..Hall 7, Stand 7E111<br />
NVIDIA. .....Hall 7 Stand 7C110<br />
ARM .......Hall 6 Stand 6A31<br />
3 4 5 6 7 8 9 10 11 12 13 14 15<br />
features Global Mobile Awards 2013<br />
9
features AR in Construction<br />
Augmented Reality in <strong>the</strong> Construction Industry<br />
Augmented Reality (AR) enhances <strong>the</strong><br />
environment by allowing human senses to<br />
interact with richer and more compelling<br />
experiences through <strong>the</strong> addition of<br />
digital information to <strong>the</strong> real world.<br />
Virtual content can now coexist with <strong>the</strong> tangible world.<br />
The origins of Augmented Reality take <strong>the</strong>ir root from<br />
Ivan Su<strong>the</strong>rland 1965’s piece: “The Ultimate Display”.<br />
Since <strong>the</strong>n, <strong>the</strong> application and interest in AR has grown<br />
exponentially in various industries. While many have<br />
been quick to adopt Augmented Reality, <strong>the</strong> construction<br />
industry has been slow to embrace this new technology.<br />
In order to draw a better picture of <strong>the</strong> state of AR in<br />
<strong>the</strong> construction industry we sent 345 surveys to construction<br />
companies and received 34 responses. The<br />
majority of respondents were European with <strong>the</strong> remaining<br />
participants in North America, South America,<br />
Asia and Australia.<br />
Of <strong>the</strong> 38% already familiar with AR, 23% note <strong>the</strong><br />
technology is already implemented in <strong>the</strong> workplace,<br />
comprising only 9% of <strong>the</strong> responding companies.<br />
Surprisingly enough, nearly 90% said <strong>the</strong>y could think<br />
of ways that Augmented Reality could be useful within<br />
<strong>the</strong>ir respective workplaces.<br />
At this time, AR implementation seems to be restricted<br />
to a few large companies, while smaller building<br />
firms and architect offices are reluctant to adopt new<br />
10<br />
Survey: AR and Construction<br />
3 4 5 6 7 8 9 10 11 12 13 14 15<br />
Are you familiar with AR<br />
Does your company use AR?<br />
Would AR solve problems<br />
at your company?
technology tools due to finite resources. In addition,<br />
it is of note that 40% of those aware of AR but not<br />
yet using it in <strong>the</strong> workplace say that <strong>the</strong> technology is<br />
currently being investigated and that it could be used<br />
in <strong>the</strong> near future.<br />
A demonstration illustrating <strong>the</strong> advantages of AR in <strong>the</strong><br />
construction industry was showcased last year at <strong>the</strong><br />
InsideAR 2012 Augmented Reality conference in Munich,<br />
Germany. The aim of this demonstration was to visualize<br />
how <strong>the</strong> planning of a construction site, with <strong>the</strong> help of<br />
AR, provided significant improvements over traditional<br />
methods. The demo focused on <strong>the</strong> features of engineering<br />
and industrial based Augmented Reality and <strong>the</strong><br />
benefits it is able to bring to <strong>the</strong> construction industry.<br />
Features<br />
→ Virtual elements are augmented into <strong>the</strong> real world in real time<br />
→ Visualization of all devices and equipment involved in <strong>the</strong> project<br />
→ Crane range of motion visible through visualization of its radius<br />
→ See-through 3D radius of cranes models and range of motion<br />
→ Visualization of <strong>the</strong> various connection required to utilities<br />
→ Representation of <strong>the</strong> finished project<br />
→ Visualization of any additional information possible<br />
→ Visualization of <strong>the</strong> overall construction site’s structure and layout<br />
Benefits<br />
→ Planning takes place on site; no paper plan needed<br />
→ Determine optimal orientation and disposal of each and every unit<br />
→ Easily see how accessible <strong>the</strong> material storage and o<strong>the</strong>r<br />
necessary areas are<br />
→ Provides extensive feedback of crane interaction with<br />
surroundings in order to prevent collisions<br />
→ Base <strong>the</strong> layout of you construction site on <strong>the</strong> availability of<br />
utilities and maximize efficiency<br />
→ Instantly see how your construction project looks, interacts &<br />
impacts on <strong>the</strong> surroundings<br />
→ Superimpose <strong>the</strong> construction schedule to monitor <strong>the</strong> deadlines<br />
→ Improved coordination between delivery services and<br />
construction site logistics<br />
Quick Facts - <strong>Metaio</strong> Engineer:<br />
+ =<br />
→ Advantages of AR for Construction & Planning<br />
3 4 5 6 7 8 9 10 11 12 13 14 15<br />
features AR in Construction<br />
→ Reconstruct onsite virtual 3-D assets, materials, prototypes<br />
and environments, in real-time<br />
→ Insert and visualize objects obscured by real-world materials<br />
→ Reduce costs, test processes and simulate project conditions<br />
even in planning stages<br />
→ Visualize completed project in a real-world environment<br />
before it kicks off<br />
→ Optimize a project’s delivery with more efficient prior planning<br />
and design<br />
Learn more about <strong>Metaio</strong> Engineer!<br />
Contact us at sales@metaio.com for more information<br />
on what you can achieve with <strong>Metaio</strong> Engineer and<br />
industrial AR.<br />
www.metaio.com/products/engineer<br />
11
features Android Fragmentation<br />
The Difficulties of being Droid<br />
The first smartphone running Google’s<br />
Android mobile operating system was<br />
released in October 2008. Today, 1.3<br />
million android devices are activated<br />
daily, 70,000 of which are tablets.<br />
Due to it’s nature as an open platform, Android can<br />
be installed on any kind of device, with any kind of<br />
hardware, including different graphic capabilities,<br />
completely different and non-homogeneous screen<br />
sizes, different user inputs, on both high and low end<br />
devices. Android has even been seen running on cars,<br />
ovens and refrigerators. There are seemingly no limits<br />
when it comes to <strong>the</strong> myriad of devices and electronics<br />
that can run Android.<br />
This, however, presents a problem for companies and<br />
developers bringing applications, games, books, movies,<br />
music and magazines to <strong>the</strong> Google Play store.<br />
This problem is called fragmentation and is a result of<br />
nearly unlimited device variations and configurations, in<br />
respect to both <strong>the</strong> hardware and software.<br />
Developers want to take this fragmentation issue and<br />
make it work to <strong>the</strong>ir benefit, but clearly cannot be<br />
expected to make a single application for all Android<br />
devices and have it to work perfectly on every single<br />
one. For this reason, companies and developers are<br />
spending extra time and effort on <strong>the</strong>ir applications and<br />
optimizing <strong>the</strong> user interfaces to fit on every screen size<br />
or at <strong>the</strong> very least, <strong>the</strong> widest possible range of sizes,<br />
resolutions and combinations of screen orientations.<br />
Today, 1.3 million Android<br />
devices are activated daily<br />
Imagine great-looking app optimized for a smartphone<br />
with a smaller screen. How will it look when running on<br />
a different phone with a larger screen, or on a tablet<br />
in landscape orientation? On a higher resolution display,<br />
<strong>the</strong> interface components can be adjusted and<br />
positioned in a more visually engaging manner, or more<br />
information can be shown on <strong>the</strong> display. In regards to<br />
tablets, retaining <strong>the</strong> same layout may result in a waste<br />
of <strong>the</strong> usable screen real estate, resulting in <strong>the</strong> need<br />
to vary <strong>the</strong> user interface again or create a completely<br />
different version of <strong>the</strong> application.<br />
Introduced alongside Android 3.0 (Honeycomb), <strong>the</strong><br />
Fragments API has made it much easier to create an application,<br />
based on fragments, which is also backwards<br />
compatible with earlier Android devices. Fragments<br />
make it possible for developers to define sections of<br />
<strong>the</strong> user interface as individual units that can adjust<br />
12<br />
<strong>the</strong>ir location on screen depending on <strong>the</strong> screen size,<br />
resolution and orientation of <strong>the</strong> device. Now Android<br />
developers have <strong>the</strong> power to ensure that <strong>the</strong>ir applications<br />
offer quality user-experiences with less worry<br />
about which device <strong>the</strong> user may have in <strong>the</strong>ir hands.<br />
This is great for app development in general, and especially<br />
for Augmented Reality applications. With <strong>the</strong><br />
flexibility of <strong>the</strong> devices that <strong>the</strong> Fragments API allows<br />
developers to target, less time is necessary for user<br />
interface adjustments and backwards compatibility<br />
issues, allowing more time to be spent enhancing,<br />
perfecting and delivering <strong>the</strong> best Augmented Reality<br />
experiences possible. Augmented Reality is great for<br />
tablets and devices with larger displays, but users with<br />
smaller devices should also be able to easily experience<br />
all of <strong>the</strong> amazing AR content and applications<br />
being offered.<br />
The <strong>Metaio</strong> SDK for Android is also <strong>the</strong> only available<br />
augmented reality software with which developers can<br />
create native Android apps. In conjunction with <strong>the</strong><br />
Fragments API, developers not only have a much easier<br />
time optimizing applications for different devices, but<br />
can also rely on <strong>the</strong>ir creations to work as intended for<br />
<strong>the</strong> user or client. And one of <strong>the</strong> huge benefits of <strong>the</strong><br />
so-called fragmentation of <strong>the</strong> Android OS is that <strong>the</strong><br />
plentitude of devices running Android mean more users<br />
and more clients to reach in one of <strong>the</strong> largest mobile<br />
audiences in <strong>the</strong> world.<br />
And with Android expanding to automobiles and maybe<br />
even connected home appliances, developers will have<br />
myriad opportunities to create new experiences and interactions<br />
for all aspects of our daily lives. Windshields,<br />
mirrors, refrigerator “desktops”- and of course, Glass.<br />
Ei<strong>the</strong>r way, <strong>the</strong>y can rely on <strong>the</strong> <strong>Metaio</strong> Augmented<br />
Reality SDK to get <strong>the</strong>re.<br />
3 4 5 6 7 8 9 10 11 12 13 14 15
The LEGO Digital Box Augmented Reality Kiosk<br />
An eye-catching in-store AR solution for<br />
<strong>the</strong> most iconic toy company in <strong>the</strong> world<br />
Purchase decisions at <strong>the</strong> point of sale are mostly<br />
driven by <strong>the</strong> excitement of customers about a product.<br />
This certainly applies to <strong>the</strong> toy market.<br />
Customers tend to want to examine and interact with<br />
products before purchasing <strong>the</strong>m. Though LEGO is<br />
one of <strong>the</strong> world’s most renowned toy companies, consumers<br />
can only really interact with <strong>the</strong> product after<br />
purchasing, returning home and assembling it. LEGO<br />
wanted a way for potential consumers to engage with<br />
<strong>the</strong>ir toys ahead of time, so <strong>the</strong>y opted for an Augmented<br />
Reality point-of-sale experience to show <strong>the</strong> customer<br />
product features and to stimulate customers’ emotions<br />
towards <strong>the</strong> product.<br />
<strong>Metaio</strong> developed a custom AR application for LEGO<br />
based on <strong>the</strong> <strong>Metaio</strong> SDK - <strong>the</strong> LEGO Digital Box. The<br />
application relies on image detection and tracking to<br />
recognize <strong>the</strong> different LEGO boxes and visualize 3-D<br />
animations of <strong>the</strong> finished LEGO models directly on top<br />
of <strong>the</strong> product packaging, complete with sound effects.<br />
The application was designed modularly so that content<br />
updates can be performed painlessly. Fur<strong>the</strong>rmore,<br />
statistical evaluation has shown a positive impact on<br />
<strong>the</strong> consumer experience and o<strong>the</strong>r targets of LEGO in<br />
regards to <strong>the</strong> DIGITAL BOX.<br />
Children can now hold LEGO packaging up to <strong>the</strong><br />
DIGITAL BOX and watch a 3-D animation of <strong>the</strong> product,<br />
from any angle and in every detail - all in <strong>the</strong>ir<br />
hands. The installation not only creates a fascinating<br />
technological experience, but also gives in-store retailers<br />
a unique positioning opportunity to educate and<br />
influence purchasing decisions.<br />
“The DIGITAL BOX helps consumers get a better<br />
impression of our products,” says Torben Nielsen,<br />
Director of 3D technology from LEGO Group’s Digital<br />
Development Department, and adds: “We’ve had very<br />
positive feedback from our stores and customers.<br />
Thanks to <strong>Metaio</strong>’s technology, we can excite and inform<br />
our customers on a new level.”<br />
Quick Facts<br />
→ Start of <strong>the</strong> initial evaluation phase in November 2008<br />
→ Worldwide brand store rollout began in April 2010<br />
→ Using <strong>the</strong> <strong>Metaio</strong> SDK<br />
→ Bringing customer excitement to a new level<br />
3 4 5 6 7 8 9 10 11 12 13 14 15<br />
fragments LEGO Digital Box<br />
→ Most successful Augmented Reality application worldwide<br />
13
fragments <strong>Metaio</strong> Enterprise Solutions<br />
Mitsubishi Electric Cooling & Heating Relies on<br />
Augmented Reality Enterprise Solutions from <strong>Metaio</strong><br />
To boost adoption of its ductless air conditioning and<br />
heating products, Mitsubishi Electric Cooling & Heating<br />
needed to more effectively show consumers what an<br />
installed unit would look like in <strong>the</strong>ir home. As a result of<br />
deploying <strong>the</strong> metaio Enterprise Solution (MES), a mobile<br />
augmented reality app, to each of its sales channel<br />
representatives. Mitsubishi Electric has projected an<br />
increase of $30 million in revenue. They also forecast<br />
decreasing by millions <strong>the</strong> future costs for printing and<br />
distributing product catalogs.<br />
The latest innovations in comfort technology and energy-efficient<br />
ductless HVAC systems are provided<br />
by Mitsubishi Electric Cooling & Heating, a division of<br />
Mitsubishi Electric & Electronics USA, Inc. Ductless<br />
systems are 30% more energy-efficient than unitary<br />
HVAC and offer personalized comfort control in each<br />
room or zone.<br />
Mitsubishi Electric provides sales tools, technical support<br />
and training to contractors, distributors, engineers and<br />
architects on its award-winning line of variable refrigerant<br />
flow (VRF) and ductless systems for commercial and<br />
residential, respectively, installations. With over 25,000<br />
contractors and 1,500 distributors nationwide, Mitsubishi<br />
Electric needed a solution to streamline <strong>the</strong> delivery of<br />
information and education of its sales channel.<br />
Gabriel Weiss, head of Interactive Marketing Technologies<br />
for Mitsubishi Electric, recognized a number of issues with<br />
<strong>the</strong> company’s multi-faceted communication network.<br />
Weiss found redundancies and shortcomings, including<br />
marketing strategies that competed with each o<strong>the</strong>r.<br />
14<br />
For example, product and pricing information in print<br />
catalogs was becoming out of date before <strong>the</strong> next<br />
catalog was even drafted. They need a solution that<br />
could be updated year-round. And while product was<br />
pictured in <strong>the</strong>se print catalogs, being able to show <strong>the</strong><br />
product actually in <strong>the</strong> customer’s space would answer<br />
<strong>the</strong> most frequently asked question from customers,<br />
“What will it look like on my wall?”.<br />
Mitsubishi Electric Cooling and<br />
Heating is generating an additional<br />
$30 million in annual sales by<br />
visualizing products with <strong>the</strong><br />
metaio Enterprise Solution<br />
Weiss’ vision for Mitsubishi Electric is “Using technology<br />
to sell our technology,” so <strong>the</strong> value of having a<br />
custom-branded app through which products could be<br />
“seen” was invaluable.<br />
“Using <strong>the</strong> metaio augmented reality technology we<br />
are able to give our customers a mobile product visualization<br />
tool that is completely unique to our industry.<br />
Giving <strong>the</strong>m a competitive advantage and making <strong>the</strong><br />
sales process more efficient for <strong>the</strong>m.”<br />
To visualize a unit exactly as it would appear installed in<br />
a customer’s home, Mitsubishi Electric sales representatives<br />
simply place a 18-inch by 18-inch Post-It Note<br />
marker on <strong>the</strong> wall where <strong>the</strong> unit should appear and<br />
launch <strong>the</strong> meVIEW AR app on an iPad. When <strong>the</strong><br />
user points <strong>the</strong> iPad’s camera towards <strong>the</strong> marker, <strong>the</strong><br />
product is automatically displayed to scale where <strong>the</strong><br />
marker is on <strong>the</strong> wall. The user can <strong>the</strong>n tap to place<br />
any product on <strong>the</strong> same location and share of photo<br />
of it via email with family or project decision makers.<br />
Using this technology, products can be visualized in<br />
any location throughout a customer’s home or office.<br />
Mitsubishi Electric also opted to include social features,<br />
so that photos taken of <strong>the</strong> augmented experience can<br />
be posted to Twitter and Facebook.<br />
Learn more about <strong>Metaio</strong> AR<br />
Enterprise Solutions<br />
Contact sales@metaio.com for more information<br />
on how <strong>Metaio</strong> Enterprise Solutions can solve your<br />
Augmented Reality needs.<br />
www.metaio.com/enterprise<br />
3 4 5 6 7 8 9 10 11 12 13 14 15
InsideAR: The Augmented Reality Conference<br />
Meet <strong>Metaio</strong> all over <strong>the</strong> world<br />
GPU Technology Conference<br />
March 18-21, 2013 – San Jose, California<br />
http://www.gputechconf.com/page/home.html<br />
Game Developers Conference<br />
March 25-29, 2013 – San Francisco, CA<br />
http://www.gdconf.com/<br />
Gartner CIO Leadership Forum<br />
March 17-19, 2013 - Huntington Beach, CA<br />
http://www.gartner.com/technology/summits/na/cio/<br />
South By Southwest Interactive<br />
March 8-12, 2013 - Austin, TX<br />
http://sxsw.com/<br />
PAX East<br />
March 22-24, 2103 – Boston, MA<br />
http://east.paxsite.com/<br />
Augmented World Expo<br />
June 4-5, 2013 - Santa Clara, CA<br />
http://augmentedworldexpo.com/<br />
events<br />
October 2013 - Munich, Germany<br />
Discover <strong>the</strong> future of Augmented Reality at <strong>the</strong> annual InsideAR Augmented Reality Conference, hosted<br />
by <strong>Metaio</strong>. Visit <strong>the</strong> AR Live-expo and experience Augmented Reality hands-on with exhibits and demos<br />
presented by, <strong>Metaio</strong>, <strong>the</strong>ir partners and <strong>the</strong> growing community of certified developers. Keynotes and presentations<br />
from industry experts will take place during <strong>the</strong> conference, giving you insight into <strong>the</strong> numerous ways<br />
Augmented Reality is changing <strong>the</strong> world we know.<br />
For more information visit www.metaio.com/insideAR<br />
CeBIT ISMAR<br />
March 5-9, 2013 - Hannover, Germany<br />
CeBIT is <strong>the</strong> world’s largest trade fair showcasing<br />
digital IT (information technology) and telecommunications<br />
solutions for home and work environments.<br />
The key target groups are users from industry, <strong>the</strong><br />
wholesale and retail sectors, skilled trades, banks,<br />
<strong>the</strong> services sector, government agencies, science<br />
and all users passionate about technology.<br />
Learn More at http://www.cebit.de/<br />
3 4 5 6 7 8 9 10 11 12 13 14 15<br />
October 1-4, 2013 - Adelaide, SA, Australia<br />
The 2013 ISMAR (International Symposium on<br />
Mixed and Augmented Reality) conference showcases<br />
<strong>the</strong> diversity and quality of work in Mixed and<br />
Augmented Reality, with a top-quality collection of<br />
workshops, tutorials, panels, papers, posters, and<br />
late advances in Science & Technology and Art,<br />
Media and Humanities programs.<br />
Learn More at http://ismar.vgtc.org/<br />
15
The Augmented Reality Magazine<br />
www.metaio.com