Display of 3D Holoscopic content on ... - Brunel University
Display of 3D Holoscopic content on ... - Brunel University
Display of 3D Holoscopic content on ... - Brunel University
Create successful ePaper yourself
Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.
ICT Project <str<strong>on</strong>g>3D</str<strong>on</strong>g> VIVANT– Deliverable 6.4<br />
C<strong>on</strong>tract no.:<br />
248420<br />
<str<strong>on</strong>g>Display</str<strong>on</strong>g> <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> C<strong>on</strong>tent <strong>on</strong><br />
Auto-stereoscopic <str<strong>on</strong>g>Display</str<strong>on</strong>g><br />
Project Number:<br />
Project title:<br />
Deliverable Type:<br />
CEC Deliverable Number:<br />
248420<br />
<str<strong>on</strong>g>3D</str<strong>on</strong>g> VIVANT<br />
Public<br />
Resubmissi<strong>on</strong> Delivery Date: 15 th September 2011<br />
Actual Delivery Date: 1 st September 2011<br />
Title <str<strong>on</strong>g>of</str<strong>on</strong>g> the Deliverable:<br />
Workpackage:<br />
Nature <str<strong>on</strong>g>of</str<strong>on</strong>g> the Deliverable:<br />
Organisati<strong>on</strong>s:<br />
IST-248420/<strong>Brunel</strong>/WP06/PU/PR/Del-6-4<br />
<str<strong>on</strong>g>Display</str<strong>on</strong>g> <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> C<strong>on</strong>tent <strong>on</strong> Auto-stereoscopic <str<strong>on</strong>g>Display</str<strong>on</strong>g>s<br />
WP6<br />
Report<br />
1 <strong>Brunel</strong> <strong>University</strong> <strong>Brunel</strong><br />
2 Centre for Research and Technology Hellas – Informatics and<br />
Telematics Institute<br />
3 Institut für Rundfunktechnik GmbH<br />
4 Holografika<br />
5 RAI research centre<br />
6 Rundfunk Berlin-Brandenburg<br />
7 Instituto de Telecomunicações<br />
8 European Broadcast Uni<strong>on</strong><br />
9 Arnold & Richter Cine Technik<br />
Authors:<br />
Circulati<strong>on</strong> List:<br />
Amar Aggoun, Emmanuel Tsekleves Rafiq Swash and Shafik<br />
Salih<br />
Partners and Public <strong>on</strong> Internet<br />
Keywords: <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Display</str<strong>on</strong>g>s<br />
1
ICT Project <str<strong>on</strong>g>3D</str<strong>on</strong>g> VIVANT– Deliverable 6.4<br />
C<strong>on</strong>tract no.:<br />
248420<br />
<str<strong>on</strong>g>Display</str<strong>on</strong>g> <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> C<strong>on</strong>tent <strong>on</strong><br />
Auto-stereoscopic <str<strong>on</strong>g>Display</str<strong>on</strong>g><br />
C<strong>on</strong>tents<br />
FIGURE CAPTIONS ........................................................................................................................................... 3<br />
1. INTRODUCTION ....................................................................................................................................... 4<br />
1.1 EXECUTIVE SUMMARY .......................................................................................................................... 4<br />
1.2 DELIVERABLE STRUCTURE .................................................................................................................... 4<br />
2. <str<strong>on</strong>g>3D</str<strong>on</strong>g> DISPLAYS .............................................................................................................................................. 4<br />
2.1 MULTIVIEW AUTO-STEREOSCOPIC DISPLAYS ........................................................................................ 4<br />
2.2 <str<strong>on</strong>g>3D</str<strong>on</strong>g> HOLOSCOPIC DISPLAYS .................................................................................................................... 6<br />
3. COMPUTER GENERATED <str<strong>on</strong>g>3D</str<strong>on</strong>g> HOLOSCOPIC IMAGES. .................................................................. 9<br />
4. DISPLAY OF <str<strong>on</strong>g>3D</str<strong>on</strong>g> HOLOSCOPIC CONTENT ON MULTIVIEW STEREO DISPLAYS ................. 11<br />
4.1 ALIOSCOPY <str<strong>on</strong>g>3D</str<strong>on</strong>g> AUTO-STEREOSCOPIC DISPLAY .................................................................................. 12<br />
4.2 GENERATING <str<strong>on</strong>g>3D</str<strong>on</strong>g> HOLOSCOPIC CONTENT FOR ALIOSCOPY <str<strong>on</strong>g>3D</str<strong>on</strong>g> AUTO-STEREOSCOPIC DISPLAY ........... 15<br />
5. CONCLUSION .......................................................................................................................................... 16<br />
2
ICT Project <str<strong>on</strong>g>3D</str<strong>on</strong>g> VIVANT– Deliverable 6.4<br />
C<strong>on</strong>tract no.:<br />
248420<br />
FIGURE CAPTIONS<br />
<str<strong>on</strong>g>Display</str<strong>on</strong>g> <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> C<strong>on</strong>tent <strong>on</strong><br />
Auto-stereoscopic <str<strong>on</strong>g>Display</str<strong>on</strong>g><br />
FIGURE 1: MULTIVIEW AUTO-STEREOSCOPIC DISPLAY. ........................................................................................................ 6<br />
FIGURE 2: THE SLANTED ARRANGEMENT OF THE LENTICULAR LENS AND PIXELS IN THE MULTIVIEW AUTO-STEREOSCOPIC DISPLAYS. .... 6<br />
FIGURE 3: RECORDING OF A <str<strong>on</strong>g>3D</str<strong>on</strong>g> HOLOSCOPIC IMAGE. ........................................................................................................ 7<br />
FIGURE 4: RECORDED <str<strong>on</strong>g>3D</str<strong>on</strong>g> HOLOSCOPIC CONTENT SHOWING A 2D ARRAY OF MICRO-IMAGES. .................................................... 7<br />
FIGURE 5: <str<strong>on</strong>g>3D</str<strong>on</strong>g> HOLOSCOPIC DISPLAY. .............................................................................................................................. 8<br />
FIGURE 6: UNIDIRECTIONAL <str<strong>on</strong>g>3D</str<strong>on</strong>g> HOLOSCOPIC DISPLAY. ...................................................................................................... 8<br />
FIGURE 7: LENTICULAR SHEET MODEL IN INTEGRAL RAY TRACER. ........................................................................................... 9<br />
FIGURE 8: MICRO-LENS ARRAY IN INTEGRAL RAY TRACING. ................................................................................................ 10<br />
FIGURE 9: CAMERA MODEL OF <str<strong>on</strong>g>3D</str<strong>on</strong>g> HOLOSCOPIC IMAGING FOR COMPUTER GRAPHICS. ............................................................ 10<br />
FIGURE 10: CUTLERY SCENE IN OPENGL. ....................................................................................................................... 11<br />
FIGURE 11: CUTLERY SCENE IN OPENGL AFTER PROJECTION THROUGH A VIRTUAL LENTICULAR LENS ARRAY. ................................ 11<br />
FIGURE 12 - STEPS OF GENERATING INTERLACED IMAGE TO BE DISPLAYED ON ALIOSCOPY <str<strong>on</strong>g>3D</str<strong>on</strong>g> DISPLAY ....................................... 13<br />
FIGURE 13 - STEPS OF GENERATING 8 CAMERA IMAGES USING THE PLUG-INS/SCRIPTS FOR ALIOSCOPY MIX & PLAY ASSISTANT ...... 14<br />
FIGURE 14 – STEPS OF GENERATING INTEGRAL IMAGE TO BE DISPLAYED ON ALIOSCOPY <str<strong>on</strong>g>3D</str<strong>on</strong>g> DISPLAY .......................................... 15<br />
FIGURE 15 - PLAY-BACK ON <str<strong>on</strong>g>3D</str<strong>on</strong>g> HOLOSCOPIC CONTENT ON ALIOSCOPY DISPLAY .................................................................... 16<br />
3
ICT Project <str<strong>on</strong>g>3D</str<strong>on</strong>g> VIVANT– Deliverable 6.4<br />
C<strong>on</strong>tract no.:<br />
248420<br />
<str<strong>on</strong>g>Display</str<strong>on</strong>g> <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> C<strong>on</strong>tent <strong>on</strong><br />
Auto-stereoscopic <str<strong>on</strong>g>Display</str<strong>on</strong>g><br />
1. INTRODUCTION<br />
1.1 EXECUTIVE SUMMARY<br />
This document presents an update <strong>on</strong> the display <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g> <strong>on</strong> commercially available<br />
<str<strong>on</strong>g>3D</str<strong>on</strong>g> auto-stereoscopic display systems. Its main objective is to report the work carried out in the<br />
c<strong>on</strong>text <str<strong>on</strong>g>of</str<strong>on</strong>g> WP6/Task6.2 and to serve as a guideline during the deployment <str<strong>on</strong>g>of</str<strong>on</strong>g> the full parallax <str<strong>on</strong>g>3D</str<strong>on</strong>g><br />
<str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> display. The report also discusses the procedures for computer generated <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g><br />
<str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g>.<br />
Stereoscopic <str<strong>on</strong>g>3D</str<strong>on</strong>g> displays had been launched <strong>on</strong> the market by several companies worldwide such as<br />
Philips, Sharp, Alioscopy and Newsight Corporati<strong>on</strong>. However, auto-stereoscopic <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g> suffers<br />
from the eye fatigue issues. Since <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g> presentati<strong>on</strong> with horiz<strong>on</strong>tal parallax can<br />
be achieved by using lenticular sheet in associati<strong>on</strong> with an LCD. <str<strong>on</strong>g>3D</str<strong>on</strong>g> VIVANT will investigate the<br />
possibility <str<strong>on</strong>g>of</str<strong>on</strong>g> presenting <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g> <strong>on</strong> commercially available auto-stereoscopic displays<br />
based <strong>on</strong> the principles <str<strong>on</strong>g>of</str<strong>on</strong>g> lenticular array.<br />
Initial experimentati<strong>on</strong>s were carried out <strong>on</strong> the Philips display. A s<str<strong>on</strong>g>of</str<strong>on</strong>g>tware tool for remapping <str<strong>on</strong>g>of</str<strong>on</strong>g> the<br />
<str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g> was developed. However the results were unsatisfactory due to lack<br />
informati<strong>on</strong> regarding the lenticular sheet used in the Philips system. A substantial amount <str<strong>on</strong>g>of</str<strong>on</strong>g> test and<br />
adaptati<strong>on</strong>s <str<strong>on</strong>g>of</str<strong>on</strong>g> some finding were carried out to find out a soluti<strong>on</strong>.<br />
The latest experiments were carried out <strong>on</strong> the Alioscopy <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Display</str<strong>on</strong>g> and a s<str<strong>on</strong>g>of</str<strong>on</strong>g>tware tools was<br />
developed to generate <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g> for the display. The results are extremely satisfactory<br />
and for the first time it is proved that <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g> can be displayed <strong>on</strong> commercially<br />
available Multi-view auto-stereoscopic displays.<br />
1.2 DELIVERABLE STRUCTURE<br />
The rest <str<strong>on</strong>g>of</str<strong>on</strong>g> the document is structured as follows:<br />
Secti<strong>on</strong> 2 describes <str<strong>on</strong>g>3D</str<strong>on</strong>g> display technologies, mainly focusing <strong>on</strong> multiview displays and <str<strong>on</strong>g>3D</str<strong>on</strong>g><br />
<str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> displays.<br />
Secti<strong>on</strong> 3 provides a brief discussi<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> the computer generati<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g>. Computer<br />
generated unidirecti<strong>on</strong>al <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> are used to dem<strong>on</strong>strated the display <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g><br />
<str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g> <strong>on</strong> multiview stereo displays.<br />
Secti<strong>on</strong> 4 describes the investigati<strong>on</strong>s carried out in attempt to display <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g> <strong>on</strong><br />
multiview stereo display. A mapping strategy <str<strong>on</strong>g>of</str<strong>on</strong>g> the <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> data <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g> <strong>on</strong> the Alioscopy<br />
<str<strong>on</strong>g>3D</str<strong>on</strong>g> mutiview stereo display is discussed and results provided.<br />
Secti<strong>on</strong> 5 presents some general remarks regarding <str<strong>on</strong>g>3D</str<strong>on</strong>g> holoscopic video displays and summarizes the<br />
c<strong>on</strong>clusi<strong>on</strong>s drawn for this deliverable.<br />
2. <str<strong>on</strong>g>3D</str<strong>on</strong>g> DISPLAYS<br />
2.1 MULTIVIEW AUTO-STEREOSCOPIC DISPLAYS<br />
The c<strong>on</strong>cept <str<strong>on</strong>g>of</str<strong>on</strong>g> using a lenticular lens array together with a multiview stereo image has l<strong>on</strong>g been<br />
used in <str<strong>on</strong>g>3D</str<strong>on</strong>g> photography both for entertainment and pr<str<strong>on</strong>g>of</str<strong>on</strong>g>essi<strong>on</strong>al purposes. The combinati<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> a<br />
lenticular and an electr<strong>on</strong>ic display provides an optically efficient way <str<strong>on</strong>g>of</str<strong>on</strong>g> making an electr<strong>on</strong>ic <str<strong>on</strong>g>3D</str<strong>on</strong>g><br />
display which does not require the viewer to wear special glasses. This removes a key barrier to<br />
acceptance <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> displays for everyday use but requires a significant change in approach to <str<strong>on</strong>g>3D</str<strong>on</strong>g><br />
4
ICT Project <str<strong>on</strong>g>3D</str<strong>on</strong>g> VIVANT– Deliverable 6.4<br />
C<strong>on</strong>tract no.:<br />
248420<br />
<str<strong>on</strong>g>Display</str<strong>on</strong>g> <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> C<strong>on</strong>tent <strong>on</strong><br />
Auto-stereoscopic <str<strong>on</strong>g>Display</str<strong>on</strong>g><br />
display design. Auto-stereoscopic displays using micro-optics in combinati<strong>on</strong> with an LCD element<br />
have become attractive to display designers and several new <str<strong>on</strong>g>3D</str<strong>on</strong>g> display types are now available<br />
commercially.<br />
Auto-stereoscopic displays have been dem<strong>on</strong>strated using a range <str<strong>on</strong>g>of</str<strong>on</strong>g> optical elements in combinati<strong>on</strong><br />
with an LCD including:<br />
• Parallax barriers, optical apertures aligned with columns <str<strong>on</strong>g>of</str<strong>on</strong>g> LCD pixels.<br />
• Lenticular optics, cylindrical lenses aligned with columns <str<strong>on</strong>g>of</str<strong>on</strong>g> LCD pixels.<br />
Currently there are a number <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Display</str<strong>on</strong>g>s available <strong>on</strong> the market which uses the combinati<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g><br />
lenticular optics in combinati<strong>on</strong> with LCD panels. Lenticular elements used in <str<strong>on</strong>g>3D</str<strong>on</strong>g> displays are<br />
typically cylindrical lenses arranged vertically with respect to a 2D display such as an LCD as shown<br />
in figure 1. The cylindrical lenses direct the diffuse light from a pixel so it can <strong>on</strong>ly be seen in a<br />
limited angle in fr<strong>on</strong>t <str<strong>on</strong>g>of</str<strong>on</strong>g> the display. In the case <str<strong>on</strong>g>of</str<strong>on</strong>g> two views, this allows different pixels to be<br />
directed to either the left or right viewing windows. However such a technology is used for<br />
multiview stereo displays to allow freedom <str<strong>on</strong>g>of</str<strong>on</strong>g> viewing <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g> by more than <strong>on</strong>e observer. For<br />
example a nine views display will use nine images, which are interlaced to form nine group <str<strong>on</strong>g>of</str<strong>on</strong>g> pixels<br />
per lenticular. In this case each pixel in every group <str<strong>on</strong>g>of</str<strong>on</strong>g> nine pixels is directed to a different viewing<br />
window.<br />
There are several drawbacks to the basic multi-view approach that are particularly apparent when<br />
electr<strong>on</strong>ic displays are used. The first is there is a black mask between LCD pixels and this is imaged<br />
into dark lines between each view window, which is distracting to observers when their eye crosses a<br />
window boundary. Also images with any significant depth will result in an image-flipping artefact as<br />
the observer moves their eye across <strong>on</strong>e view window and into the next. Finally as more views are<br />
used the horiz<strong>on</strong>tal resoluti<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> the images decreases rapidly. To overcome these problems Philips<br />
proposed a new approach to multi-view LCD display. A significant step forward was made by<br />
positi<strong>on</strong>ing the lenticular array at an angle to the LCD pixel array as shown in figure 2. This mixes<br />
adjacent views reducing image flipping problems and spreading the effect <str<strong>on</strong>g>of</str<strong>on</strong>g> the black mask making<br />
it less visible. The other benefit <str<strong>on</strong>g>of</str<strong>on</strong>g> this design is that each view has a better aspect ratio, rather than<br />
splitting the display horiz<strong>on</strong>tally into many views both horiz<strong>on</strong>tal and vertical directi<strong>on</strong>s are split.<br />
5
ICT Project <str<strong>on</strong>g>3D</str<strong>on</strong>g> VIVANT– Deliverable 6.4<br />
C<strong>on</strong>tract no.:<br />
248420<br />
<str<strong>on</strong>g>Display</str<strong>on</strong>g> <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> C<strong>on</strong>tent <strong>on</strong><br />
Auto-stereoscopic <str<strong>on</strong>g>Display</str<strong>on</strong>g><br />
Figure 1: Multiview auto-stereoscopic display.<br />
Slanted<br />
Lenticular optics<br />
LCD Panel<br />
Figure 2: The Slanted arrangement <str<strong>on</strong>g>of</str<strong>on</strong>g> the lenticular lens and pixels in the multiview auto-stereoscopic displays.<br />
2.2 <str<strong>on</strong>g>3D</str<strong>on</strong>g> HOLOSCOPIC DISPLAYS<br />
<str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> imaging (also known as Integral imaging) is a technique that is capable <str<strong>on</strong>g>of</str<strong>on</strong>g> creating<br />
and encoding a true volume spatial optical model <str<strong>on</strong>g>of</str<strong>on</strong>g> the object scene in the form <str<strong>on</strong>g>of</str<strong>on</strong>g> a planar intensity<br />
distributi<strong>on</strong> by using unique optical comp<strong>on</strong>ents. It is akin to holography in that <str<strong>on</strong>g>3D</str<strong>on</strong>g> informati<strong>on</strong><br />
recorded <strong>on</strong> a 2D medium can be replayed as a full <str<strong>on</strong>g>3D</str<strong>on</strong>g> optical model, however, in c<strong>on</strong>trast to<br />
holography, coherent light sources are not required. This c<strong>on</strong>veniently allows more c<strong>on</strong>venti<strong>on</strong>al live<br />
capture and display procedures to be adopted. With recent progress in the theory and microlens<br />
manufacturing, integral imaging is becoming a practical and prospective <str<strong>on</strong>g>3D</str<strong>on</strong>g> display technology and is<br />
attracting much interest in the <str<strong>on</strong>g>3D</str<strong>on</strong>g> area.<br />
To record a <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> image a regularly spaced array <str<strong>on</strong>g>of</str<strong>on</strong>g> small lenslets closely packed together in<br />
c<strong>on</strong>tact with an image sensor (as shown in figure 3). Each lenslet views the scene at a slightly<br />
different angle to its neighbour and therefore a scene is captured from many view points and parallax<br />
informati<strong>on</strong> is recorded. After processing, if the photographic transparency is re-registered with the<br />
original recording array and illuminated by diffuse white light from the rear, the object will be<br />
c<strong>on</strong>structed in space by the intersecti<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> ray bundles emanating from each <str<strong>on</strong>g>of</str<strong>on</strong>g> the lenslets.<br />
A <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> image is recorded in a regular block pixel pattern. The planar intensity distributi<strong>on</strong><br />
representing a <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> image is comprised <str<strong>on</strong>g>of</str<strong>on</strong>g> 2D array <str<strong>on</strong>g>of</str<strong>on</strong>g> M×M micro-images due to the<br />
structure <str<strong>on</strong>g>of</str<strong>on</strong>g> the microlens array used in the capture and replay. The rectangular aperture at the fr<strong>on</strong>t <str<strong>on</strong>g>of</str<strong>on</strong>g><br />
the camera and the regular structure <str<strong>on</strong>g>of</str<strong>on</strong>g> the hexag<strong>on</strong>al microlenses array used in the hexag<strong>on</strong>al grid<br />
(recording microlens array) gives rise to a regular ‘brick structure’ in the intensity distributi<strong>on</strong> as<br />
illustrated in Figure 4.<br />
6
ICT Project <str<strong>on</strong>g>3D</str<strong>on</strong>g> VIVANT– Deliverable 6.4<br />
C<strong>on</strong>tract no.:<br />
248420<br />
<str<strong>on</strong>g>Display</str<strong>on</strong>g> <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> C<strong>on</strong>tent <strong>on</strong><br />
Auto-stereoscopic <str<strong>on</strong>g>Display</str<strong>on</strong>g><br />
Recording<br />
Medium<br />
Microlens<br />
Array<br />
Figure 3: Recording <str<strong>on</strong>g>of</str<strong>on</strong>g> a <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> Image.<br />
The replay <str<strong>on</strong>g>of</str<strong>on</strong>g> the <str<strong>on</strong>g>3D</str<strong>on</strong>g> Integral images is achieved by placing a microlens array <strong>on</strong> the top <str<strong>on</strong>g>of</str<strong>on</strong>g> the<br />
recoded planar intensity distributi<strong>on</strong>s as shown in figure 5. The microlens array has to match exactly<br />
the structure <str<strong>on</strong>g>of</str<strong>on</strong>g> the planar intensity distributi<strong>on</strong>.<br />
Figure 4: Recorded <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g> showing a 2D Array <str<strong>on</strong>g>of</str<strong>on</strong>g> micro-images.<br />
7
ICT Project <str<strong>on</strong>g>3D</str<strong>on</strong>g> VIVANT– Deliverable 6.4<br />
C<strong>on</strong>tract no.:<br />
248420<br />
<str<strong>on</strong>g>Display</str<strong>on</strong>g> <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> C<strong>on</strong>tent <strong>on</strong><br />
Auto-stereoscopic <str<strong>on</strong>g>Display</str<strong>on</strong>g><br />
Microlens Array<br />
LCD Panel<br />
Figure 5: <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> <str<strong>on</strong>g>Display</str<strong>on</strong>g>.<br />
A special case <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> imaging system is to replace the 2D array <str<strong>on</strong>g>of</str<strong>on</strong>g> microlenses with a 1D<br />
cylindrical microlens array as shown in figure 6. The resulting images c<strong>on</strong>tain parallax in the<br />
horiz<strong>on</strong>tal directi<strong>on</strong> <strong>on</strong>ly and is referred to as Unidirecti<strong>on</strong>al <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> images. The M<br />
vertically running bands present in the planar intensity distributi<strong>on</strong> captured by the integral <str<strong>on</strong>g>3D</str<strong>on</strong>g><br />
camera are due to the regular structure <str<strong>on</strong>g>of</str<strong>on</strong>g> the 1D cylindrical microlens array used in the capture<br />
process.<br />
Computer generated unidirecti<strong>on</strong>al <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> are used to dem<strong>on</strong>strated the display <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g><br />
<str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g> <strong>on</strong> multiview stereo displays. For this purpose the next secti<strong>on</strong> will provide a<br />
brief discussi<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> the computer generati<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g>.<br />
Lenticular<br />
Optics<br />
LCD Panel<br />
Figure 6: Unidirecti<strong>on</strong>al <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> <str<strong>on</strong>g>Display</str<strong>on</strong>g>.<br />
8
ICT Project <str<strong>on</strong>g>3D</str<strong>on</strong>g> VIVANT– Deliverable 6.4<br />
C<strong>on</strong>tract no.:<br />
248420<br />
<str<strong>on</strong>g>Display</str<strong>on</strong>g> <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> C<strong>on</strong>tent <strong>on</strong><br />
Auto-stereoscopic <str<strong>on</strong>g>Display</str<strong>on</strong>g><br />
3. COMPUTER GENERATED <str<strong>on</strong>g>3D</str<strong>on</strong>g> HOLOSCOPIC IMAGES.<br />
A computer generated synthetic <str<strong>on</strong>g>3D</str<strong>on</strong>g> holoscopic image is presented as a two dimensi<strong>on</strong>al distributi<strong>on</strong><br />
<str<strong>on</strong>g>of</str<strong>on</strong>g> intensities termed a lenslet-encoded spatial distributi<strong>on</strong> (LeSD), which is ordered directly by the<br />
parameters <str<strong>on</strong>g>of</str<strong>on</strong>g> a decoding array <str<strong>on</strong>g>of</str<strong>on</strong>g> micro lenses used to replay the three-dimensi<strong>on</strong>al synthetic image.<br />
When viewed, the image exhibits c<strong>on</strong>tinuous parallax within a viewing z<strong>on</strong>e dictated by the field<br />
angle <str<strong>on</strong>g>of</str<strong>on</strong>g> the array <str<strong>on</strong>g>of</str<strong>on</strong>g> micro-lenses. The replayed image is a volumetric optical model, which exists in<br />
space at a locati<strong>on</strong> independent <str<strong>on</strong>g>of</str<strong>on</strong>g> the viewing positi<strong>on</strong>. This occurs because, unlike stereoscopic<br />
techniques, which present planar perspective views to the viewer’s eyes, each point within the volume<br />
<str<strong>on</strong>g>of</str<strong>on</strong>g> a <str<strong>on</strong>g>3D</str<strong>on</strong>g> holoscopic image is generated by the intersecti<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> ray pencils projected by the individual<br />
micro-lenses.<br />
Due to the nature <str<strong>on</strong>g>of</str<strong>on</strong>g> the recording process <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> imaging, many changes to the camera<br />
model used in standard computer generati<strong>on</strong> s<str<strong>on</strong>g>of</str<strong>on</strong>g>tware are carried out. To generate a unidirecti<strong>on</strong>al <str<strong>on</strong>g>3D</str<strong>on</strong>g><br />
<str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> image using a lenticular sheet, each lens acts like a cylindrical camera. A strip <str<strong>on</strong>g>of</str<strong>on</strong>g> pixels is<br />
associated with each lens forming a micro-image. Each cylindrical lens records a micro-image <str<strong>on</strong>g>of</str<strong>on</strong>g> the<br />
scene from a different angle as shown in the Figure 7. For micro-lens arrays each lens acts like a<br />
square or a hexag<strong>on</strong>al camera depending <strong>on</strong> the structure <str<strong>on</strong>g>of</str<strong>on</strong>g> the lenses, as shown in Figure 8. In the<br />
lateral cross secti<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> the lenticular or the micro-lenses, a pinhole model is used. In the case <str<strong>on</strong>g>of</str<strong>on</strong>g><br />
lenticular sheets, the pinhole forms a straight line parallel to the axis <str<strong>on</strong>g>of</str<strong>on</strong>g> the cylindrical lens in the<br />
vertical directi<strong>on</strong>. For each pixel, a primary ray is spawned. The recording path <str<strong>on</strong>g>of</str<strong>on</strong>g> the primary ray<br />
draws a straight line going forward towards the image plane and backward away from the image<br />
plane. Similar primary rays <str<strong>on</strong>g>of</str<strong>on</strong>g> neighbouring lenses are spawned to similar directi<strong>on</strong>s parallel to each<br />
other. Therefore highly correlated micro-images are produced which, is a property <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> holoscopic<br />
imaging.<br />
Figure 7: Lenticular sheet model in integral ray tracer.<br />
9
ICT Project <str<strong>on</strong>g>3D</str<strong>on</strong>g> VIVANT– Deliverable 6.4<br />
C<strong>on</strong>tract no.:<br />
248420<br />
<str<strong>on</strong>g>Display</str<strong>on</strong>g> <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> C<strong>on</strong>tent <strong>on</strong><br />
Auto-stereoscopic <str<strong>on</strong>g>Display</str<strong>on</strong>g><br />
Figure 8: Micro-lens array in integral ray tracing.<br />
The structure <str<strong>on</strong>g>of</str<strong>on</strong>g> the lenses and the camera model in the in <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> computer graphics affects<br />
the way primary rays are spawned as well as the spatial coherence am<strong>on</strong>g them.<br />
The camera model used for each micro-lens is the pinhole approximati<strong>on</strong>, where each micro-lens acts<br />
like a separate camera. The result is a set multiple cameras. Each <str<strong>on</strong>g>of</str<strong>on</strong>g> them records a micro-image <str<strong>on</strong>g>of</str<strong>on</strong>g><br />
the virtual scene from a different angle (See figure 9). Primary rays pass through the centre <str<strong>on</strong>g>of</str<strong>on</strong>g> the<br />
micro-lens and the image plane. The scene image straddles the micro-lens array. Therefore there are<br />
two recording directi<strong>on</strong>s, in fr<strong>on</strong>t and behind the micro-lens array.<br />
Figure 9: Camera model <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> imaging for computer graphics.<br />
The specific characteristics <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> holoscopic imaging, allows us to deal with each cylindrical lens<br />
separate from the others, and to measure the number <str<strong>on</strong>g>of</str<strong>on</strong>g> pixels behind each lens, focal length and the<br />
image width. All these parameters including the number <str<strong>on</strong>g>of</str<strong>on</strong>g> lenslets in the virtual cylindrical array are<br />
selected <strong>on</strong> the basis <str<strong>on</strong>g>of</str<strong>on</strong>g> the characteristics <str<strong>on</strong>g>of</str<strong>on</strong>g> the display device.<br />
The pixels intensity values <str<strong>on</strong>g>of</str<strong>on</strong>g> the micro-image for each lenslet are read, saved, and then mapped to<br />
10
ICT Project <str<strong>on</strong>g>3D</str<strong>on</strong>g> VIVANT– Deliverable 6.4<br />
C<strong>on</strong>tract no.:<br />
248420<br />
<str<strong>on</strong>g>Display</str<strong>on</strong>g> <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> C<strong>on</strong>tent <strong>on</strong><br />
Auto-stereoscopic <str<strong>on</strong>g>Display</str<strong>on</strong>g><br />
pixels locati<strong>on</strong>s <strong>on</strong> the screen so that all the vertical slots are displayed at the same time forming the<br />
<str<strong>on</strong>g>3D</str<strong>on</strong>g> holoscopic image. The locati<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> the vertical elemental image <strong>on</strong> the computer screen is identical<br />
to the locati<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> the corresp<strong>on</strong>ding lenslet in the virtual lenses array.<br />
Figure 10 shows the <str<strong>on</strong>g>3D</str<strong>on</strong>g> scene “cutlery” rendered in OpenGL. The scene was first built in <str<strong>on</strong>g>3D</str<strong>on</strong>g> max,<br />
and then exported by OpenGL via Blender and saved as MD2 files. Each object in the scene was<br />
exported, saved and uned as a separate MD2 file. Figure 11 shows the <str<strong>on</strong>g>3D</str<strong>on</strong>g> holoscopic image<br />
resulting from the projecti<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> the scene through the virtual lenticular lens array.<br />
Figure 10: Cutlery scene in OpenGL.<br />
Figure 11: Cutlery scene in OpenGL after projecti<strong>on</strong> through a virtual lenticular lens array.<br />
4. DISPLAY OF <str<strong>on</strong>g>3D</str<strong>on</strong>g> HOLOSCOPIC CONTENT ON MULTIVIEW<br />
STEREO DISPLAYS<br />
Original experimentati<strong>on</strong>s was carried out <strong>on</strong> the Philips multiview auto-Stereoscopic display has<br />
been studied and experimented as an example <str<strong>on</strong>g>of</str<strong>on</strong>g> commercially available <str<strong>on</strong>g>3D</str<strong>on</strong>g> displays. A 20-inch <str<strong>on</strong>g>3D</str<strong>on</strong>g><br />
11
ICT Project <str<strong>on</strong>g>3D</str<strong>on</strong>g> VIVANT– Deliverable 6.4<br />
C<strong>on</strong>tract no.:<br />
248420<br />
<str<strong>on</strong>g>Display</str<strong>on</strong>g> <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> C<strong>on</strong>tent <strong>on</strong><br />
Auto-stereoscopic <str<strong>on</strong>g>Display</str<strong>on</strong>g><br />
auto-stereoscopic display was designed to <str<strong>on</strong>g>of</str<strong>on</strong>g>fer lenticular lens design creating a variety <str<strong>on</strong>g>of</str<strong>on</strong>g> distinct <str<strong>on</strong>g>3D</str<strong>on</strong>g><br />
views. The <str<strong>on</strong>g>3D</str<strong>on</strong>g> Auto-stereoscopic display has an embedded hardware that accepts 2D-plus-depth<br />
format and renders 9 views to enable multiple viewers to see <str<strong>on</strong>g>3D</str<strong>on</strong>g> images at any <strong>on</strong>e time.<br />
The display player does not support 9-views <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g> as input. However, given that the <str<strong>on</strong>g>3D</str<strong>on</strong>g><br />
<str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g> is recorded as a single 2D data, then <strong>on</strong>ly the 2D input is used. Furthermore it is<br />
necessary to acquire the various parameter <str<strong>on</strong>g>of</str<strong>on</strong>g> the lenticular sheet used by the Philips including the<br />
slanting angle. Three important parameters namely, the focal length and pitch <str<strong>on</strong>g>of</str<strong>on</strong>g> each lenslet and the<br />
slanting angle <str<strong>on</strong>g>of</str<strong>on</strong>g> the lenticular sheet are required by the s<str<strong>on</strong>g>of</str<strong>on</strong>g>tware developed at <strong>Brunel</strong> <strong>University</strong> to<br />
computer generate <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> images for the Philips display. Unfortunately it was difficult to<br />
acquire this informati<strong>on</strong> from Philips. So we have adapted the informati<strong>on</strong> <strong>on</strong> an earlier versi<strong>on</strong><br />
published by Philips in 1999 for a 7 views <str<strong>on</strong>g>3D</str<strong>on</strong>g> LCD display. A s<str<strong>on</strong>g>of</str<strong>on</strong>g>tware tool has been developed to<br />
map the pixels <str<strong>on</strong>g>of</str<strong>on</strong>g> the 2D intensity distributi<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> a <str<strong>on</strong>g>3D</str<strong>on</strong>g> holoscopic image to fit into a slanted lenticular<br />
structure <str<strong>on</strong>g>of</str<strong>on</strong>g> the Philips display. Unfortunately this [rocedure did not provide satisfactory results due<br />
to<br />
(i) adapting the lenticular optical characteristics from previous development is not<br />
accurate enough and may have caused some <str<strong>on</strong>g>of</str<strong>on</strong>g> the problems;<br />
(ii) Missing informati<strong>on</strong> about the lenticular sheet such as the focal length and pitch <str<strong>on</strong>g>of</str<strong>on</strong>g><br />
each lenslet;<br />
(iii) The display does not accept multiple inputs.<br />
Due to the fact that the auto-stereoscopic Philips display has been disc<strong>on</strong>tinued and no l<strong>on</strong>ger<br />
commercially available, it was not possible to get access to the necessary informati<strong>on</strong> to allow<br />
accurate mapping <str<strong>on</strong>g>of</str<strong>on</strong>g> the <str<strong>on</strong>g>3D</str<strong>on</strong>g> holoscopic image <strong>on</strong>to the display.<br />
To solve this problem, the <strong>Brunel</strong> team c<strong>on</strong>tacted a number <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> auto-stereoscopic diplay<br />
manufactures. Alioscopy <str<strong>on</strong>g>3D</str<strong>on</strong>g> Auto-Stereoscopic display is <strong>on</strong>e <str<strong>on</strong>g>of</str<strong>on</strong>g> the systems studied and<br />
experimented with as an example <str<strong>on</strong>g>of</str<strong>on</strong>g> State <str<strong>on</strong>g>of</str<strong>on</strong>g> the art <str<strong>on</strong>g>3D</str<strong>on</strong>g> Auto-Stereoscopic <str<strong>on</strong>g>Display</str<strong>on</strong>g> to ensure the<br />
<str<strong>on</strong>g>3D</str<strong>on</strong>g>VIVANT <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g>s (<str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g>) can be replayed <strong>on</strong> the Alioscopy <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Display</str<strong>on</strong>g>.<br />
4.1 ALIOSCOPY <str<strong>on</strong>g>3D</str<strong>on</strong>g> AUTO-STEREOSCOPIC DISPLAY<br />
The 42-inch <str<strong>on</strong>g>3D</str<strong>on</strong>g> Auto-stereoscopic display is designed to <str<strong>on</strong>g>of</str<strong>on</strong>g>fer lenticular lens design creating 8 <str<strong>on</strong>g>of</str<strong>on</strong>g><br />
distinct auto-Stereoscopic views. The <str<strong>on</strong>g>3D</str<strong>on</strong>g> Auto-stereoscopic display has a play-back s<str<strong>on</strong>g>of</str<strong>on</strong>g>tware which<br />
accepts Mixed-C<strong>on</strong>tent and Mixed-<str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g> can be generated using Alioscopy Mix & <str<strong>on</strong>g>Display</str<strong>on</strong>g><br />
Assistant s<str<strong>on</strong>g>of</str<strong>on</strong>g>tware that accepts images from 8 cameras and then it renders 8 images into a single<br />
interlaced-image as shown in Figure 12.<br />
12
ICT Project <str<strong>on</strong>g>3D</str<strong>on</strong>g> VIVANT– Deliverable 6.4<br />
C<strong>on</strong>tract no.:<br />
248420<br />
<str<strong>on</strong>g>Display</str<strong>on</strong>g> <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> C<strong>on</strong>tent <strong>on</strong><br />
Auto-stereoscopic <str<strong>on</strong>g>Display</str<strong>on</strong>g><br />
Figure 12 - Steps <str<strong>on</strong>g>of</str<strong>on</strong>g> generating interlaced image to be displayed <strong>on</strong> Alioscopy <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Display</str<strong>on</strong>g><br />
13
ICT Project <str<strong>on</strong>g>3D</str<strong>on</strong>g> VIVANT– Deliverable 6.4<br />
C<strong>on</strong>tract no.:<br />
248420<br />
<str<strong>on</strong>g>Display</str<strong>on</strong>g> <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> C<strong>on</strong>tent <strong>on</strong><br />
Auto-stereoscopic <str<strong>on</strong>g>Display</str<strong>on</strong>g><br />
Alioscopy developed plug-ins/scripts for <str<strong>on</strong>g>3D</str<strong>on</strong>g> modelling commercial s<str<strong>on</strong>g>of</str<strong>on</strong>g>tware such as Cinema4d,<br />
Maya, and <str<strong>on</strong>g>3D</str<strong>on</strong>g>s MAX that can be used to generate <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g> for the <str<strong>on</strong>g>3D</str<strong>on</strong>g> display and the steps/processes<br />
are shown in Figure 13.<br />
Figure 13 - Steps <str<strong>on</strong>g>of</str<strong>on</strong>g> generating 8 camera images using the plug-ins/scripts for Alioscopy Mix & Play<br />
Assistant<br />
The process <str<strong>on</strong>g>of</str<strong>on</strong>g> generating MIXED <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g> for Alioscopy <str<strong>on</strong>g>3D</str<strong>on</strong>g> Auto-Stereoscopic display is studied and<br />
understood as it requires 8 perspective camera images or 8 rendered images from the Alioscopy plugins/scripts<br />
and then MIX and Play Assistant s<str<strong>on</strong>g>of</str<strong>on</strong>g>tware generates interlaced image with resoluti<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g><br />
1920x1080 pixel (interlacing 8 * 960x540 images).<br />
14
ICT Project <str<strong>on</strong>g>3D</str<strong>on</strong>g> VIVANT– Deliverable 6.4<br />
C<strong>on</strong>tract no.:<br />
248420<br />
<str<strong>on</strong>g>Display</str<strong>on</strong>g> <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> C<strong>on</strong>tent <strong>on</strong><br />
Auto-stereoscopic <str<strong>on</strong>g>Display</str<strong>on</strong>g><br />
4.2 GENERATING <str<strong>on</strong>g>3D</str<strong>on</strong>g> HOLOSCOPIC CONTENT FOR ALIOSCOPY <str<strong>on</strong>g>3D</str<strong>on</strong>g> AUTO-<br />
STEREOSCOPIC DISPLAY<br />
A research is carried out to c<strong>on</strong>firm that <str<strong>on</strong>g>3D</str<strong>on</strong>g>VIVANT <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g> can be replayed back <strong>on</strong><br />
State <str<strong>on</strong>g>of</str<strong>on</strong>g> the Art <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Display</str<strong>on</strong>g> (Alioscopy <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Display</str<strong>on</strong>g>). Figure 14 shows the steps involved in<br />
generating <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g> and as seen there are 8 orthographic images generated using <str<strong>on</strong>g>3D</str<strong>on</strong>g><br />
holoscopic camera and then those images are feed into the Mix & Play Assistant s<str<strong>on</strong>g>of</str<strong>on</strong>g>tware to mix and<br />
replayed <strong>on</strong> Alioscopy <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Display</str<strong>on</strong>g>.<br />
Figure 14 – Steps <str<strong>on</strong>g>of</str<strong>on</strong>g> generating integral image to be displayed <strong>on</strong> Alioscopy <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Display</str<strong>on</strong>g><br />
A couple <str<strong>on</strong>g>of</str<strong>on</strong>g> video clips are generated for this display and the steps are (1) a sequences <str<strong>on</strong>g>of</str<strong>on</strong>g> bitmap<br />
images are generated using the steps 1 to 4 (see Figure 14) and then (2) the bitmap images are<br />
c<strong>on</strong>verted to a video clips. The resulting images are shown in Figure 15.<br />
15
ICT Project <str<strong>on</strong>g>3D</str<strong>on</strong>g> VIVANT– Deliverable 6.4<br />
C<strong>on</strong>tract no.:<br />
248420<br />
<str<strong>on</strong>g>Display</str<strong>on</strong>g> <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> C<strong>on</strong>tent <strong>on</strong><br />
Auto-stereoscopic <str<strong>on</strong>g>Display</str<strong>on</strong>g><br />
Figure 15 - Play-back <strong>on</strong> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g> <strong>on</strong> Alioscopy <str<strong>on</strong>g>Display</str<strong>on</strong>g><br />
5. CONCLUSION<br />
In this report we have shown that the <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g> with horiz<strong>on</strong>tal parallax can be<br />
displayed <strong>on</strong> commercially available multiview auto-stereoscopic displays. To our knowledge this<br />
the first time this has been achieved. For this study the Alioscopy display has been used.<br />
Part <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> VIVANT project objectives is to design a <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> display. This study will form the<br />
basis <str<strong>on</strong>g>of</str<strong>on</strong>g> the development <str<strong>on</strong>g>of</str<strong>on</strong>g> the <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> display with full parallax based <strong>on</strong> a combinati<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g><br />
microlens arrays with LCD.<br />
16