27.01.2015 Views

Display of 3D Holoscopic content on ... - Brunel University

Display of 3D Holoscopic content on ... - Brunel University

Display of 3D Holoscopic content on ... - Brunel University

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

ICT Project <str<strong>on</strong>g>3D</str<strong>on</strong>g> VIVANT– Deliverable 6.4<br />

C<strong>on</strong>tract no.:<br />

248420<br />

<str<strong>on</strong>g>Display</str<strong>on</strong>g> <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> C<strong>on</strong>tent <strong>on</strong><br />

Auto-stereoscopic <str<strong>on</strong>g>Display</str<strong>on</strong>g><br />

Project Number:<br />

Project title:<br />

Deliverable Type:<br />

CEC Deliverable Number:<br />

248420<br />

<str<strong>on</strong>g>3D</str<strong>on</strong>g> VIVANT<br />

Public<br />

Resubmissi<strong>on</strong> Delivery Date: 15 th September 2011<br />

Actual Delivery Date: 1 st September 2011<br />

Title <str<strong>on</strong>g>of</str<strong>on</strong>g> the Deliverable:<br />

Workpackage:<br />

Nature <str<strong>on</strong>g>of</str<strong>on</strong>g> the Deliverable:<br />

Organisati<strong>on</strong>s:<br />

IST-248420/<strong>Brunel</strong>/WP06/PU/PR/Del-6-4<br />

<str<strong>on</strong>g>Display</str<strong>on</strong>g> <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> C<strong>on</strong>tent <strong>on</strong> Auto-stereoscopic <str<strong>on</strong>g>Display</str<strong>on</strong>g>s<br />

WP6<br />

Report<br />

1 <strong>Brunel</strong> <strong>University</strong> <strong>Brunel</strong><br />

2 Centre for Research and Technology Hellas – Informatics and<br />

Telematics Institute<br />

3 Institut für Rundfunktechnik GmbH<br />

4 Holografika<br />

5 RAI research centre<br />

6 Rundfunk Berlin-Brandenburg<br />

7 Instituto de Telecomunicações<br />

8 European Broadcast Uni<strong>on</strong><br />

9 Arnold & Richter Cine Technik<br />

Authors:<br />

Circulati<strong>on</strong> List:<br />

Amar Aggoun, Emmanuel Tsekleves Rafiq Swash and Shafik<br />

Salih<br />

Partners and Public <strong>on</strong> Internet<br />

Keywords: <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Display</str<strong>on</strong>g>s<br />

1


ICT Project <str<strong>on</strong>g>3D</str<strong>on</strong>g> VIVANT– Deliverable 6.4<br />

C<strong>on</strong>tract no.:<br />

248420<br />

<str<strong>on</strong>g>Display</str<strong>on</strong>g> <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> C<strong>on</strong>tent <strong>on</strong><br />

Auto-stereoscopic <str<strong>on</strong>g>Display</str<strong>on</strong>g><br />

C<strong>on</strong>tents<br />

FIGURE CAPTIONS ........................................................................................................................................... 3<br />

1. INTRODUCTION ....................................................................................................................................... 4<br />

1.1 EXECUTIVE SUMMARY .......................................................................................................................... 4<br />

1.2 DELIVERABLE STRUCTURE .................................................................................................................... 4<br />

2. <str<strong>on</strong>g>3D</str<strong>on</strong>g> DISPLAYS .............................................................................................................................................. 4<br />

2.1 MULTIVIEW AUTO-STEREOSCOPIC DISPLAYS ........................................................................................ 4<br />

2.2 <str<strong>on</strong>g>3D</str<strong>on</strong>g> HOLOSCOPIC DISPLAYS .................................................................................................................... 6<br />

3. COMPUTER GENERATED <str<strong>on</strong>g>3D</str<strong>on</strong>g> HOLOSCOPIC IMAGES. .................................................................. 9<br />

4. DISPLAY OF <str<strong>on</strong>g>3D</str<strong>on</strong>g> HOLOSCOPIC CONTENT ON MULTIVIEW STEREO DISPLAYS ................. 11<br />

4.1 ALIOSCOPY <str<strong>on</strong>g>3D</str<strong>on</strong>g> AUTO-STEREOSCOPIC DISPLAY .................................................................................. 12<br />

4.2 GENERATING <str<strong>on</strong>g>3D</str<strong>on</strong>g> HOLOSCOPIC CONTENT FOR ALIOSCOPY <str<strong>on</strong>g>3D</str<strong>on</strong>g> AUTO-STEREOSCOPIC DISPLAY ........... 15<br />

5. CONCLUSION .......................................................................................................................................... 16<br />

2


ICT Project <str<strong>on</strong>g>3D</str<strong>on</strong>g> VIVANT– Deliverable 6.4<br />

C<strong>on</strong>tract no.:<br />

248420<br />

FIGURE CAPTIONS<br />

<str<strong>on</strong>g>Display</str<strong>on</strong>g> <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> C<strong>on</strong>tent <strong>on</strong><br />

Auto-stereoscopic <str<strong>on</strong>g>Display</str<strong>on</strong>g><br />

FIGURE 1: MULTIVIEW AUTO-STEREOSCOPIC DISPLAY. ........................................................................................................ 6<br />

FIGURE 2: THE SLANTED ARRANGEMENT OF THE LENTICULAR LENS AND PIXELS IN THE MULTIVIEW AUTO-STEREOSCOPIC DISPLAYS. .... 6<br />

FIGURE 3: RECORDING OF A <str<strong>on</strong>g>3D</str<strong>on</strong>g> HOLOSCOPIC IMAGE. ........................................................................................................ 7<br />

FIGURE 4: RECORDED <str<strong>on</strong>g>3D</str<strong>on</strong>g> HOLOSCOPIC CONTENT SHOWING A 2D ARRAY OF MICRO-IMAGES. .................................................... 7<br />

FIGURE 5: <str<strong>on</strong>g>3D</str<strong>on</strong>g> HOLOSCOPIC DISPLAY. .............................................................................................................................. 8<br />

FIGURE 6: UNIDIRECTIONAL <str<strong>on</strong>g>3D</str<strong>on</strong>g> HOLOSCOPIC DISPLAY. ...................................................................................................... 8<br />

FIGURE 7: LENTICULAR SHEET MODEL IN INTEGRAL RAY TRACER. ........................................................................................... 9<br />

FIGURE 8: MICRO-LENS ARRAY IN INTEGRAL RAY TRACING. ................................................................................................ 10<br />

FIGURE 9: CAMERA MODEL OF <str<strong>on</strong>g>3D</str<strong>on</strong>g> HOLOSCOPIC IMAGING FOR COMPUTER GRAPHICS. ............................................................ 10<br />

FIGURE 10: CUTLERY SCENE IN OPENGL. ....................................................................................................................... 11<br />

FIGURE 11: CUTLERY SCENE IN OPENGL AFTER PROJECTION THROUGH A VIRTUAL LENTICULAR LENS ARRAY. ................................ 11<br />

FIGURE 12 - STEPS OF GENERATING INTERLACED IMAGE TO BE DISPLAYED ON ALIOSCOPY <str<strong>on</strong>g>3D</str<strong>on</strong>g> DISPLAY ....................................... 13<br />

FIGURE 13 - STEPS OF GENERATING 8 CAMERA IMAGES USING THE PLUG-INS/SCRIPTS FOR ALIOSCOPY MIX & PLAY ASSISTANT ...... 14<br />

FIGURE 14 – STEPS OF GENERATING INTEGRAL IMAGE TO BE DISPLAYED ON ALIOSCOPY <str<strong>on</strong>g>3D</str<strong>on</strong>g> DISPLAY .......................................... 15<br />

FIGURE 15 - PLAY-BACK ON <str<strong>on</strong>g>3D</str<strong>on</strong>g> HOLOSCOPIC CONTENT ON ALIOSCOPY DISPLAY .................................................................... 16<br />

3


ICT Project <str<strong>on</strong>g>3D</str<strong>on</strong>g> VIVANT– Deliverable 6.4<br />

C<strong>on</strong>tract no.:<br />

248420<br />

<str<strong>on</strong>g>Display</str<strong>on</strong>g> <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> C<strong>on</strong>tent <strong>on</strong><br />

Auto-stereoscopic <str<strong>on</strong>g>Display</str<strong>on</strong>g><br />

1. INTRODUCTION<br />

1.1 EXECUTIVE SUMMARY<br />

This document presents an update <strong>on</strong> the display <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g> <strong>on</strong> commercially available<br />

<str<strong>on</strong>g>3D</str<strong>on</strong>g> auto-stereoscopic display systems. Its main objective is to report the work carried out in the<br />

c<strong>on</strong>text <str<strong>on</strong>g>of</str<strong>on</strong>g> WP6/Task6.2 and to serve as a guideline during the deployment <str<strong>on</strong>g>of</str<strong>on</strong>g> the full parallax <str<strong>on</strong>g>3D</str<strong>on</strong>g><br />

<str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> display. The report also discusses the procedures for computer generated <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g><br />

<str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g>.<br />

Stereoscopic <str<strong>on</strong>g>3D</str<strong>on</strong>g> displays had been launched <strong>on</strong> the market by several companies worldwide such as<br />

Philips, Sharp, Alioscopy and Newsight Corporati<strong>on</strong>. However, auto-stereoscopic <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g> suffers<br />

from the eye fatigue issues. Since <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g> presentati<strong>on</strong> with horiz<strong>on</strong>tal parallax can<br />

be achieved by using lenticular sheet in associati<strong>on</strong> with an LCD. <str<strong>on</strong>g>3D</str<strong>on</strong>g> VIVANT will investigate the<br />

possibility <str<strong>on</strong>g>of</str<strong>on</strong>g> presenting <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g> <strong>on</strong> commercially available auto-stereoscopic displays<br />

based <strong>on</strong> the principles <str<strong>on</strong>g>of</str<strong>on</strong>g> lenticular array.<br />

Initial experimentati<strong>on</strong>s were carried out <strong>on</strong> the Philips display. A s<str<strong>on</strong>g>of</str<strong>on</strong>g>tware tool for remapping <str<strong>on</strong>g>of</str<strong>on</strong>g> the<br />

<str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g> was developed. However the results were unsatisfactory due to lack<br />

informati<strong>on</strong> regarding the lenticular sheet used in the Philips system. A substantial amount <str<strong>on</strong>g>of</str<strong>on</strong>g> test and<br />

adaptati<strong>on</strong>s <str<strong>on</strong>g>of</str<strong>on</strong>g> some finding were carried out to find out a soluti<strong>on</strong>.<br />

The latest experiments were carried out <strong>on</strong> the Alioscopy <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Display</str<strong>on</strong>g> and a s<str<strong>on</strong>g>of</str<strong>on</strong>g>tware tools was<br />

developed to generate <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g> for the display. The results are extremely satisfactory<br />

and for the first time it is proved that <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g> can be displayed <strong>on</strong> commercially<br />

available Multi-view auto-stereoscopic displays.<br />

1.2 DELIVERABLE STRUCTURE<br />

The rest <str<strong>on</strong>g>of</str<strong>on</strong>g> the document is structured as follows:<br />

Secti<strong>on</strong> 2 describes <str<strong>on</strong>g>3D</str<strong>on</strong>g> display technologies, mainly focusing <strong>on</strong> multiview displays and <str<strong>on</strong>g>3D</str<strong>on</strong>g><br />

<str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> displays.<br />

Secti<strong>on</strong> 3 provides a brief discussi<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> the computer generati<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g>. Computer<br />

generated unidirecti<strong>on</strong>al <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> are used to dem<strong>on</strong>strated the display <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g><br />

<str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g> <strong>on</strong> multiview stereo displays.<br />

Secti<strong>on</strong> 4 describes the investigati<strong>on</strong>s carried out in attempt to display <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g> <strong>on</strong><br />

multiview stereo display. A mapping strategy <str<strong>on</strong>g>of</str<strong>on</strong>g> the <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> data <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g> <strong>on</strong> the Alioscopy<br />

<str<strong>on</strong>g>3D</str<strong>on</strong>g> mutiview stereo display is discussed and results provided.<br />

Secti<strong>on</strong> 5 presents some general remarks regarding <str<strong>on</strong>g>3D</str<strong>on</strong>g> holoscopic video displays and summarizes the<br />

c<strong>on</strong>clusi<strong>on</strong>s drawn for this deliverable.<br />

2. <str<strong>on</strong>g>3D</str<strong>on</strong>g> DISPLAYS<br />

2.1 MULTIVIEW AUTO-STEREOSCOPIC DISPLAYS<br />

The c<strong>on</strong>cept <str<strong>on</strong>g>of</str<strong>on</strong>g> using a lenticular lens array together with a multiview stereo image has l<strong>on</strong>g been<br />

used in <str<strong>on</strong>g>3D</str<strong>on</strong>g> photography both for entertainment and pr<str<strong>on</strong>g>of</str<strong>on</strong>g>essi<strong>on</strong>al purposes. The combinati<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> a<br />

lenticular and an electr<strong>on</strong>ic display provides an optically efficient way <str<strong>on</strong>g>of</str<strong>on</strong>g> making an electr<strong>on</strong>ic <str<strong>on</strong>g>3D</str<strong>on</strong>g><br />

display which does not require the viewer to wear special glasses. This removes a key barrier to<br />

acceptance <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> displays for everyday use but requires a significant change in approach to <str<strong>on</strong>g>3D</str<strong>on</strong>g><br />

4


ICT Project <str<strong>on</strong>g>3D</str<strong>on</strong>g> VIVANT– Deliverable 6.4<br />

C<strong>on</strong>tract no.:<br />

248420<br />

<str<strong>on</strong>g>Display</str<strong>on</strong>g> <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> C<strong>on</strong>tent <strong>on</strong><br />

Auto-stereoscopic <str<strong>on</strong>g>Display</str<strong>on</strong>g><br />

display design. Auto-stereoscopic displays using micro-optics in combinati<strong>on</strong> with an LCD element<br />

have become attractive to display designers and several new <str<strong>on</strong>g>3D</str<strong>on</strong>g> display types are now available<br />

commercially.<br />

Auto-stereoscopic displays have been dem<strong>on</strong>strated using a range <str<strong>on</strong>g>of</str<strong>on</strong>g> optical elements in combinati<strong>on</strong><br />

with an LCD including:<br />

• Parallax barriers, optical apertures aligned with columns <str<strong>on</strong>g>of</str<strong>on</strong>g> LCD pixels.<br />

• Lenticular optics, cylindrical lenses aligned with columns <str<strong>on</strong>g>of</str<strong>on</strong>g> LCD pixels.<br />

Currently there are a number <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Display</str<strong>on</strong>g>s available <strong>on</strong> the market which uses the combinati<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g><br />

lenticular optics in combinati<strong>on</strong> with LCD panels. Lenticular elements used in <str<strong>on</strong>g>3D</str<strong>on</strong>g> displays are<br />

typically cylindrical lenses arranged vertically with respect to a 2D display such as an LCD as shown<br />

in figure 1. The cylindrical lenses direct the diffuse light from a pixel so it can <strong>on</strong>ly be seen in a<br />

limited angle in fr<strong>on</strong>t <str<strong>on</strong>g>of</str<strong>on</strong>g> the display. In the case <str<strong>on</strong>g>of</str<strong>on</strong>g> two views, this allows different pixels to be<br />

directed to either the left or right viewing windows. However such a technology is used for<br />

multiview stereo displays to allow freedom <str<strong>on</strong>g>of</str<strong>on</strong>g> viewing <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g> by more than <strong>on</strong>e observer. For<br />

example a nine views display will use nine images, which are interlaced to form nine group <str<strong>on</strong>g>of</str<strong>on</strong>g> pixels<br />

per lenticular. In this case each pixel in every group <str<strong>on</strong>g>of</str<strong>on</strong>g> nine pixels is directed to a different viewing<br />

window.<br />

There are several drawbacks to the basic multi-view approach that are particularly apparent when<br />

electr<strong>on</strong>ic displays are used. The first is there is a black mask between LCD pixels and this is imaged<br />

into dark lines between each view window, which is distracting to observers when their eye crosses a<br />

window boundary. Also images with any significant depth will result in an image-flipping artefact as<br />

the observer moves their eye across <strong>on</strong>e view window and into the next. Finally as more views are<br />

used the horiz<strong>on</strong>tal resoluti<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> the images decreases rapidly. To overcome these problems Philips<br />

proposed a new approach to multi-view LCD display. A significant step forward was made by<br />

positi<strong>on</strong>ing the lenticular array at an angle to the LCD pixel array as shown in figure 2. This mixes<br />

adjacent views reducing image flipping problems and spreading the effect <str<strong>on</strong>g>of</str<strong>on</strong>g> the black mask making<br />

it less visible. The other benefit <str<strong>on</strong>g>of</str<strong>on</strong>g> this design is that each view has a better aspect ratio, rather than<br />

splitting the display horiz<strong>on</strong>tally into many views both horiz<strong>on</strong>tal and vertical directi<strong>on</strong>s are split.<br />

5


ICT Project <str<strong>on</strong>g>3D</str<strong>on</strong>g> VIVANT– Deliverable 6.4<br />

C<strong>on</strong>tract no.:<br />

248420<br />

<str<strong>on</strong>g>Display</str<strong>on</strong>g> <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> C<strong>on</strong>tent <strong>on</strong><br />

Auto-stereoscopic <str<strong>on</strong>g>Display</str<strong>on</strong>g><br />

Figure 1: Multiview auto-stereoscopic display.<br />

Slanted<br />

Lenticular optics<br />

LCD Panel<br />

Figure 2: The Slanted arrangement <str<strong>on</strong>g>of</str<strong>on</strong>g> the lenticular lens and pixels in the multiview auto-stereoscopic displays.<br />

2.2 <str<strong>on</strong>g>3D</str<strong>on</strong>g> HOLOSCOPIC DISPLAYS<br />

<str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> imaging (also known as Integral imaging) is a technique that is capable <str<strong>on</strong>g>of</str<strong>on</strong>g> creating<br />

and encoding a true volume spatial optical model <str<strong>on</strong>g>of</str<strong>on</strong>g> the object scene in the form <str<strong>on</strong>g>of</str<strong>on</strong>g> a planar intensity<br />

distributi<strong>on</strong> by using unique optical comp<strong>on</strong>ents. It is akin to holography in that <str<strong>on</strong>g>3D</str<strong>on</strong>g> informati<strong>on</strong><br />

recorded <strong>on</strong> a 2D medium can be replayed as a full <str<strong>on</strong>g>3D</str<strong>on</strong>g> optical model, however, in c<strong>on</strong>trast to<br />

holography, coherent light sources are not required. This c<strong>on</strong>veniently allows more c<strong>on</strong>venti<strong>on</strong>al live<br />

capture and display procedures to be adopted. With recent progress in the theory and microlens<br />

manufacturing, integral imaging is becoming a practical and prospective <str<strong>on</strong>g>3D</str<strong>on</strong>g> display technology and is<br />

attracting much interest in the <str<strong>on</strong>g>3D</str<strong>on</strong>g> area.<br />

To record a <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> image a regularly spaced array <str<strong>on</strong>g>of</str<strong>on</strong>g> small lenslets closely packed together in<br />

c<strong>on</strong>tact with an image sensor (as shown in figure 3). Each lenslet views the scene at a slightly<br />

different angle to its neighbour and therefore a scene is captured from many view points and parallax<br />

informati<strong>on</strong> is recorded. After processing, if the photographic transparency is re-registered with the<br />

original recording array and illuminated by diffuse white light from the rear, the object will be<br />

c<strong>on</strong>structed in space by the intersecti<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> ray bundles emanating from each <str<strong>on</strong>g>of</str<strong>on</strong>g> the lenslets.<br />

A <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> image is recorded in a regular block pixel pattern. The planar intensity distributi<strong>on</strong><br />

representing a <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> image is comprised <str<strong>on</strong>g>of</str<strong>on</strong>g> 2D array <str<strong>on</strong>g>of</str<strong>on</strong>g> M×M micro-images due to the<br />

structure <str<strong>on</strong>g>of</str<strong>on</strong>g> the microlens array used in the capture and replay. The rectangular aperture at the fr<strong>on</strong>t <str<strong>on</strong>g>of</str<strong>on</strong>g><br />

the camera and the regular structure <str<strong>on</strong>g>of</str<strong>on</strong>g> the hexag<strong>on</strong>al microlenses array used in the hexag<strong>on</strong>al grid<br />

(recording microlens array) gives rise to a regular ‘brick structure’ in the intensity distributi<strong>on</strong> as<br />

illustrated in Figure 4.<br />

6


ICT Project <str<strong>on</strong>g>3D</str<strong>on</strong>g> VIVANT– Deliverable 6.4<br />

C<strong>on</strong>tract no.:<br />

248420<br />

<str<strong>on</strong>g>Display</str<strong>on</strong>g> <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> C<strong>on</strong>tent <strong>on</strong><br />

Auto-stereoscopic <str<strong>on</strong>g>Display</str<strong>on</strong>g><br />

Recording<br />

Medium<br />

Microlens<br />

Array<br />

Figure 3: Recording <str<strong>on</strong>g>of</str<strong>on</strong>g> a <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> Image.<br />

The replay <str<strong>on</strong>g>of</str<strong>on</strong>g> the <str<strong>on</strong>g>3D</str<strong>on</strong>g> Integral images is achieved by placing a microlens array <strong>on</strong> the top <str<strong>on</strong>g>of</str<strong>on</strong>g> the<br />

recoded planar intensity distributi<strong>on</strong>s as shown in figure 5. The microlens array has to match exactly<br />

the structure <str<strong>on</strong>g>of</str<strong>on</strong>g> the planar intensity distributi<strong>on</strong>.<br />

Figure 4: Recorded <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g> showing a 2D Array <str<strong>on</strong>g>of</str<strong>on</strong>g> micro-images.<br />

7


ICT Project <str<strong>on</strong>g>3D</str<strong>on</strong>g> VIVANT– Deliverable 6.4<br />

C<strong>on</strong>tract no.:<br />

248420<br />

<str<strong>on</strong>g>Display</str<strong>on</strong>g> <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> C<strong>on</strong>tent <strong>on</strong><br />

Auto-stereoscopic <str<strong>on</strong>g>Display</str<strong>on</strong>g><br />

Microlens Array<br />

LCD Panel<br />

Figure 5: <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> <str<strong>on</strong>g>Display</str<strong>on</strong>g>.<br />

A special case <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> imaging system is to replace the 2D array <str<strong>on</strong>g>of</str<strong>on</strong>g> microlenses with a 1D<br />

cylindrical microlens array as shown in figure 6. The resulting images c<strong>on</strong>tain parallax in the<br />

horiz<strong>on</strong>tal directi<strong>on</strong> <strong>on</strong>ly and is referred to as Unidirecti<strong>on</strong>al <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> images. The M<br />

vertically running bands present in the planar intensity distributi<strong>on</strong> captured by the integral <str<strong>on</strong>g>3D</str<strong>on</strong>g><br />

camera are due to the regular structure <str<strong>on</strong>g>of</str<strong>on</strong>g> the 1D cylindrical microlens array used in the capture<br />

process.<br />

Computer generated unidirecti<strong>on</strong>al <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> are used to dem<strong>on</strong>strated the display <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g><br />

<str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g> <strong>on</strong> multiview stereo displays. For this purpose the next secti<strong>on</strong> will provide a<br />

brief discussi<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> the computer generati<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g>.<br />

Lenticular<br />

Optics<br />

LCD Panel<br />

Figure 6: Unidirecti<strong>on</strong>al <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> <str<strong>on</strong>g>Display</str<strong>on</strong>g>.<br />

8


ICT Project <str<strong>on</strong>g>3D</str<strong>on</strong>g> VIVANT– Deliverable 6.4<br />

C<strong>on</strong>tract no.:<br />

248420<br />

<str<strong>on</strong>g>Display</str<strong>on</strong>g> <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> C<strong>on</strong>tent <strong>on</strong><br />

Auto-stereoscopic <str<strong>on</strong>g>Display</str<strong>on</strong>g><br />

3. COMPUTER GENERATED <str<strong>on</strong>g>3D</str<strong>on</strong>g> HOLOSCOPIC IMAGES.<br />

A computer generated synthetic <str<strong>on</strong>g>3D</str<strong>on</strong>g> holoscopic image is presented as a two dimensi<strong>on</strong>al distributi<strong>on</strong><br />

<str<strong>on</strong>g>of</str<strong>on</strong>g> intensities termed a lenslet-encoded spatial distributi<strong>on</strong> (LeSD), which is ordered directly by the<br />

parameters <str<strong>on</strong>g>of</str<strong>on</strong>g> a decoding array <str<strong>on</strong>g>of</str<strong>on</strong>g> micro lenses used to replay the three-dimensi<strong>on</strong>al synthetic image.<br />

When viewed, the image exhibits c<strong>on</strong>tinuous parallax within a viewing z<strong>on</strong>e dictated by the field<br />

angle <str<strong>on</strong>g>of</str<strong>on</strong>g> the array <str<strong>on</strong>g>of</str<strong>on</strong>g> micro-lenses. The replayed image is a volumetric optical model, which exists in<br />

space at a locati<strong>on</strong> independent <str<strong>on</strong>g>of</str<strong>on</strong>g> the viewing positi<strong>on</strong>. This occurs because, unlike stereoscopic<br />

techniques, which present planar perspective views to the viewer’s eyes, each point within the volume<br />

<str<strong>on</strong>g>of</str<strong>on</strong>g> a <str<strong>on</strong>g>3D</str<strong>on</strong>g> holoscopic image is generated by the intersecti<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> ray pencils projected by the individual<br />

micro-lenses.<br />

Due to the nature <str<strong>on</strong>g>of</str<strong>on</strong>g> the recording process <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> imaging, many changes to the camera<br />

model used in standard computer generati<strong>on</strong> s<str<strong>on</strong>g>of</str<strong>on</strong>g>tware are carried out. To generate a unidirecti<strong>on</strong>al <str<strong>on</strong>g>3D</str<strong>on</strong>g><br />

<str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> image using a lenticular sheet, each lens acts like a cylindrical camera. A strip <str<strong>on</strong>g>of</str<strong>on</strong>g> pixels is<br />

associated with each lens forming a micro-image. Each cylindrical lens records a micro-image <str<strong>on</strong>g>of</str<strong>on</strong>g> the<br />

scene from a different angle as shown in the Figure 7. For micro-lens arrays each lens acts like a<br />

square or a hexag<strong>on</strong>al camera depending <strong>on</strong> the structure <str<strong>on</strong>g>of</str<strong>on</strong>g> the lenses, as shown in Figure 8. In the<br />

lateral cross secti<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> the lenticular or the micro-lenses, a pinhole model is used. In the case <str<strong>on</strong>g>of</str<strong>on</strong>g><br />

lenticular sheets, the pinhole forms a straight line parallel to the axis <str<strong>on</strong>g>of</str<strong>on</strong>g> the cylindrical lens in the<br />

vertical directi<strong>on</strong>. For each pixel, a primary ray is spawned. The recording path <str<strong>on</strong>g>of</str<strong>on</strong>g> the primary ray<br />

draws a straight line going forward towards the image plane and backward away from the image<br />

plane. Similar primary rays <str<strong>on</strong>g>of</str<strong>on</strong>g> neighbouring lenses are spawned to similar directi<strong>on</strong>s parallel to each<br />

other. Therefore highly correlated micro-images are produced which, is a property <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> holoscopic<br />

imaging.<br />

Figure 7: Lenticular sheet model in integral ray tracer.<br />

9


ICT Project <str<strong>on</strong>g>3D</str<strong>on</strong>g> VIVANT– Deliverable 6.4<br />

C<strong>on</strong>tract no.:<br />

248420<br />

<str<strong>on</strong>g>Display</str<strong>on</strong>g> <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> C<strong>on</strong>tent <strong>on</strong><br />

Auto-stereoscopic <str<strong>on</strong>g>Display</str<strong>on</strong>g><br />

Figure 8: Micro-lens array in integral ray tracing.<br />

The structure <str<strong>on</strong>g>of</str<strong>on</strong>g> the lenses and the camera model in the in <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> computer graphics affects<br />

the way primary rays are spawned as well as the spatial coherence am<strong>on</strong>g them.<br />

The camera model used for each micro-lens is the pinhole approximati<strong>on</strong>, where each micro-lens acts<br />

like a separate camera. The result is a set multiple cameras. Each <str<strong>on</strong>g>of</str<strong>on</strong>g> them records a micro-image <str<strong>on</strong>g>of</str<strong>on</strong>g><br />

the virtual scene from a different angle (See figure 9). Primary rays pass through the centre <str<strong>on</strong>g>of</str<strong>on</strong>g> the<br />

micro-lens and the image plane. The scene image straddles the micro-lens array. Therefore there are<br />

two recording directi<strong>on</strong>s, in fr<strong>on</strong>t and behind the micro-lens array.<br />

Figure 9: Camera model <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> imaging for computer graphics.<br />

The specific characteristics <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> holoscopic imaging, allows us to deal with each cylindrical lens<br />

separate from the others, and to measure the number <str<strong>on</strong>g>of</str<strong>on</strong>g> pixels behind each lens, focal length and the<br />

image width. All these parameters including the number <str<strong>on</strong>g>of</str<strong>on</strong>g> lenslets in the virtual cylindrical array are<br />

selected <strong>on</strong> the basis <str<strong>on</strong>g>of</str<strong>on</strong>g> the characteristics <str<strong>on</strong>g>of</str<strong>on</strong>g> the display device.<br />

The pixels intensity values <str<strong>on</strong>g>of</str<strong>on</strong>g> the micro-image for each lenslet are read, saved, and then mapped to<br />

10


ICT Project <str<strong>on</strong>g>3D</str<strong>on</strong>g> VIVANT– Deliverable 6.4<br />

C<strong>on</strong>tract no.:<br />

248420<br />

<str<strong>on</strong>g>Display</str<strong>on</strong>g> <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> C<strong>on</strong>tent <strong>on</strong><br />

Auto-stereoscopic <str<strong>on</strong>g>Display</str<strong>on</strong>g><br />

pixels locati<strong>on</strong>s <strong>on</strong> the screen so that all the vertical slots are displayed at the same time forming the<br />

<str<strong>on</strong>g>3D</str<strong>on</strong>g> holoscopic image. The locati<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> the vertical elemental image <strong>on</strong> the computer screen is identical<br />

to the locati<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> the corresp<strong>on</strong>ding lenslet in the virtual lenses array.<br />

Figure 10 shows the <str<strong>on</strong>g>3D</str<strong>on</strong>g> scene “cutlery” rendered in OpenGL. The scene was first built in <str<strong>on</strong>g>3D</str<strong>on</strong>g> max,<br />

and then exported by OpenGL via Blender and saved as MD2 files. Each object in the scene was<br />

exported, saved and uned as a separate MD2 file. Figure 11 shows the <str<strong>on</strong>g>3D</str<strong>on</strong>g> holoscopic image<br />

resulting from the projecti<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> the scene through the virtual lenticular lens array.<br />

Figure 10: Cutlery scene in OpenGL.<br />

Figure 11: Cutlery scene in OpenGL after projecti<strong>on</strong> through a virtual lenticular lens array.<br />

4. DISPLAY OF <str<strong>on</strong>g>3D</str<strong>on</strong>g> HOLOSCOPIC CONTENT ON MULTIVIEW<br />

STEREO DISPLAYS<br />

Original experimentati<strong>on</strong>s was carried out <strong>on</strong> the Philips multiview auto-Stereoscopic display has<br />

been studied and experimented as an example <str<strong>on</strong>g>of</str<strong>on</strong>g> commercially available <str<strong>on</strong>g>3D</str<strong>on</strong>g> displays. A 20-inch <str<strong>on</strong>g>3D</str<strong>on</strong>g><br />

11


ICT Project <str<strong>on</strong>g>3D</str<strong>on</strong>g> VIVANT– Deliverable 6.4<br />

C<strong>on</strong>tract no.:<br />

248420<br />

<str<strong>on</strong>g>Display</str<strong>on</strong>g> <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> C<strong>on</strong>tent <strong>on</strong><br />

Auto-stereoscopic <str<strong>on</strong>g>Display</str<strong>on</strong>g><br />

auto-stereoscopic display was designed to <str<strong>on</strong>g>of</str<strong>on</strong>g>fer lenticular lens design creating a variety <str<strong>on</strong>g>of</str<strong>on</strong>g> distinct <str<strong>on</strong>g>3D</str<strong>on</strong>g><br />

views. The <str<strong>on</strong>g>3D</str<strong>on</strong>g> Auto-stereoscopic display has an embedded hardware that accepts 2D-plus-depth<br />

format and renders 9 views to enable multiple viewers to see <str<strong>on</strong>g>3D</str<strong>on</strong>g> images at any <strong>on</strong>e time.<br />

The display player does not support 9-views <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g> as input. However, given that the <str<strong>on</strong>g>3D</str<strong>on</strong>g><br />

<str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g> is recorded as a single 2D data, then <strong>on</strong>ly the 2D input is used. Furthermore it is<br />

necessary to acquire the various parameter <str<strong>on</strong>g>of</str<strong>on</strong>g> the lenticular sheet used by the Philips including the<br />

slanting angle. Three important parameters namely, the focal length and pitch <str<strong>on</strong>g>of</str<strong>on</strong>g> each lenslet and the<br />

slanting angle <str<strong>on</strong>g>of</str<strong>on</strong>g> the lenticular sheet are required by the s<str<strong>on</strong>g>of</str<strong>on</strong>g>tware developed at <strong>Brunel</strong> <strong>University</strong> to<br />

computer generate <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> images for the Philips display. Unfortunately it was difficult to<br />

acquire this informati<strong>on</strong> from Philips. So we have adapted the informati<strong>on</strong> <strong>on</strong> an earlier versi<strong>on</strong><br />

published by Philips in 1999 for a 7 views <str<strong>on</strong>g>3D</str<strong>on</strong>g> LCD display. A s<str<strong>on</strong>g>of</str<strong>on</strong>g>tware tool has been developed to<br />

map the pixels <str<strong>on</strong>g>of</str<strong>on</strong>g> the 2D intensity distributi<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> a <str<strong>on</strong>g>3D</str<strong>on</strong>g> holoscopic image to fit into a slanted lenticular<br />

structure <str<strong>on</strong>g>of</str<strong>on</strong>g> the Philips display. Unfortunately this [rocedure did not provide satisfactory results due<br />

to<br />

(i) adapting the lenticular optical characteristics from previous development is not<br />

accurate enough and may have caused some <str<strong>on</strong>g>of</str<strong>on</strong>g> the problems;<br />

(ii) Missing informati<strong>on</strong> about the lenticular sheet such as the focal length and pitch <str<strong>on</strong>g>of</str<strong>on</strong>g><br />

each lenslet;<br />

(iii) The display does not accept multiple inputs.<br />

Due to the fact that the auto-stereoscopic Philips display has been disc<strong>on</strong>tinued and no l<strong>on</strong>ger<br />

commercially available, it was not possible to get access to the necessary informati<strong>on</strong> to allow<br />

accurate mapping <str<strong>on</strong>g>of</str<strong>on</strong>g> the <str<strong>on</strong>g>3D</str<strong>on</strong>g> holoscopic image <strong>on</strong>to the display.<br />

To solve this problem, the <strong>Brunel</strong> team c<strong>on</strong>tacted a number <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> auto-stereoscopic diplay<br />

manufactures. Alioscopy <str<strong>on</strong>g>3D</str<strong>on</strong>g> Auto-Stereoscopic display is <strong>on</strong>e <str<strong>on</strong>g>of</str<strong>on</strong>g> the systems studied and<br />

experimented with as an example <str<strong>on</strong>g>of</str<strong>on</strong>g> State <str<strong>on</strong>g>of</str<strong>on</strong>g> the art <str<strong>on</strong>g>3D</str<strong>on</strong>g> Auto-Stereoscopic <str<strong>on</strong>g>Display</str<strong>on</strong>g> to ensure the<br />

<str<strong>on</strong>g>3D</str<strong>on</strong>g>VIVANT <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g>s (<str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g>) can be replayed <strong>on</strong> the Alioscopy <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Display</str<strong>on</strong>g>.<br />

4.1 ALIOSCOPY <str<strong>on</strong>g>3D</str<strong>on</strong>g> AUTO-STEREOSCOPIC DISPLAY<br />

The 42-inch <str<strong>on</strong>g>3D</str<strong>on</strong>g> Auto-stereoscopic display is designed to <str<strong>on</strong>g>of</str<strong>on</strong>g>fer lenticular lens design creating 8 <str<strong>on</strong>g>of</str<strong>on</strong>g><br />

distinct auto-Stereoscopic views. The <str<strong>on</strong>g>3D</str<strong>on</strong>g> Auto-stereoscopic display has a play-back s<str<strong>on</strong>g>of</str<strong>on</strong>g>tware which<br />

accepts Mixed-C<strong>on</strong>tent and Mixed-<str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g> can be generated using Alioscopy Mix & <str<strong>on</strong>g>Display</str<strong>on</strong>g><br />

Assistant s<str<strong>on</strong>g>of</str<strong>on</strong>g>tware that accepts images from 8 cameras and then it renders 8 images into a single<br />

interlaced-image as shown in Figure 12.<br />

12


ICT Project <str<strong>on</strong>g>3D</str<strong>on</strong>g> VIVANT– Deliverable 6.4<br />

C<strong>on</strong>tract no.:<br />

248420<br />

<str<strong>on</strong>g>Display</str<strong>on</strong>g> <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> C<strong>on</strong>tent <strong>on</strong><br />

Auto-stereoscopic <str<strong>on</strong>g>Display</str<strong>on</strong>g><br />

Figure 12 - Steps <str<strong>on</strong>g>of</str<strong>on</strong>g> generating interlaced image to be displayed <strong>on</strong> Alioscopy <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Display</str<strong>on</strong>g><br />

13


ICT Project <str<strong>on</strong>g>3D</str<strong>on</strong>g> VIVANT– Deliverable 6.4<br />

C<strong>on</strong>tract no.:<br />

248420<br />

<str<strong>on</strong>g>Display</str<strong>on</strong>g> <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> C<strong>on</strong>tent <strong>on</strong><br />

Auto-stereoscopic <str<strong>on</strong>g>Display</str<strong>on</strong>g><br />

Alioscopy developed plug-ins/scripts for <str<strong>on</strong>g>3D</str<strong>on</strong>g> modelling commercial s<str<strong>on</strong>g>of</str<strong>on</strong>g>tware such as Cinema4d,<br />

Maya, and <str<strong>on</strong>g>3D</str<strong>on</strong>g>s MAX that can be used to generate <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g> for the <str<strong>on</strong>g>3D</str<strong>on</strong>g> display and the steps/processes<br />

are shown in Figure 13.<br />

Figure 13 - Steps <str<strong>on</strong>g>of</str<strong>on</strong>g> generating 8 camera images using the plug-ins/scripts for Alioscopy Mix & Play<br />

Assistant<br />

The process <str<strong>on</strong>g>of</str<strong>on</strong>g> generating MIXED <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g> for Alioscopy <str<strong>on</strong>g>3D</str<strong>on</strong>g> Auto-Stereoscopic display is studied and<br />

understood as it requires 8 perspective camera images or 8 rendered images from the Alioscopy plugins/scripts<br />

and then MIX and Play Assistant s<str<strong>on</strong>g>of</str<strong>on</strong>g>tware generates interlaced image with resoluti<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g><br />

1920x1080 pixel (interlacing 8 * 960x540 images).<br />

14


ICT Project <str<strong>on</strong>g>3D</str<strong>on</strong>g> VIVANT– Deliverable 6.4<br />

C<strong>on</strong>tract no.:<br />

248420<br />

<str<strong>on</strong>g>Display</str<strong>on</strong>g> <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> C<strong>on</strong>tent <strong>on</strong><br />

Auto-stereoscopic <str<strong>on</strong>g>Display</str<strong>on</strong>g><br />

4.2 GENERATING <str<strong>on</strong>g>3D</str<strong>on</strong>g> HOLOSCOPIC CONTENT FOR ALIOSCOPY <str<strong>on</strong>g>3D</str<strong>on</strong>g> AUTO-<br />

STEREOSCOPIC DISPLAY<br />

A research is carried out to c<strong>on</strong>firm that <str<strong>on</strong>g>3D</str<strong>on</strong>g>VIVANT <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g> can be replayed back <strong>on</strong><br />

State <str<strong>on</strong>g>of</str<strong>on</strong>g> the Art <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Display</str<strong>on</strong>g> (Alioscopy <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Display</str<strong>on</strong>g>). Figure 14 shows the steps involved in<br />

generating <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g> and as seen there are 8 orthographic images generated using <str<strong>on</strong>g>3D</str<strong>on</strong>g><br />

holoscopic camera and then those images are feed into the Mix & Play Assistant s<str<strong>on</strong>g>of</str<strong>on</strong>g>tware to mix and<br />

replayed <strong>on</strong> Alioscopy <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Display</str<strong>on</strong>g>.<br />

Figure 14 – Steps <str<strong>on</strong>g>of</str<strong>on</strong>g> generating integral image to be displayed <strong>on</strong> Alioscopy <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Display</str<strong>on</strong>g><br />

A couple <str<strong>on</strong>g>of</str<strong>on</strong>g> video clips are generated for this display and the steps are (1) a sequences <str<strong>on</strong>g>of</str<strong>on</strong>g> bitmap<br />

images are generated using the steps 1 to 4 (see Figure 14) and then (2) the bitmap images are<br />

c<strong>on</strong>verted to a video clips. The resulting images are shown in Figure 15.<br />

15


ICT Project <str<strong>on</strong>g>3D</str<strong>on</strong>g> VIVANT– Deliverable 6.4<br />

C<strong>on</strong>tract no.:<br />

248420<br />

<str<strong>on</strong>g>Display</str<strong>on</strong>g> <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> C<strong>on</strong>tent <strong>on</strong><br />

Auto-stereoscopic <str<strong>on</strong>g>Display</str<strong>on</strong>g><br />

Figure 15 - Play-back <strong>on</strong> <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g> <strong>on</strong> Alioscopy <str<strong>on</strong>g>Display</str<strong>on</strong>g><br />

5. CONCLUSION<br />

In this report we have shown that the <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> <str<strong>on</strong>g>c<strong>on</strong>tent</str<strong>on</strong>g> with horiz<strong>on</strong>tal parallax can be<br />

displayed <strong>on</strong> commercially available multiview auto-stereoscopic displays. To our knowledge this<br />

the first time this has been achieved. For this study the Alioscopy display has been used.<br />

Part <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>3D</str<strong>on</strong>g> VIVANT project objectives is to design a <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> display. This study will form the<br />

basis <str<strong>on</strong>g>of</str<strong>on</strong>g> the development <str<strong>on</strong>g>of</str<strong>on</strong>g> the <str<strong>on</strong>g>3D</str<strong>on</strong>g> <str<strong>on</strong>g>Holoscopic</str<strong>on</strong>g> display with full parallax based <strong>on</strong> a combinati<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g><br />

microlens arrays with LCD.<br />

16

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!