SOURCE: Fraunhofer IIS

Fraunhofer IIS

September 12, 2016 07:08 ET

Fraunhofer Unveils Industry Momentum to Drive Light-Field Technology Adoption

Standardization to Play a Vital Role in Enabling New, Immersive Viewing Experiences From 3D, Virtual Reality and Beyond

AMSTERDAM, THE NETHERLANDS--(Marketwired - Sep 12, 2016) - The Fraunhofer IIS Department Moving Picture Technologies, the leading provider of future-oriented solutions for enhanced digital media workflows, is one of the industry leaders in driving widespread development, standardization and adoption of light-field technology. These advances will be pivotal in meeting the demands and challenges of this technology in how we generate and deliver future immersive viewing experiences.

"Light-field technology is an industry game changer, enabling new, creative possibilities to meet consumers' expectations for immersive digital cinema and media," said Dr. Siegfried Foessel, spokesperson, Fraunhofer Digital Media Alliance. "This includes simplifying and enhancing any workflow for processes that combine the real world and CGI, such as 3D or virtual reality (VR). Before professionals can tap into all this technology has to offer, strides must be made."

Standardization of various components are needed for workflows to truly support light-field technology. In line with the roadmap developed by JPEG and MPEG, Fraunhofer IIS highlights the following initiatives to push light-field technology forward:

The Interoperability of Tools:
The number of companies developing cameras, content and devices for immersive services, such as VR, is growing rapidly. Several technologies are necessary for VR, including image stitching, metadata enrichment and video coding. This leads to an array of different types of formats, coding, delivery mechanisms, 3D projection, metadata or signaling. The result is market fragmentation. Each of these components must be standardized for optimal interoperability.

Light-Field Coding:
Light-field technology enables many special effects, like the Matrix Bullet effect, refocusing or depth-based editing. 3D processing in combination with audio wave field processing allows a much more immersive viewing experience, especially for next-generation cinematic movies. This results in heavy transmission bandwidth requirements, along with the burden of extensive editing and rendering required for 360 degree and 3D viewing for VR. Standardizing coding that will properly compress light-field data will alleviate this burden.

Point Cloud Compression:
Because of the limitation of data points during capturing, point clouds are often sparsely distributed. Point clouds enable 3D representations, allowing new renderings from different viewpoints. Point clouds typically use thousands or up to billions of points to represent scenes that can be realistically reconstructed. They are typically captured using multiple cameras and depth sensors in various setups, but as usual in JPEG and MPEG, acquisition is outside of the scope of the standard. The standards target efficient geometry and attribute compression, scalable/progressive coding, and coding of sequences of point clouds captured over time. The compressed data format must also support random access to subsets of the point cloud.

For the past five years, Fraunhofer IIS has played a major role in the innovation of light-field technology. Along with developing the first technology for use in moving pictures, Fraunhofer IIS works jointly with and holds leadership positions with relevant standardization groups, including JPEG and MPEG.

The Fraunhofer IIS Department of Moving Picture Technologies is a member of the Fraunhofer Digital Media Alliance. The goal of the Alliance is to provide new technologies and innovations for each step of any digital media or cinema workflow for immersive viewing and audio experiences that enable customers to stay ahead of the market.

IBC attendees can see a demo of Fraunhofer IIS' Light-Field Technology at stand 8.B80. Further information is also available at: http://www.iis.fraunhofer.de/en/ff/bsy/tech/lichtfeld.html

About Fraunhofer Digital Media Alliance
The Fraunhofer Digital Media Alliance consists of Fraunhofer IIS, Fraunhofer Heinrich-Hertz Institute HHI, Fraunhofer IDMT and Fraunhofer FOKUS. The Alliance provides a network of deep expertise and intelligence for the development of scalable technologies and international standards that allow customers to stay ahead of the market. With the start of digitalization in the moving picture industry, these institutes joined forces in 2004 to offer R&D expertise with one face to the customer. The institutes are all well known in the industry for award-winning developments and standards like MP3, xHE-AAC, H.264, HEVC, the DCI Compliance Test Plan for Digital Cinema, IOSONO, easyDCP software etc. In addition, they are contributing to ISO, SMPTE, ISDCF, EDCF.

About Fraunhofer IIS
The Fraunhofer-Gesellschaft is the leading organization for applied research in Europe. Its research activities are conducted by 66 institutes and research units at locations throughout Germany. The Fraunhofer-Gesellschaft employs a staff of more than 2,000, who work with an annual research budget totaling 2 billion euros. Founded in 1985, Fraunhofer Institute for Integrated Circuits IIS in Erlangen, Germany, ranks first among the Fraunhofer Institutes concerning headcount and revenues. As the main inventor of mp3 and universally credited with the co-development of AAC audio coding standard, Fraunhofer IIS has reached worldwide recognition. In close cooperation with partners and clients the Institute provides research and development services in the following areas: Audio & Multimedia, Communications Systems, Energy Management, IC Design and Design Automation, Imaging System, Medical Technology, Non-destructive Testing, Positioning, Safety and Security Technology, Sensor Systems plus Supply Chain Management. More than 880 employees conduct contract research for industry, the service sector and public authorities. Fraunhofer IIS with its headquarters in Erlangen, Germany, has further branches in Dresden, Fuerth, Nuremberg, Coburg, Deggendorf, Ilmenau, Wuerzburg, Bamberg and Waischenfeld. The budget of 120 million euros is mainly financed by projects. Less than 25 percent of the budget is subsidized by federal and state funds.

Detailed information on http://www.iis.fraunhofer.de and http://www.digitalmedia.fraunhofer.de

Contact Information