by Adam Plowden | 16th February 2017
Lytro’s take on image capture is truly unique, using light field technology to create an immersive virtual environment. After raising $60 million and a complete system re-design, the Lytro Immerge Light Field camera has captured the first high-end virtual reality film and is ready for production. But first, a quick recap of what light field technology actually is. While a traditional camera records the light hitting the sensor with a specific focused point, light field captures the pathway of the light from the source or object reflecting the light to the camera. This allows for post focusing and a virtual orientation of the scene after it’s been shot (For a more in-depth explanation check out this article). Through massive investment and development, and a belief that virtual reality experiences and cinema is the next step in our world of film, Lytro has developed the capture and workflow for high-end 360-degree filming using light field technology in its Lytro Immerge system, demonstrated in this VR demo video called ‘Moon’. This project demonstrates the first 360-degree live-action VR piece with 6DoF (degrees of freedom, not depth of field), which essentially means ‘high immersion’, allowing the viewer to move around in the virtual space. The combination of light field and virtual reality creates the ‘real world’ effects that we see and experience in person, which include: Parallax, or the ability to look around objects, giving a true realistic experience. Truly correct stereo that orients with head movement, rather than stereoscopic 360-degree video which requires the head to be level with the horizon. Seamlessly integrated live action and film-quality graphics. Viewing dependent lighting effects, such as shadows and reflections in the environment. No stitching artefacts like the ones sometimes seen on 360-degree videos, because of the light field’s accurate scene reconstruction. The redesign of the camera saw it transform from a spherical array of lenses, into a planar array which is then rotated 360 degrees to capture the full environment. The Lytro Immerge servers then create the 3D virtual reality using the environment’s light fields. Old Lytro Immerge Light Field Camera Design New Lytro Immerge Light Field Camera Design Since the demonstration of project ‘Moon’, Lytro Immerge has been used in the production of Chris Milk’s Within project that focuses on storytelling in virtual reality, which is due to be released in the summer. Although high-end virtual reality films are yet to find their feet in the movie world, Lytro believe that there is an expanding market for true virtual reality cinematography and are exploring possibilities of studios using the technology especially in Asia. It’s not a technology that we’ll see in our pockets or camera bags anytime soon, but it is an exciting step forward for creating deeper immersive experiences. For more information on the Lytro Immerge, check out the Lytro website, and take a look at some of the Within projects here. via Variety.comRead more
by Richard Lackey | 11th April 2016
The future of cinematography is computational. It’s a bold statement to make, but one that I believe is inevitable. Lytro Cinema is a vision of this future. Lytro is best known for bringing to market the world’s first Light Field cameras, allowing image focus and depth of field to be changed in post. The fact of the matter is focussing or refocussing an image after the fact is barely the tip of the iceberg when it comes to the potential of Light Field technology. By capturing not only the traditional chroma and luminance information from a scene but also the direction and angle of light reflecting from every object and surface, it is possible to generate an entire 3D volumetric depth map of a live action environment. This makes integration with VFX and CG elements easier and more comprehensive than ever before. Last week Jason Rosenthal, CEO of Lytro wrote an interesting article; Why I Lit Up Lytro and Scrapped the Strategy as CEO, published on PetaPixel explaining the reasons for the company’s recent change in direction away from consumer cameras, instead investing their technology in live action cinematic VR. I’m sure you’ll agree it represents a very smart move on behalf of Lytro, just as VR is exploding into the mainstream. Lytro Cinema Lytro has now officially launched Lytro Cinema, comprising a camera, server array, and software for editing the light field data. According to Lytro in the company’s latest press release; “The breakthrough capture system enables the complete virtualization of the live action camera — transforming creative camera controls from fixed on set decisions to computational post-production processes — and allows for historically impossible shots.” “We are in the early innings of a generational shift from a legacy 2D video world to a 3D volumetric Light Field world,” said Jason Rosenthal, CEO of Lytro. “Lytro Cinema represents a significant step in that evolution. We are excited to help usher in a new era of cinema technology that allows for a broader creative palette than has ever existed before.” The volume of data that Lytro Cinema captures is staggering. The highest resolution video sensor ever designed, 755 RAW megapixels at up to 300 FPS Up to 16 stops of dynamic range and wide color gamut Integrated high-resolution active scanning Capture Environment and Action, Frame and Focus Later Lytro Cinema captures the entire light field in high resolution creating a Light Field Master. A Light Field Master represents an enormous amount of 3D volumetric data, describing almost every aspect of the scene allowing technical aspects that are traditionally set by camera hardware such as frame rate and shutter angle to be decided and rendered computationally in post. Content can be rendered for immersive VR and in multiple traditional delivery formats — including IMAX®, RealD® and traditional cinema and broadcast. Light Field data allows objects to be perfectly isolated in post by depth without a traditional chroma key, revolutionizing CG and VFX integration. It also allows focus and depth of field to be decided in post rather than permanently on set. Needless to say the role of the cinematographer in the traditional sense, not to mention focus puller, as well as countless other roles, are completely redefined as much as the hardware itself. The relationship between what happens on set, and what occurs in post becomes more integrated than ever. We will no longer be “fixing” anything in post; we’ll be capturing the live action environment on set and doing most of the “shooting” after the fact. Too Good To Be True? While the Light Field technology behind the Lytro Cinema camera and system as described is very real… in theory, and the overall vision Lytro has presented does portray the theoretical potential, many of the realities of implementing the technology as claimed push the very boundaries of what may be possible today. Will the glossy press images and extreme specifications claimed of this revolutionary future make a full and complete transformation into actual hardware as advertised? I stand by my opening statement. I believe the future of cinematography is computational, and certainly Lytro Cinema is a vision of this future. However, time will tell if Lytro Cinema can deliver this glorious vision. If you are heading out to NAB, be sure to check it out for yourself. “Life” the first short produced with Lytro Cinema in association with The Virtual Reality Company (VRC) will premiere at the National Association of Broadcasters (NAB) conference on Tuesday, April 19 at 4 p.m. PT at the Las Vegas Convention Center in Room S222. “Life” was directed by Academy Award winner Robert Stromberg, Chief Creative Officer at VRC and shot by David Stump, Chief Imaging Scientist at VRC. Learn more about Lytro Cinema activities during the 2016 NAB Show and get a behind-the-scenes look on the set of “Life” at www.lytro.com/nab2016. Lytro Cinema will be available for production in Q3 2016 to exclusive partners on a subscription basis. For more information on Lytro Cinema, visit www.lytro.com/cinema.Read more
We only send updates about our most relevant articles. No spam, guaranteed! And if you don't like our newsletter, you can unsubscribe with a single click. Read our full opt-out policy here.