Last month Sony Professional asked us if we wanted to have a play with their new professional 3D camera, the HXR-NX3D1 (or to be exact the HXR-N X3D1E which is the PAL variant). Of course we said a great big YES PLEASE and they invited us to Sony Basingstoke for a masterclass in 3D shooting.
In this 3 part series we will look at everything to do with 3D filmmaking. Part 1 (this one) we will look at the science of 3D shooting and the theory you need to bear in mind. In Part 2 we will look at the Sony NX3D1 itself with our detailed review and in the final part we will look at the post production side with a little write-up of Sony Vegas 11 Pro.
In these posts we will be giving you an example of shots in 3D. The chances are you don’t have a 3D monitor so we will be using the Red/Cyan Anaglyph style to display our images. To really take in all we have to offer get yourself some red/cyan anaglyph glasses from here on eBay for 99p. Or if like us you will be using them quite a bit you may want to splash out a couple of quid on some more permanent ones like these.
REAL 3D vs FAKE 3D
3D has taken some flack lately and it’s not without reason. 3D comes in 2 flavours. Real 3D where they film everything in stereo using a lovely big setup of 2 camera lenses converging on one point. This gives you true 3D with real depth to everything. The problem with this is it can be quite expensive to film as its so new and requires old school filmmakers to have to think differently.
The next type is the fake 3D. This is where they film in 2D like they normally do and then in post production separate those 2D scenes into multiple depth planes and using CGI create an illusion of depth. The problem with this is they often fail to add depth to the actors so their faces, where the emotion and real acting takes place just looks like a cardboard cutout. The other problem is that as most movies contain an awful lot of CGI and the CGI is often rendered in true 3D so the backgrounds and CGI are lovely and real 3D but then the actors and all the stuff filmed in the real world will appear flat and without depth. If you’ve seen the 3D pirates of the Caribbean you will know what I mean. Lovely 3D boats and monsters but a horribly flat Jack Sparrow.
For me, I love a true 3D movie and loathe having to pay extra to see a fake 3D movie which just leaves me feeling disconnected from the narrative. Thankfully the NX3D1 is a true 3D camera. Huzzah!
THE SCIENCE OF 3D MOVIES
The basics to how a 3D camera works is pretty much the same way your own eyes work. Two lenses at a certain distance apart record everything they see at a slightly different angle. All sounds simple enough, the issue comes when it’s time to play back the footage as all our display mediums be it a cinema screen or TV are actually 2D devices. So what we have to do is to trick our brain into thinking what it’s seeing has real depth, despite it actually having zero depth.
In the real world our eyes pick something to focus on and they both converge on that point. With 3D movies there is no real object to converge on so we simulate this using parallax.
This is where we make the viewer either focus on an image which appears on the screen itself (zero parallax), behind the screen (positive parallax) or in front of the screen (negative parallax). Take a look at this image from depthbeyond.com which gives you an idea how your eyes would work in these given scenarios.
Notice how to view things in negative parallax you need to go cross-eyed. If you’ve ever wondered why 3D movies don’t keep making things jump out of the screen for that “WOW!” 3D effect this is why. To do that and for you to try to focus on something which appears to be popping out of the screen requires you to go cross-eyed and this is never the most comfortable of positions for your eyes. This is a key part of shooting 3D, you nearly always want to make EVERYTHING look like it’s behind the screen in positive parallax for your 3D effect rather than jumping out at you.
When it comes to shooting 3D you have a number of different ways to decide what appears in front of the screen, on the screen or behind it. One way is to angle the lenses so they actually converge on an object. This can be quite tricky technically. Another is to adjust the disparity of the lenses (how far apart they are). Increase the distance between lenses to increase the depth, decrease the distance to decrease the depth. Again, this requires a mechanical movement and is also quite tricky. The way that the NX3D1 does this is to have lenses at a fixed convergence point and a fixed disparity and move the two images it records so they overlap each other. As the NX3D1 actually records an image greater than 1920×1080 it has a bit of space to do this without loosing quality. The benefit of this method is that in post production you can actually change the 3D depth. You can give things greater depth, make them appear to be coming out of the screen or going further back into the screen. Take a look at this screenshot from the 3D film we will be showing in part 3 using your red/cyan anaglyph glasses (with the red lens on the left).
On the left is how we shot it on the NX3D1 with Joshua’s little hands appearing on the screen glass at zero parallax and everything else behind it. On the right we adjusted it in post in Sony Vegas 11 using the Sony Stereoscopic 3D Adjust plugin so that his hat and face appear on the screen and his hands appear to be coming out of the screen slightly. We added some text on-screen to help demonstrate this effect. More on Vegas and doing this later. What you’re doing here is effectively adjusting the disparity. It’s the same as moving the lenses further apart or closer together. This is an absolute necessity as we found ourselves shooting and setting one thing as being at zero parallax but in post production realised we wanted something else to be at zero parallax.
BEWARE OF THE EDGE. THINKING ABOUT VISUAL CUES.
How we show 3D movies is all an illusion but an illusion which takes into account how you see the world. When you see depth your actually using a whole host of visual cues to help you gauge the depth. Motion, if your travelling in your car and you see things whizzing past your window you know that the closer objects will be moving faster and further away will be slower. This is down to the motion parallax visual cue. You also know that objects further away should be smaller, have less detail in their textures, maybe a little out of focus. There are a whole load of visual cues involved in 3D shooting but thank fully shooting with 2 lenses means most of these are taken care of for you.
One visual cue you absolutely must always consider when shooting 3D is that of occlusion. We know that if an object passes in front of another object then the object blocking our view of the other object must be closer. The issue we have with 3D shooting is we have the power to break that rule and therefore break the illusion. When I placed the text in the image above I was very careful to not place the text for the image on the right over Joshua’s hands. On the left it doesn’t matter, his hands are on the screen and everything else is behind it. On the right however our brains are saying “The text is on the screen and his hands are in front of it”. But if we put the text in front of his hands we cause something called an Edge Violation. This is where our brains are being fooled into seeing something in front of the screen but then something else, like the edge of the screen or an overlay you have applied in post then appears in front of this thing which our brains are seeing as in front. Take a look at this image below;
On the left all is well. But on the right you are now going to have a hard time focusing on Joshua’s hands because your eyes and brain are having a little bit of a conflict. Your brain knows that text should not be visible and parts should disappear behind Joshua’s hands but it doesn’t. What we have done is broken the magic trick. What we expect to see is the image below;
There, doesnt that feel better? We have fixed the edge violation and maintained the illusion and it also really demonstrates how much his hands appear to be leaping out of the screen. However, if you scroll so the edge of your browser cuts off his hands you once again break the illusion and will start to get a headache. Here we have broken our occlusion depth cue.
3D cameras will have a function which lets you decide what appears in negative, positive or zero parallax. This can take the form of adjusting the angle of the lenses and thus your convergence point, adjusting the disparity between the two lenses or in the case of the NX3D1 this takes the form of a little knob just below the lenses which adjusts the way the two images overlap. Using this feature we found you want to keep everything appearing behind the screen so you adjust your camera so that the closest object is on-screen and everything else just naturally falls behind. Unless you want to make a specific object jump out of the screen like with Joshua’s little hands. We will talk more about shooting 3D with the NX3D1 in our next post.
TO INFINITY…
When your driving along a country road and you look out of your window you will notice how the different depth planes will be moving by at different speeds. But there comes a point where the background is just flat and has no depth. This is usually around the infinity mark on your lens. This is something to bear in mind that when shooting 3D there will come a point where there just isn’t any more 3D and nor should there be. In the real world this is because most of our visual cues are no longer effective. A key one being convergence which is most effective for distances below 10 meters. After this all textures start to look the same, perspective is the same and all our other visual cues have little or no effect. It would be possible when shooting 3D to shoot a lovely mountain scene with some depth but to do so you would have to increase the disparity (the distance between the lenses) to such a huge degree that the camera lenses would need to be meters if not miles apart.
An example of this can be seen in the 3D version of the Marvel superhero movie Thor. In this film it is filled with wonderful vistas of the mythical city of Asgard, the camera sweeps above the city and when watching in 3D you can see the depth of the buildings. However… due to your visual cues like familiar size and motion parallax your brain knows that a city of that size and viewed from this distance shouldn’t have any depth yet here it is. This ends up making you feel like the whole thing is more of a model than a huge city. To do this the CGI artists must have placed the virtual cameras at some great distance apart to give it a 3D effect when in fact they should have left it and accepted that a city of that size would have no real depth.
DISPLAYING 3D
This camera films in lovely 3D but can we see them in full colour 3D on our 3D TV? Absolutely YES! We have so far captured everything in stereo with one image designed for each eye but how do we get that into our brain? In the examples above we used the old-fashioned anaglyph method which using coloured filters allows one image for one eye and another image for the other eye. We use this as the chances are you won’t be reading this on a 3D capable monitor. But what if you did have a 3D capable monitor or TV? Well, it doesn’t matter as there is no standard or method for transmitting 3D footage via the internet, certainly not using a simple web browser. You see, the TV has to talk to the player. This means when you play a 3D movie on your Blu-Ray player the TV and the player talk to establish how this is going to happen, what method to use and then they work together. The same applies for your Sky HD box or Virgin TiVo box. It all gets very complex but the bottom line is… there is no way for me to show full colour 3D images or films in your browser. I would have to send you a Blu-Ray disk that you put into your home 3D theatre setup.
So you have a 3D TV, just how do they work? The most common 3D TV’s work by making you wear a pair of special active shutter glasses. These glasses are synced via a little sensor to your 3D TV so that one eye will be able to see the screen while the other will be blocked, a split second later it will swap so the other eye can now see the screen. At the same time the TV screen will display an image for the left eye and as the shutter in your glasses swaps the TV will also swap and show the image for the right eye. It does this so fast you don’t notice but the overall effect is the TV will show one image to one eye and another image to the other eye.
The other type uses those hipster glasses you use when viewing 3D movies at the cinema. Instead of the TV displaying one image and a moment later displaying the other it actually displays both at the same time. One line displaying one eyes image and the alternate line on your TV displaying the other eye. When you see the image without the glasses it just looks like a ghostly blur but with the polarized glasses combined with the polarized glass of the TV each eye sees just what it needs to see (until you tilt your head 45 degrees).
The next type is where you can view the 3D image without the need for any funny eye wear at all and this is the method the NX3D1 uses to display 3D on it’s built-in LCD screen. More on this in the next part of this 3 part series.
Each has their advantages and disadvantages and Wikipedia has everything you need on the subject if you want to know more.
WHAT HAVE YOU LEARNT?
So what have you picked up so far? 3D filming is all an illusion and we need to do what we can to maintain that illusion. Having things fly out of the screen is all very nice and fancy but it has to be done with some consideration. Will the edge of the object be clipped by the edge of the screen? If so then this will break the illusion.
Are you shooting something off in the distance? If so then accept that it may not appear to have much of a 3D effect and adding depth by increasing the disparity or in post using the Sony Stereoscopic 3D Adjust plugin will once again just break the 3D illusion.
You can use other visual cues to enhance the 3D effect. In the examples above it wasnt always each to notice Joshua’s hands popping out of the screen. But add a nearby object like the text which appears on the zero parallax it helps your brain register that the hands and ball should be appearing in front of the screen plane.
To get you ready for the next part here is a neat little video from Sony Professional about the NX3D1 with some more details on the science of 3D shooting as well as a little look at the camera itself. If you look carefully enough you will see me in the background pondering.
In the next part we will be taking a look at the Sony NX3D1 and in the final part we will look at the post production of working with 3D as well as our latest part in our series on the life of Joshua Jackson | My First Year in 3D. Again, you will need your red/cyan anaglyph glasses to view this work.
Disclaimer: Sony are in no way sponsoring this series of posts. During our masterclass they provided us all with lunch and some very tasty mini jacket potatoes as well as a full copy of Sony Vegas Pro 11 for editing our 3D footage. The camera was given to us on loan. Unfortunately no free 3D TV’s.
-Danny








no comments