In Depth: Keying: Pre-Processing Greenscreen Footage for Keying
Imagine this scenario: You light your greenscreen just right. Your camera settings were spot on. The lighting is even. There is not much noise. Shadows are not a problem. because your actor is standing at the right distance from your greenscreen. You don't have any spill. You have saved gobs of time and stress because you shoot it properly.
Oh wait! Your footage is not perfect? You've gotten footage shot by someone else. No? You shot it and you just don't know what you're doing because you're an editor, not a D.P. You'll learn how to do it right with experience. I know, a lot of video editors and motion graphics artists are now expected to do it all. I feel for you. You're used to sitting behind a computer and you're suddenly thrown into a studio. You will need to fix it in post.
See part 1 in this series:
In Depth: Keying: Introduction & Frequently Asked Questions about Shooting Greenscreen
As tempting as it is to just start applying keys when you have your green screen footage in your NLE, there are some things that you may need to do to prepare footage with problems for the process. Noticed that I used the word “may”. Not all steps are necessary and it will depend on the problems in your footage. These steps will hopefully improve your footage enough that you can end up with a good quality key in the end, and speed up your workflow and your render times.
Luckily, I don't deal with field issues much these days since I mainly work with progressively shot footage.
Warning, this is Deinterlacing 101. If you have to work with footage with fields, you will need to remove field interlacing before keying. Yes, you can key interlaced fields, but if you're shooting vertically and plan to rotate or scale interlaced footage, you're inviting a mess of problems. Some people may argue that you're removing half of the resolution of footage by removing fields, and this is, in fact, true. This is a huge benefit of working with progressively shot footage – you don't lose half your resolution when you remove field interlacing. However, have you ever tried to key interlaced footage? It can be done, but it's a mess.
To remove field interlacing, you must first determine the field order. DV NTSC is always lower field first, while HD 1080i is upper field first. Progressive video, as explained earlier, has no fields, so if you can shoot progressive, you should!
RE:Vision Effects FieldsKit – If you need a stronger tool, FieldsKit allows for many more field separation and pull down options than After Effects built-in options. FieldsKit works with After Effects, Premiere Pro, Final Cut Pro, Combustion and other After Effects compatible products.
If you're converting to 24fps, check out Red Giant Frames. Start with regular interlaced video, then apply Red Giant Frames' sophisticated algorithms for a smoother, professional de-interlaced look of 24p film.
You will get cleaner keys if you denoise your footage first. Noise can come from poor lighting, JPEG and other types of compression, film grain or half-tone patterns. Noise can even be induced by some filters and plug-ins. In DV footage, blue will almost always be the noisiest channel while green is the cleanest channel.
So, what can you do with that information to make noise removal better?
Noise Reduction Tips (Read more here!)
Always use a light touch and do not use degrain or denoise plug-ins too heavily.
It is often better to leave some noise in your footage than to over process and lose detail in your shot. Just because you can denoise your footage doesn't mean you should!
- If you have the option to denoise per channel, that is the best option. If you take a look at the separate RGB channels, it's highly likely that your blue channel has the most noise. Removing more noise on the blue channel (or wherever your noise may be) will help keep the detail in your footage.
- Sampling areas for degraining. If your plug-in allows for choosing your own sampling, like the After Effects Remove Grain plug-in and Cinnafilm Dark Energy Anti-Matter, choose an area that doesn't have texture. For example, if you have a shot of clear sky, the ocean and sand, you would want to sample noise from the sky, where the color is as even as possible. If you take a sample from an area with texture, like sand or moving water, the filters will reproduce that texture.
These tips come from a two part In Depth Article I wrote a few months ago on Noise/Grain plug-ins.
- In Depth: Noise/Grain Plug-ins for After Effects, Final Cut and Other NLEs, Part 1 of 2
- In Depth: Noise/Grain Plug-ins for After Effects, Final Cut and Other NLEs, Part 2 of 2
There are many plug-ins and filters for noise reduction. ✭ indicates my favorite
- In After Effects, the Remove Grain
- ABSoft NeatVideo Pro ✭
- Boris Continuum Complete BCC Noise Reduction
- Cinnafilm Dark Energy (Windows Only)
- CoreMelt C2 Gadget Editors Tools Noise Limiter (Mac only)
- GenArts Monsters GT M_RemGrain
- GenArts Sapphire S_Grain Remove
- Noise Industries FxFactory Noise Reduction (Mac Only)
- PHYX Cleaner Fast Noise Reduction (Mac Only)
- RE:Vision Effects DE:Noise
- Red Giant Denoiser II
- Tiffen Dfx DeNoise
Do you have unevenly lit footage? Does the lighting shift around your actor? There are plug-ins and techniques that can even out and brighten the green and make it easier to key.
This is another step that is not needed much of the time because of the use of garbage mattes. I'll go into garbage mattes in detail in a future article.
In the example above, the luminance level is much brighter around his head than it is around his shorts. There are some tricks you can use to make this less of a gradient. It's just very important that you make sure that you don't affect your edges and make them jaggy or affect the color of your footage. If you have a lot of spill, you may not be able to do much to even out your greenscreen because you would be affecting your footage as well as the greenscreen. There will be some experimentation that will need to take place to get it just right.
Yes, that is a marked difference! I did go a bit over the top with it for the purpose of demonstration, but allow me to explain the technique. Reduce, deartifact, smooth.
- Reduce Noise. I used ABSoft Neat Video Pro Reduce Noise.
- Deartifact. This HDV footage needed it, some will not. I used Red Giant Key Correct Deartifactor.
- There are a couple of ways to smooth the greenscreen lighting. I used Red Giant Key Correct Smooth Screen.
Below is a tutorial from 8bitdigitaltv about preprocessing your footage to make it easier to key. They have an interesting technique that uses the Selective Color filter that ships with After Effects.
Spill is green color that is reflected off of your greenscreen and is cast onto your actor. Depending on the your actor's hair, skin and wardrobe colors and reflectivity, spill can be a big problem! It can be very easy to fix, or difficult on finely detailed, extremely reflective or semi-transparent areas.
I am not going to go into spill removal here because I have an upcoming article in this series that is dedicated entirely to spill. Although color correction is not recommended at this point either, spill removal should not be a problem. You're just removing the green, after all, and your shot will be composited.
A Few Spill Suppressor plug-ins:
- The Foundry Keylight has a built-in spill suppressor and for added control you can use Edge Color Correction.
- Red Giant Primatte and Key Correct Spill Killer built-in
- Boris Continuum Complete Chroma Key has built-in Spill Suppression
- CoreMelt C2 Gadget Spill Suppression
- PHYX Keyer Despill
Stay tuned for a full-length article dedicated to spill removal, with lots of examples and a few good tricks!
In my book Greenscreen Made Easy, I talk quite a bit about garbage mattes. “A garbage matte is a loose animated mask around your foreground footage to exclude areas of your footage you do not want to keep, like uneven greenscreen lighting, shadows, tracking dots, props, wires and rigging. Using garbage mattes limits the amount of green that your keyer will have to process, speeding up your keying process. You'll get faster keys with less heavy-handed adjustments. ” With the use of a garbage matte, you may not need to bother to make your greenscreen color smoother.
Garbage mattes are too important to just gloss over in an article like this so I plan to dive deep in the next article, along with the process of creating procedural mattes with core mattes, a mutli-matte technique that will allow you to divide and conquer problem areas in your footage..
Now that you've learned a few things you can do to improve the quality of your footage, here are a few tips on how to not make things worse for yourself in the post-production process.
Don't remove too much noise so that your footage is blurry. Don't remove so much spill from your actor that it changes their skin tones. Don't even out your greenscreen if it doesn't need it. You'll only end up creating jaggy edges.
Pixel aspect ratio (PAR) is how square and non-square pixels look on your computer.
If you're working in square pixels but your footage is HDV, D1 or some other non-square format, key before you change your pixel aspect ratio. Rick Gerard talks about this in an old post on the Adobe forums. “If you have some particularly difficult green screen footage shot on HDV or DVCPRO HD for for example you may want to pull your key in a comp that matches the footage so that the keying can work with the original pixels but that's the only time that you may gain a very slight advantage using a non square pixel comp for production. I've never had the need.” You also do not want to scale before keying, because scaling up can cause stretching and smearing, making footage more difficult to key.
Learn more about Pixel Aspect Ratio
- Pixel Aspect Ratio at Wikipedia
- PAR for the Course – Working with the new pixel aspect ratios in CS4, by Chris and Trish Meyer. It may be from 2009 but it's a great resource of information.
If your colors are a bit off, don't be too tempted to adjust them here. Wait until you're compositing with your background plates to color correct. Some plug-ins can degrade your footage and the idea is to keep your footage as pristine and untouched as possible.
I know it's not the most fun job in the world, but if you end up with less than perfect greenscreen footage to work with, it's not the end of the world. Not everything can be fixed but I do believe a lot of it can be salvageable, and even good. Hopefully, your key will look great in the end and no one will even know that you had any problems.
In the next installment of this Toolfarm In Depth series on greenscreen, I will talk about garbage mattes. Then I'll talk about procedural mattes, a method to divide and conquer problem areas during your key. I still have a few topics to cover in this series, including spill suppression, the keyers, and compositing your foreground and background plates.
Also, thanks again to Jason James, who gave me a whole bunch of greenscreen footage for my book Plug-in to After Effects.
Posted by Michele Yamazaki