Auto-gain?

michael-harrison wrote on 5/11/2020, 7:13 PM

Is there a plugin available that can dynamically alter the gain/levels or similar based on monitoring a patch on a video?

I've got a few videos that were recorded in a sunny room during a partly cloudy day and the lighting is changing every once in a while.

Often enough that I'm not eager to animate the levels and create keyframes to keep the speaker at the same lighting levels.

I can imagine that something like Silhouette from Boris might do this but haven't looked for this before.

Any recommendations?

System 1:

Windows 10
i9-10850K 10 Core
128.0G RAM
Nvidia RTX 3060 Studio driver [most likely latest]
Resolution        3840 x 2160 x 60 hertz
Video Memory 12G GDDR5

 

System 2:

Lenovo Yoga 720
Core i7-7700 2.8Ghz quad core, 8 logical
16G ram
Intel HD 630 gpu 1G vram
Nvidia GTX 1050 gpu 2G vram

 

Comments

Musicvid wrote on 5/11/2020, 7:27 PM

These autoexposure controls are in your camera.

Lacking their use, you will find there are two or three more-or-less repeatable lighting scenarios. Make a stock correction for each and apply it to your video, judiciously. Dont obsess on it.

There is no inexpensive plugin I am aware of to do this; autocorrection implies much more than exposure; like contrast, keying, subject weighting, backlight compensation, and specular suppression. Even if you could afford such a thing, it would take a long time to complete one pass.

RogerS wrote on 5/11/2020, 7:56 PM

I think MusicVid's advice on a couple of settings is the best solution.

Alternatively, the SEMW autolevels plugin is free and does a decent job with exposure and white balance but you don't have much control over what it does: https://www.semw-software.com/en/autolevels/

michael-harrison wrote on 5/11/2020, 7:59 PM

@Musicvid @RogerS

You misunderstand. I did not record these videos nor do I have any control over the environment in which they were or will be shot. I just get to edit them.

System 1:

Windows 10
i9-10850K 10 Core
128.0G RAM
Nvidia RTX 3060 Studio driver [most likely latest]
Resolution        3840 x 2160 x 60 hertz
Video Memory 12G GDDR5

 

System 2:

Lenovo Yoga 720
Core i7-7700 2.8Ghz quad core, 8 logical
16G ram
Intel HD 630 gpu 1G vram
Nvidia GTX 1050 gpu 2G vram

 

Musicvid wrote on 5/11/2020, 8:10 PM

Advise remains. Make two or three correction presets and don't sweat the rest.

Former user wrote on 5/11/2020, 8:44 PM

Is there a plugin available that can dynamically alter the gain/levels or similar based on monitoring a patch on a video?

I've got a few videos that were recorded in a sunny room during a partly cloudy day and the lighting is changing every once in a while.

 

It's difficult to search for that info in google or explain what is meant even though I know exactly what you mean. When I tried to search for such a plugin, my problem was auto exposure being on in camera, aimed at at an area in shadow but as people walked infront of camera who were in sun, exposure kept changing. What would be needed is a filter that measures illumination level where you manually mark and keeps it within a certain range. With 8bit color this has the potential to look terrible but maybe through some sort of artistic expression a shot could be saved.

I have to think such an effect exists, as many others would have experienced a similar problem

Musicvid wrote on 5/11/2020, 9:11 PM

Yes, it probably exists, is certainly very expen$ive, is ungodly slow, and gets it right about 40% of the time without manual intervention on a good day. You're talking about unbaking a cake, not a straightforward math problem..

Former user wrote on 5/11/2020, 10:53 PM

I don't know how well they work but Premiere has Auto Levels and Resolve has Color Stabilizer. These are builtin, not 3rd party plugins. I had a quick look at color stabilizer, but I don't have any media currently to test it with. If anyone does know of a plugin that works with vegaspro please comment.

RogerS wrote on 5/11/2020, 11:06 PM

Is there a plugin available that can dynamically alter the gain/levels or similar based on monitoring a patch on a video?

I've got a few videos that were recorded in a sunny room during a partly cloudy day and the lighting is changing every once in a while.

 

It's difficult to search for that info in google or explain what is meant even though I know exactly what you mean. When I tried to search for such a plugin, my problem was auto exposure being on in camera, aimed at at an area in shadow but as people walked infront of camera who were in sun, exposure kept changing. What would be needed is a filter that measures illumination level where you manually mark and keeps it within a certain range. With 8bit color this has the potential to look terrible but maybe through some sort of artistic expression a shot could be saved.

I have to think such an effect exists, as many others would have experienced a similar problem

I think you misunderstood the responses. Both of us recommended solutions to use in Vegas, not in camera- the presets would be curves or levels Fx to grade your scenes (for example: dark, light, middle).

Did the autolevels plugin I suggested above not work for you? Do give it a try and see what it does.

Realistically though I don't see a way to have this work well- the best case is to mitigate how bad it looks, probably by brightening underexposed footage and darkening the subjects until they are a reasonable brightness in the too bright scenes (even if the backgrounds are clipping to white).

Former user wrote on 5/12/2020, 12:35 AM

This is an example of davinci auto color stabilizer. It's not the same situation as the poster, but it is tracking a section on the back wall and changing the brightness if it detects a change in illumination. In this example the person is using a camera with extra sensitive auto exposure, to the extent that you see noticable lighting and darkening on the back wall as he moves. After the filter is added the problem is much less obvious so I feel if Poster could get a plugin for vegas it could be effective and be much less work than constantly manually keying the exposure each time the sun comes in and out of clouds

michael-harrison wrote on 5/12/2020, 1:27 AM

@Musicvid @RogerS

@Former user Lenard has the best understanding of my situation. It's not worth it for me to animate levels changes during the short video I'm working on currently. The time needed just isn't justified. Coming from the 3D development world I know this sort of thing is not only possible but computationally cheap and I was hoping someone had done it and I could add in just a little bit extra to make the resulting video a bit better. It's also not worth it (yet) for me to dive into plugin development for Vegas but that day may be coming.

Also understand that the video was recorded using Zoom so the quality isn't great to start with and any artifacts would, almost literally, be lost in the noise.

There are two methods I found that work within Vegas.

Boris Sapphire has a Flicker Remove effect that works pretty well and evens out the levels without too many obvious artifacts. Unfortunately it looked like it would take some tweaking to make the visual result worth it so I started digging in the other Boris tool that I just recently received.

Boris Silhouette has a Deflicker effect that gives near-perfect results. The drawback is that it's an external tool and the footage has to be exported to an image sequence, processed and re-imported. Odd to me but my understanding is the tool is primarily used by big studios and that's their process. For the short (5 min) video I'm working on currently, that's not an impediment.
 

I'll have to give Resolve a shot since it gets mentioned a fair amount. Probably worth being passably familiar with.

System 1:

Windows 10
i9-10850K 10 Core
128.0G RAM
Nvidia RTX 3060 Studio driver [most likely latest]
Resolution        3840 x 2160 x 60 hertz
Video Memory 12G GDDR5

 

System 2:

Lenovo Yoga 720
Core i7-7700 2.8Ghz quad core, 8 logical
16G ram
Intel HD 630 gpu 1G vram
Nvidia GTX 1050 gpu 2G vram

 

john_dennis wrote on 5/12/2020, 1:35 AM

@michael-harrison

This may be a long shot depending on the period of the changes.

GBDeflicker

Though it is marketed as an Adobe plugin, there is a standalone Windows version that operates on still image sequences. No big deal for time lapse shooters, but you would have to render your troublesome source to still image sequences and back to video. There is a free trial and the price is reasonable.

Marco. wrote on 5/12/2020, 1:46 AM

I use Graide Color Match for this purpose, even for the light changes of time lapse recordings. In continuous mode you pick one reference frame or a section of it and it will control the other frames.