Flood fill algorithm for background removal (better chroma keyer)

nonam3 wrote on 5/31/2022, 8:19 PM

Hello,

Question (and probably feature request) regarding flood fill algorithm for background removal - is such plug-in available for Vegas? Searched and found some open source OFX plugins, but unfortunately those didn't worked with Vegas.

It would be helpful for Vegas to either expand current chroma keyer or add new plugin with such functionality.

Best regards

Comments

Former user wrote on 6/1/2022, 12:18 AM

I don't think that is a common feature yet for NLE's. They have a beta grade version in Resolve Studio . It is a a bit hit and miss, in this example I selected remove everything but man and grass, replaced original wire fireworks

By default I was left with a glow around man, I used a slider in FXl to reduce it. Did not notice, but reducing the glow ate into the subject. Because they use contrast to differentiate these things will frequently fail

nonam3 wrote on 6/1/2022, 12:34 PM

This is exactly the result that I want to achieve. Granted it will not work in all cases but having additional parameters / options and ability to i.e. add more then one FX effect to the event should resolve most of the issues (as flood fill will work based on are not whole image).

Personally I was thinking of implementing such FX plugin for Vegas myself but had to much work to tackle this and am not sure if OFX API will allow to do that (depends on kind of input that API exposes I guess have to look into that)

Former user wrote on 6/1/2022, 9:43 PM

Personally I was thinking of implementing such FX plugin for Vegas myself but had to much work to tackle this and am not sure if OFX API will allow to do that (depends on kind of input that API exposes I guess have to look into that)

One thing I've noticed with Vegas their GPU processing seems to get limited when using OFX plugins, like there is a bandwidth or latency problem that doesn't exist with internal filters. In latest release of Vegas it's finally been updated to OpenFX 1.4 API so that could be helpful.

NeatVIdeo make a special version for Vegas with the comment "The OFX support in Vegas is still not most reliable. Which is why we do not currently support it in our OFX plug-in but may add such support later.". NeatVideo works great as far as GPU support but it seems they couldn't make it work via the old OFX Api. Maybe new versions will be OFX

This is the processing that is required for Resolve to do this, potentially much slower via 3rd party OFX, but even if it was would be a very unique OFX filter that would be hugely popular. This video is to show the amount of GPU processing required for this native filter (2x playback speed)