VEGAS 21 Update 3 launches tomorrow, here's a video showcasing the new AI Smart Mask 2.0 effect, and how it can be used to mask a person out from the background in less than 90 seconds.
From here, the result can easily be further refined, but this is just to showcase how easy it is to get usable results very quickly.
interesting
Needs better edge softening the way Capcut does it here, more acceptable to the eye even if the resolution of the cut out is similar to Vegas. I had an attempt at softening edges on the Vegas version(right image), better result but not great.
@UltraVista We'll soon get there.
@fr0sty Just tried your clip downloaded from your other post,
I've got to this point, shouldn't the Complete Masking activate or do we have to work with it like this? (clicking on a different event & then back to AI Smart mask resets the View Masking Results to unticked), I noticed i your vid it doesn't activate either.
This is playback over jpg, less then 1fps.
& trying this has crashed Vegas 3 times, (I've tried this fx 3 times)
Don't expect smooth playback at this point, this effect is very CPU intensive. I never tried to play back the file after making the mask, I just skipped around on the timeline to make sure the mask didn't lose tracking at any point and made refinements as necessary. If you need a smooth preview, you'd have to use selective pre-rendering most likely... but it would take a while. Still a long way to go before we can have these AI effects preview smoothly.
I've reached out for clarification about the complete mask thing... I was able to get a usable mask without it, but yes, I too need to know why it was greyed out.
@fr0sty Preview rendering filled in all the missing keyframes, took at least 10mins but didn't improve playback (my RAM didn't increase at all) & without an actual mask being created how can it be adjusted?
Selective pre-rendering is set to mp4, there's no pop-up giving you the render options, it just goes straight into rendering? I don't remember how to change that so I rendered using ProRes XQ to get the Alpha, it took 9.26mins,. What render option to get the Alpha would you choose?
@fr0sty If you use the 'Auto analyze current frame' option, make sure that you untick the checkbox before you select your mask. If you leave it checked, the 'Complete Masking' option stays greyed out. It's unrecoverable from there unless you remove the FX and start again. I never use the Auto analyse option, that's why I've never seen the option greyed out.
Correction - If the option is greyed out, clear all the masks, including the current one and uncheck the checkbox. Analyse the current frame again and select a mask. The option becomes available again.
90 seconds is a bit of an exageration! It took 10 minutes to Complete Masking on a 3-second clip, and that was only in 1080p. I was quite impressed by the result though, except in an area where the subject was dark and the background fussy, so given a careful choice of source material should be very usable. A promising start - slow, but thats to be expected.
@Jack S Thanks, yep unticking Analyse the current frame made the Complete Masking available, the preview only showed the first mask so I turned back on Analyse the current frame & it then showed all masks as i clicked across the event 👍.
Creating masks takes a while, estimate approx 9mins for your 8sec woman vid.
-----------------
🤷♂️🤔 Creating masks filled in all the keyframes but still doesn't play back, less then 1fps or give any option for adjustment?
90 seconds is a bit of an exageration! It took 10 minutes to complete the masking on a 3-second clip, and that was only in 1080p. I was quite impressed by the result though, except in an area where the subject was dark and the background fussy, so given better source material should be usable. A very promising start - slow, but thats to be expected.
It took just a bit over a minute to create and refine the mask. Rendering it is a different story, but that is a hands-off process, the video was meant to show how much manual intervention was required to pull it off. For that, less than 90 seconds is accurate.
Less than 90 seconds to create, yes, render time? lul
https://streamable.com/wjh2qq this took 30 minutes to render on a 3090ti using CUDA
(orignal)
Yeah, render times could improve, and hopefully will... but at least that isn't time spent behind the keyboard, you can open another instance of VEGAS and keep cutting, or work on another computer to keep getting work done. I would have spent a good half hour or so manually masking that girl out.
I agree setting up the mask on the first frame is pretty quick and easy. It was the 'Complete Masking' creating a mask for every frame which took a long time. At least once that was done it was possible to preview at normal frame rate. Rendering didnt take any significant extra time.
Hello! I am currently testing this new feature on a 15 second video. While the analysis only took a minute, the task "Complete masking" lasted 2.5 hours. Is this normal? I think I have a powerful machine: Core i7 13th generation, 32 GB of RAM and Nvidia GeForce RTX 4060 graphics card... In the promotional video, it only takes a few seconds!
Hello! I am currently testing this new feature on a 15 second video. While the analysis only took a minute, the task "Complete masking" lasted 2.5 hours. Is this normal? I think I have a powerful machine: Core i7 13th generation, 32 GB of RAM and Nvidia GeForce RTX 4060 graphics card... In the promotional video, it only takes a few seconds!
Rendering the mask takes longer, but it didn't take me 2.5 hours for 15 seconds... The video is meant to illustrate how long it takes to create and refine the mask, to illustrate how efficient the UI workflow is, not to show how long the render takes.
In that case, am I wrong for it to be so long? Processing 9 seconds of video shouldn't take 2.5 hours. With the previous version (1.0) I only waited a few minutes.