Auto Tracking

Roger Bansemer wrote on 12/18/2022, 8:16 AM

Do you think Vegas will ever implement an automatic AI auto tracking of faces and figures for removing backgrounds? CapCut which is a free video editing software does a pretty good job at it and does it in a matter of seconds.

Comments

walter-i. wrote on 12/18/2022, 9:17 AM

It doesn't really matter what we (users) think, but more whether developers and ownership expect it to provide a competitive advantage, or a particular customer benefit.
My suggestion:
Post it in this thread, (that's where the developers look in too) and make the responsible people's mouths water.
https://www.vegascreativesoftware.info/us/forum/vegas-pro-feature-requests--134374/?page=17#ca863924

Former user wrote on 12/19/2022, 12:42 AM

Do you think Vegas will ever implement an automatic AI auto tracking of faces and figures for removing backgrounds?

That opens the door to other AI stuff like beauty filters, and auto reframing. I use automated reframing all the time for posts meant for social media. I'll show an example. And it can be seen it's not perfect, it's not how a human would reframe all those shots, but it's good enough that it can still be much faster modifying some keyframes then adding them all manually.

Auto Reframing has been available on Premiere and Resolve for a number of years now.

 

 

RogerS wrote on 12/19/2022, 12:46 AM

I do, yes as Vegas now has the hooks to connect to AI engines.

I just don't think it's at the top of the priority list (and rightly so) as there are more basic playback and performance issue to attend to.

Custom PC (2022) Intel i5-13600K with UHD 770 iGPU with 31.0.101.4091 driver, MSI z690 Tomahawk motherboard, 64GB Corsair DDR5 5200 ram, NVIDIA 2080 Super (8GB) with latest studio driver, 2TB Hynix P41 SSD, Windows 11 Pro 64 bit

Dell XPS 15 laptop (2017) 32GB ram, NVIDIA 1050 (4GB) with latest studio driver, Intel i7-7700HQ with Intel 630 iGPU (driver 31.0.101.2115), dual internal SSD (256GB; 1TB), Windows 10 64 bit

Vegas 19.648
Vegas 20.270

VEGAS 4K "sample project" benchmark: https://forms.gle/ypyrrbUghEiaf2aC7
VEGAS Pro 20 "Ad" benchmark: https://forms.gle/eErJTR87K2bbJc4Q7

FayFen wrote on 12/19/2022, 5:40 AM

If all AI, then will VP23 do all the work once one loaded the media and writes "VP! I want 12'34" project ASAP, comprendo? I'm going for a mug of coffee"

vkmast wrote on 12/19/2022, 5:56 AM

@FayFen do you assume you will then still need to write your commands...

fr0sty wrote on 12/19/2022, 7:37 AM

I know nothing of the progress, but I can say that based on my conversations with the dev team, auto masking via AI is something they are indeed looking into. I've been asking for it since V19.

Systems:

Desktop

AMD Ryzen 7 1800x 8 core 16 thread at stock speed

64GB 3000mhz DDR4

Geforce RTX 3090

Windows 10

Laptop:

ASUS Zenbook Pro Duo 32GB (9980HK CPU, RTX 2060 GPU, dual 4K touch screens, main one OLED HDR)

Steve_Rhoden wrote on 12/19/2022, 11:00 AM

@Roger Bansemer It's definitely on the radar of the Vegas development team Roger.....

FayFen wrote on 12/19/2022, 12:07 PM

@FayFen do you assume you will then still need to write your commands...

Well... I better do something.

Roger Bansemer wrote on 12/19/2022, 2:54 PM

I do, yes as Vegas now has the hooks to connect to AI engines.

I just don't think it's at the top of the priority list (and rightly so) as there are more basic playback and performance issue to attend to.

That's for sure. I started a new project today using Vegas17 and worked on it almost all day with not one crash or "not responding" I saved it for V17 and then moved to V20 and saved it there as a new project and almost immediately it lagged and was dealing with the "not responding" issue again. Only reason I'm using V20 is because of a few new features for color correcting, etc.

fr0sty wrote on 12/20/2022, 8:28 AM

More bugfixes for 20 are not far off... they just squashed one big one that was affecting a lot of users since VEGAS 19, which is why 19 just got a new update as well. Perhaps that or one of the other fixes will address your problem. If not, let us know (especially if you can provide us steps to reliably repeat the problem so we can try to reproduce it), and we'll make sure the dev team is aware if we can't help you sort it ourselves.

Systems:

Desktop

AMD Ryzen 7 1800x 8 core 16 thread at stock speed

64GB 3000mhz DDR4

Geforce RTX 3090

Windows 10

Laptop:

ASUS Zenbook Pro Duo 32GB (9980HK CPU, RTX 2060 GPU, dual 4K touch screens, main one OLED HDR)