Moving video behind of a mask

Comments

fr0sty wrote on 8/29/2023, 10:16 PM

Because the above video already had the mocha freeze stabilization applied to it, I was able to draw a circle mask around his face, and you'll see it stays perfectly inside the circle the entire time. That's the key, the mask goes on last, after you applied the mocha freeze stabilization effect to the video itself, not to the mask.

Last changed by fr0sty on 8/29/2023, 10:20 PM, changed a total of 2 times.

Systems:

Desktop

AMD Ryzen 7 1800x 8 core 16 thread at stock speed

64GB 3000mhz DDR4

Geforce RTX 3090

Windows 10

Laptop:

ASUS Zenbook Pro Duo 32GB (9980HK CPU, RTX 2060 GPU, dual 4K touch screens, main one OLED HDR)

Godzinhu wrote on 8/29/2023, 10:21 PM

@fr0sty I guess that what is wrong is my mocha tracking, when i try to track something small it fails, i guess that its the video quality that is giving issues since its an old video

Former user wrote on 8/29/2023, 10:24 PM

@Godzinhu Hi would you share that short clip of you, unedited, no mask etc. ?

Some of the tracking problems (error msgs) might be how you're tracking, Mocha is a planer tracker, it likes to track individual 'planes', you could think of them as flat surfaces, unfortunately someones head isn't just one flat surface you also turn your head. Mocha doesn't like reflections either, there's quite a lot of shine on your headset, & you need to exclude your hand that covers your face, you can draw/track a spline around your hand on a layer above your face tracking spline that will make the tracking layer exclude it, As @fr0sty says it can be 'a bit challenging to learn', There's loads of Mocha Pro videos on Boris's site where the basic tracking technique will apply to Mocha Vegas too https://borisfx.com/videos/?tags=product:Mocha%20Pro&search=

Godzinhu wrote on 8/29/2023, 10:30 PM

its a little big, i just cut the portion when i move arround to better attempt in adjust it

fr0sty wrote on 8/29/2023, 10:54 PM

Here's a step by step... the key is to use the bezier masking effect instead of the mask in event pan crop, and to make sure the masking effect is applied AFTER VEGAS stabilization. otherwise the mask will move around with the mocha track. I didn't get a perfect track in mocha, so his head drifts a bit, but it was a complex dancing figure I was trying to track, your head just talking to the camera should track much easier. To further refine this, I'd repeat the same process over again after getting a better track in mocha.

Systems:

Desktop

AMD Ryzen 7 1800x 8 core 16 thread at stock speed

64GB 3000mhz DDR4

Geforce RTX 3090

Windows 10

Laptop:

ASUS Zenbook Pro Duo 32GB (9980HK CPU, RTX 2060 GPU, dual 4K touch screens, main one OLED HDR)

fr0sty wrote on 8/29/2023, 10:56 PM

try adjusting the brightness and contrast in your video so that areas of your face stick out more, and apply mocha after the brightness/contrast effect, so that it has something easier to track. After the mocha tracking is done, you can disable the brightness/contrast effect to return the video back to its normal state.

Systems:

Desktop

AMD Ryzen 7 1800x 8 core 16 thread at stock speed

64GB 3000mhz DDR4

Geforce RTX 3090

Windows 10

Laptop:

ASUS Zenbook Pro Duo 32GB (9980HK CPU, RTX 2060 GPU, dual 4K touch screens, main one OLED HDR)

fr0sty wrote on 8/29/2023, 10:56 PM

Try the video tutorial I just made above. It's specialized for your use case.

Systems:

Desktop

AMD Ryzen 7 1800x 8 core 16 thread at stock speed

64GB 3000mhz DDR4

Geforce RTX 3090

Windows 10

Laptop:

ASUS Zenbook Pro Duo 32GB (9980HK CPU, RTX 2060 GPU, dual 4K touch screens, main one OLED HDR)

Former user wrote on 8/29/2023, 10:57 PM

 

@fr0sty I guess that what is wrong is my mocha tracking, when i try to track something small it fails, i guess that its the video quality that is giving issues since its an old video

I told you what to do , I showed you what to do. You don't want to use mocha, you want an AI re-framer, Vegas doesn't have one. Mocha will lose track whenever it can't see your face clearly, either because you turned your head or even if your hand goes infront of your face.

It's not at all suited to what you're doing with multiple cuts and maybe 10 - 20 minute video, you want AI based reframing.

Godzinhu wrote on 8/29/2023, 11:00 PM

I am watching it, sadly the video quality does not allow me to read the texts, but i am tryng to follow step by step

fr0sty wrote on 8/29/2023, 11:02 PM

Here's the text

first we're going to track the motion with mocha. note that i only applied the transform tracking, the first tracking option, I turned all the others off.


Mocha has lost track of his hat, so we'll correct that real fast.

Didn't mean to do that... (don't let this part mess you up, I had to ctrl+Z to undo the button I didn't mean to press).

Here's the trick... to do the mask, do not use the mask option in event pan crop. Instead, use the bezier mask effect. make sure it is applied AFTER Mocha.

We're losing track, so to fix that, go back into mocha and refine the track until you get it just right.

This is the basic idea of how it is done, you'll refine it from here to get it just right.

After you finish tracking and get your mask applied, you can then use track motion (NOT pan/crop) to move the mask and the video around to wherever you want it to be on the screen.

Last changed by fr0sty on 8/29/2023, 11:10 PM, changed a total of 1 times.

Systems:

Desktop

AMD Ryzen 7 1800x 8 core 16 thread at stock speed

64GB 3000mhz DDR4

Geforce RTX 3090

Windows 10

Laptop:

ASUS Zenbook Pro Duo 32GB (9980HK CPU, RTX 2060 GPU, dual 4K touch screens, main one OLED HDR)

fr0sty wrote on 8/29/2023, 11:14 PM

The main key thing to remember is after the mocha tracking is done, you cannot use the mask tool in event pan crop like you are in that video you posted, you must use the bezier mask effect, and it must be applied after the vegas stabilization effect in your effect chain.

Godzinhu wrote on 8/29/2023, 11:18 PM

@Former user I appreciate your help man, i trully do, but i kinda don't want to use multiples software to do this, even tho one are specialized on it, if i can do all in one i will go for it.

@fr0sty you are a legend bro! i just realized where i was doing a mistake while watching your video, i was using pan and crop, not that bezier mask, thats why the bubble was all messed up, now i am just tryng to understand how do i position the bubble in the screen and also resize the video to increase/decrease the camera zoom

Godzinhu wrote on 8/29/2023, 11:45 PM

@Former user it is not loading for me for some reason

Former user wrote on 8/29/2023, 11:47 PM

@Godzinhu Yep, I uploaded ProRes & the forum doesn't seem to like that, I've rerendered it as MP4, It's loading as i type but still taking it's time, Took too long so I deleted that, I'm uploading it to YT, this forum normally accepts my vids no prob but it can be grumpy 🤷‍♂️

Former user wrote on 8/29/2023, 11:57 PM

@Godzinhu Hi, just using Pan/Crop 4 keyframes & the Cookie cutter for the circle mask

Godzinhu wrote on 8/30/2023, 12:04 AM

@Former user I liked it! seems easier and faster, i have already saved the video to check more on it later, i guess that mocha is for bigger projects, but i loved both ways to do, and i have learned something new wich is win win haha, i can't wait to try more stuffs with mocha. But since its 2AM here now its time to get some rest.

Godzinhu wrote on 8/30/2023, 12:06 AM

Thank you everyone that spend your time to assist one amateur video editor haha ! 💯😃

Former user wrote on 8/30/2023, 12:07 AM

@Godzinhu 👍 Yep sometimes simple is the way to go, It's 6am here & I've been up all night 🥱🤣

fr0sty wrote on 8/30/2023, 12:14 AM

@Former user I appreciate your help man, i trully do, but i kinda don't want to use multiples software to do this, even tho one are specialized on it, if i can do all in one i will go for it.

@fr0sty you are a legend bro! i just realized where i was doing a mistake while watching your video, i was using pan and crop, not that bezier mask, thats why the bubble was all messed up, now i am just tryng to understand how do i position the bubble in the screen and also resize the video to increase/decrease the camera zoom

Use track motion to position and resize the bubble. Track motion can be found in the track option menu on the left side of every track.

Alternately, you can do this at the event level instead of at the track level by applying the picture in picture effect at the end of the effects chain after the bezier mask effect, and then you can drag the entire mask and video around wherever you want on the screen and resize it as needed.

 

Last changed by fr0sty on 8/30/2023, 12:15 AM, changed a total of 2 times.

Systems:

Desktop

AMD Ryzen 7 1800x 8 core 16 thread at stock speed

64GB 3000mhz DDR4

Geforce RTX 3090

Windows 10

Laptop:

ASUS Zenbook Pro Duo 32GB (9980HK CPU, RTX 2060 GPU, dual 4K touch screens, main one OLED HDR)

Godzinhu wrote on 8/30/2023, 9:21 AM

@fr0sty is there any configuration to prevent vegas from crashing every 2 minutes ? xD i have a pretty decent computer but for some reason it keeps crashing

 

RogerS wrote on 8/30/2023, 9:35 AM

Is it related to the masking/Fx? If not perhaps create a new post here so you can get help specific to that issue.

fr0sty wrote on 8/30/2023, 9:59 AM

Make a new thread containing the info requested in this post, specifically sections B and C.

 

https://www.vegascreativesoftware.info/us/forum/important-information-required-to-help-you--110457/

Systems:

Desktop

AMD Ryzen 7 1800x 8 core 16 thread at stock speed

64GB 3000mhz DDR4

Geforce RTX 3090

Windows 10

Laptop:

ASUS Zenbook Pro Duo 32GB (9980HK CPU, RTX 2060 GPU, dual 4K touch screens, main one OLED HDR)