@Dexcon I know that. But I think it is not the problem of the PC specs as you can see that AI masking is working, but I might do the masking wrong. Let's see what others say and as I cannot spend a very significant amount for new PC parts, I have to find some work around if AI would not work as it is intended, in my PC. I need to mask properly so that I can superimpose a clip on another. That is my goal and I have to achieve that in any way possible with the current hardware I have. Thank you for reply.

You should have started masking at the beginning of the frame, not in the middle. You have a keyframe right there where the masking will start.

@sky-w Turn on 'Auto analyse current frame' as well as 'View masking results'

You should have started masking at the beginning of the frame, not in the middle. You have a keyframe right there where the masking will start.

I did and here is the result:
https://mega.nz/file/iSA1jKjL#nbIe3pBU57_XiPl3ZK7WjRDp-FsOEv_F3uu7bXOBKmM

In this video you can clearly see that the mask didn't move along with the subject, instead it remained at that fixed place. What should I do to move it along with the subject?

@sky-w Turn on 'Auto analyse current frame' as well as 'View masking results'

Nope. Didn't do any good, instead it did a confusing job. See the video:
https://mega.nz/file/jCAyRQ7J#J1AorQKu0UpXnQMMRXb40fHtBJ2TnYhhFH27M6WRrho

@sky-w You can upload videos on here using the arrow button next to the smiley at the top of a new comment.

-------------------

PS. can you put that video of the woman on a file sharing site like Google Drive & post the link on here using the chain button at the top of a new comment? I'll try it & I'm sure others will.

On that thought -

Smart mask 1 was crap, Smart mask 2 isn't much better, a few people on here have tried using it but I don't think anybody knows exactly how it works despite the online instructions. https://help.magix-hub.com/video/vegas/22/en/content/topics/8-design/fxplugins/ai_smartmask2.htm?cshid=2116. Even the Vegas on-line 'instructors' seem to be doing a bit of guessing.

Those on here that have used it. inc me, & have made successful videos have found it to be very PC intensive, (check the specs of my PC in my Signature at the bottom of my comments), long times for mask creation & average at best results that leave little or no room for adjustment. The remarks about your PC's below par specs are def warranted esp with this mask fx.

Basically if you can get a good result with Smart mask 2 then good , but don't have high hopes or expectations.

--------

Oh yeah, you don't need to start tracking from the start of your video, that is why it has track forward & track backwards in the options. With any tracker it's best to start tracking from a frame that clearly shows the object you're intending to track, proceed then to track backwards & forwards from that point. Vegas tracker & Mocha both have the option to track forwards & backwards just for this reason.

@sky-w

Hello, I don't own Vegas Pro.

But I've worked with some object segmentation/background removal tools.

All of them also required you to complete the mask (Complete Masking).

You may still need to perform this procedure.

I can only give advice, as I can't try it out myself with Vegas Pro.

@Gid OOOHHHH!!! That is a dream machine which I wouldn't be able to build... not at least in coming 5 years and then Vegas will advance more and will be more demanding. So, I think, I have to drop the idea of using AI masking, totally. But now you know my goal, can you guide me to any other process to remove the background which my PC can handle?

PS. Here are the links of bothe files I have used:
Girl: https://mega.nz/file/ybQ3jRqK#ajZxyjJ1vQVxMi9pAEL8e3leo196ErnA0urP_oS0KRo
Beach: https://mega.nz/file/nKRy0LjY#Xj_XnzQsfCrtEefzXeMpHMyVfjnxcHFzE7DQRGWJEnk
Regarding uploading video here, I tried but after uploading, the loading sign was circling for a long time and I cancelled and upload them in Mega and posted the links here. May be it was a network issue at my end. I will try it again.
Btw, you are a heck of a carpenter. I will see all your videos. They seem very interesting. :)

@Marc-Goder How did you do it, I mean bacground remove? And believe me, I completed the whole process and rendered the final output. It was a mess and worst than the result showing inside the Vegas Pro. Here is the result:
https://mega.nz/file/yGxiVILC#Nj4Il97BYYfi43Z0rjoGZ8zyIUeUwPN67l9cU2CQrcI

@sky-w Hi, this is the first try, like i say the quality of the mask can be crap, I'll try it a few times & see if I can get a better result.

When you're uploading videos on here, you'll get an orange bar go across the pop-up window which will turn green, then that bar will disappear, but the grey box with the blue circle can at times remain circling for quite a long time after clicking Comment. Leave it be, it should show in the comment eventually. I noted your videos are .MOV, I don't know what format you're trying to upload but MP4's are prob better for uploading (don't quote me on that as it might make no difference)

-------------

(I've uploaded this vid & typed this comment but the grey box is still grey with a blue circle, I'll click Comment but like I say it sometimes takes a little while to show )

@sky-w This is before tracking, you can see the highlighted area changes from the woman to the background as I click along. The highlighted area is what will be tracked & masked, so if that highlighted area isn't consistent the final track/matte will be crap.

I don't think I can get a good track/mask with this clip, I've tried selecting parts with the green + as you did, I tried altering the contrast etc of the clip prior to trying to mask it with Smart mask without any luck. Maybe someone else will have more success 🤷‍♂️ Sorry.

@sky-w Ok this is a better version.

I tracked the background instead, then used the Mask Refinement to invert the mask, there's still some bits that don't get masked, a bezier mask could cut them out & I didn't shrink or feather the mask to refine it. but still a lot better than trying to mask the woman.

@sky-w

Your video with the woman has too many of the same colors.
This makes it very difficult for any software to create a mask.
The woman should be wearing clothes that are more distinct from the surroundings.
The sky and grass / grain, are very similar to the color of the guitar and clothing.

That's the best I can get out of it.

https://drive.google.com/file/d/114sb8FCYHa_UgRGCSGn9zB9D-V-kbtRT/view?usp=drive_link

@sky-w Ok this is a better version.

I tracked the background instead, then used the Mask Refinement to invert the mask, there's still some bits that don't get masked, a bezier mask could cut them out & I didn't shrink or feather the mask to refine it. but still a lot better than trying to mask the woman.

You have done an incredible job. But still there are glitches which are not your faults. It seems that AI is not very efficient when handling complex environment and as this is the most hyped topic, probably in this decade, Magix has to jump in the flow before testing it fully as they are also suffering from FOMO syndrome. :D

But as @Marc-Goder has correctly identified the problem regarding the colour and as AI is not that intelligent till the last DLM created, it is failing to recognize the colour difference at micro-minute level. But the 'Boris FX Color Key' is also failing because of colour variations in the girl footage. Though Adobes own Colour Key effect successfully removed the whole sky at one go, it fails to remove other colours like green shades and brown shades. I don't know about Resolve as it is a very demanding software reagarding hardware and the free version doesn't have some even basic otions like upscaling. So, I don't know what will Resolve do in this type of case. Besides asking you I also searched the internet on this topic and came to a clonclusion using the insights given by you all here and other websites and forums, the choice of the clip was wrong for AI masking or Colour Key. The intended effect might be achieved by using Bezier Masking but it is verty time consuming. So, the solution is to use masking and tracking with my present setup, I must use a clip with single and uniform coloured background or at least the portion I would want to remove. So, what do you say? Is my understanding correct? Oh, and one thing, I could not find any native Colour Key effect inside Vegas Pro 22 bild 250. My friends, can you confirm it? And my heartfelt thanks to all here who tried to help me and wasted their valuable time just to give me some insights, though this thread has not ended yet.

>I could not find any native Colour Key effect inside Vegas Pro 
Er ... Chroma Keyer?

>it is failing to recognize the colour difference ...
Depends on the AI tool you are using. The (newish) Matte Assist ML in Mocha Pro, for example, doesn't seem to struggle too much with this clip. The following took about 2 mins to do in total