Vegas Pro Edit 365 AI Smart Mask 2.0 does not work

Joseph-Pace wrote on 6/26/2024, 12:37 AM

 

Here's a Youtube video, PLEASE FIX THIS! I can't even use pan/crop to set the video on top center of portrait view, any suggestions how to fix this or is this actually broken and does not work...?

I paid for this software expecting this to work and none works.. but I am looking forward to working versions, please fix this...

Or how do I get around this problem..?

Comments

RogerS wrote on 6/26/2024, 12:43 AM

You're cropping it before the smart mask Fx. What if you move the smart mask Fx first in the Fx chain? Or add a different Fx after it like picture in picture and or crop? Or use track motion to recenter the video?

Joseph-Pace wrote on 6/26/2024, 12:50 AM

They all freeze, break lol, I need it on a cropped video and it just won't work period, I've tried everything, as LONG as the video is cropped, it WILL break the smart mask PERIOD... I can't get it to work period and this sucks because I got all projects that's all edited from older vegas, videos are all cropped and I cannot get the smart mask 2.0 to work at all on any cropped videos.. :(

 

And I need it to work on a cropped video to put it above gameplays for making shorts, we need that fixed badly...

Joseph-Pace wrote on 6/26/2024, 12:55 AM

I did, just not really understanding what you mean, if show me video of it that'll help lol, does it work for you doing what I'm doing, can you test it to see if you get it to work using my video setup..?

Test it by cropping the video, and see if smart mask 2.0 works on a CROPPED video, go ahead try everything you can to have the smart mask 2.0 working on a cropped video, see if it works for you or not.

(You deleted your comment lmao)

RogerS wrote on 6/26/2024, 1:01 AM

I deleted it because I don't think it's productive to engage here and will let others do so. I would think that cropping would interfere with the smart mask process by changing the input it is expecting.

Joseph-Pace wrote on 6/26/2024, 1:07 AM

Anything helps to be honest, I just wanted to point out this problem that I really hope they improve this feature to be able to work on a cropped video somehow.. beautiful job on smart mask 2.0 but this needs to be added soo bad please lol

Gid wrote on 6/26/2024, 2:48 AM

@Joseph-Pace 

You add a 640x480 clip to a 640x480 projects timeline, add Smart mask & it works, yay 🤸‍♂️

You add that 640x480 clip to a 1080 x 1920 project, mess with the Pan/Crop settings, add Smart Mask, it doesn't work & you're surprised ?

This isn't Smart Mask broken, with respect it's you not understanding what the fx needs,

Any fx I have that masks or does a similar thing needs the media to be the same as the project, I have Mocha Pro £700+ Hollywood quality masking, if the media doesn't match the project the same type of problem occurs.

But you don't have to literally change the size or aspect of the clip -

Try making the Pan/Crop settings the same size as the project, ie 1080x1920 or right click 'Match Output Aspect' in Pan/Crop. Keep that 9:16 locked (no cropping)

Last changed by Gid on 6/26/2024, 2:51 AM, changed a total of 1 times.

Vegas Pro 18 - 22
Vegas Pro/Post 19
Boris Continuum & Sapphire, 
Silhouette Standalone + Plugin, 
Mocha Pro Standalone + Plugin, 
Boris Optics,
NewBlue TotalFX
Desktop PC Microsoft Windows 10 Pro - 64-Bit
ASUS PRO WS WRX80E-SAGE SE WIFI AMD Motherboard
AMD Ryzen Threadripper PRO 3975WX 3.5GHz 32 Core
Corsair iCUE H150i RGB PRO XT 360mm All-in-One Liquid CPU Cooler
RAM 256GB ( 8x Micron 32GB (1x 32GB) 2666MHz DDR4 RAM )
2x Western Digital Black SN850 2TB M.2-2280 SSD, 7000MB/s Read, 5100MB/s Write
(programs on one, project files on the other)
Graphics MSI GeForce RTX 3090 SUPRIM X 24GB OC GPU
ASUS ROG Thor 1200W Semi-Modular 80+ Platinum PSU 
Fractal Design Define 7 XL Dark TG Case with 3 Fans
Dell SE3223Q 31.5 Inch 4K UHD (3840x2160) Monitor, 60Hz, & an Acer 24" monitor.

At the moment my filming is done with a Samsung Galaxy S23 Ultra 5G & a GoPro Hero11 Black

I've been a Joiner/Carpenter for 40yrs, apprentice trained time served, I don't have an apprentice of my own so to share my knowledge I put videos on YouTube.

YouTube videos - https://www.youtube.com/c/Gidjoiner

 

RogerS wrote on 6/26/2024, 10:51 PM

@Joseph-Pace Here's an example of what I meant in my first post. Notice the order of the Fx chain with crop coming after AI Smart Mask. I can't really test this very well as my laptop is just too slow to render smart mask frames.

Track motion also works well to move the subject elsewhere in the frame.

Hopefully this gives you some ideas for how to manipulate footage masked in smart mask.

You could always render out the smart mask segment to ProRes with alpha and then bring it back into VEGAS.

Joseph-Pace wrote on 6/27/2024, 9:05 PM

@Joseph-Pace 

You add a 640x480 clip to a 640x480 projects timeline, add Smart mask & it works, yay 🤸‍♂️

You add that 640x480 clip to a 1080 x 1920 project, mess with the Pan/Crop settings, add Smart Mask, it doesn't work & you're surprised ?

This isn't Smart Mask broken, with respect it's you not understanding what the fx needs,

Any fx I have that masks or does a similar thing needs the media to be the same as the project, I have Mocha Pro £700+ Hollywood quality masking, if the media doesn't match the project the same type of problem occurs.

But you don't have to literally change the size or aspect of the clip -

Try making the Pan/Crop settings the same size as the project, ie 1080x1920 or right click 'Match Output Aspect' in Pan/Crop. Keep that 9:16 locked (no cropping)

Gee Sherlock, go try it before telling me to try making it /facepalm..

 

Make a video showing me how it's done please, it's really NOT that hard..

 

Seriously... sorry but that's a stupid reply that does NOT help anything, maybe try being more useful, nicer, and not state the obvious what I already know genius, I can see that...

 

Hopefully you know how to help, and show a video of how to make it work, again, it's really not that hard to help if you know how to, if you don't then don't share a video it's okay, you tried.. I appreciate you trying, thanks!

Joseph-Pace wrote on 6/27/2024, 9:19 PM

@Joseph-Pace Here's an example of what I meant in my first post. Notice the order of the Fx chain with crop coming after AI Smart Mask. I can't really test this very well as my laptop is just too slow to render smart mask frames.

Track motion also works well to move the subject elsewhere in the frame.

Hopefully this gives you some ideas for how to manipulate footage masked in smart mask.

You could always render out the smart mask segment to ProRes with alpha and then bring it back into VEGAS.

Sorry, honestly this is a bit confusing if not showing me video how it's done, there are really no tutorials and I've tried everything I could do, it always breaks as shown in video, I cannot even mess with pan/Crop at all because if I do, it won't even work after..

 

I need to pan/Crop the 2nd video with of course a different resolutions and have that video that's got pan/crop ON..

 

What I'm saying is, as shown in the video, it just does not work at all for making youtube shorts, to display gameplay with 2nd video that needs to be resized and put it at top of the video and somehow smart mask 2.0 will just NOT work right period if pan/crop have been touched..

 

This is vegas pro forum community, PLEASE, show me how it works, how to make it litterally work on what I'm trying to do, show me how should it be edited by recording, upload, SHARE it so if other people run into similar problems to this, they'll see this and appreciate

 

Right now there really are no tutorials, I've tried everything I've seen, nothing works, please check it out, see if you can make it work, if can, then record and show please!

RogerS wrote on 6/27/2024, 9:29 PM

Don't use pan/crop. Secondly replicate the Fx as I showed you.

I'm not going to record a video tutorial but have confidence if I can figure it out you can too!

Joseph-Pace wrote on 6/27/2024, 9:40 PM

Don't use pan/crop. Secondly replicate the Fx as I showed you.

I'm not going to record a video tutorial but have confidence if I can figure it out you can too!

Okay so it is broken, I'm sorry you don't know how to record a video that's okay, if you don't know how to help by recording a video showing how it's done then don't bother commenting lol..

 

I'm looking for someone that KNOWS how to help, and you already tried.. yay!! Thanks :)

 

Hopefully someone else actually knows how to make it work, and how to.. record a video to show how to... lmao, it's okay you tried!! Again, I appreciate it but leave room in this section for helpful comments that shows how please!! Thanks!!

 

P.S. there's a free recording app called.. snipping tool.. that's on windows, and there's a site called... youtube for uploading, you're welcome!

RogerS wrote on 6/27/2024, 10:11 PM

You don't get to choose what kind of help you receive on a public forum.

If you are unwilling to make any effort to understand the advice you are given or even to try the solutions presented I doubt you will find others willing to help you.

Three tools that should work: track motion (track level- like pan/crop). Use it with crop Fx (only crops) or alternatively use picture in picture Fx (can move and resize wherever you want). Place these Fx after AI Smart Mask so as not to interfere with its processing. Pan/crop placed before the Smart Mask Fx will change the data going into smart mask.

Good luck.

Gid wrote on 6/28/2024, 5:06 AM

@RogerS Thankyou, precisely 👍

@Joseph-Pace Your replies are rude & my comment isn't stupid, both me & RogerS gave you all the info needed as to why you're having problems & solutions, I did try it & I do know what I'm talking about, you'd understand what has been written if as you say 'and not state the obvious what I already know', but if you don't understand & you'd replied politely with questions I'd have taken the time to make a video for you, but not with that attitude.

Vegas Pro 18 - 22
Vegas Pro/Post 19
Boris Continuum & Sapphire, 
Silhouette Standalone + Plugin, 
Mocha Pro Standalone + Plugin, 
Boris Optics,
NewBlue TotalFX
Desktop PC Microsoft Windows 10 Pro - 64-Bit
ASUS PRO WS WRX80E-SAGE SE WIFI AMD Motherboard
AMD Ryzen Threadripper PRO 3975WX 3.5GHz 32 Core
Corsair iCUE H150i RGB PRO XT 360mm All-in-One Liquid CPU Cooler
RAM 256GB ( 8x Micron 32GB (1x 32GB) 2666MHz DDR4 RAM )
2x Western Digital Black SN850 2TB M.2-2280 SSD, 7000MB/s Read, 5100MB/s Write
(programs on one, project files on the other)
Graphics MSI GeForce RTX 3090 SUPRIM X 24GB OC GPU
ASUS ROG Thor 1200W Semi-Modular 80+ Platinum PSU 
Fractal Design Define 7 XL Dark TG Case with 3 Fans
Dell SE3223Q 31.5 Inch 4K UHD (3840x2160) Monitor, 60Hz, & an Acer 24" monitor.

At the moment my filming is done with a Samsung Galaxy S23 Ultra 5G & a GoPro Hero11 Black

I've been a Joiner/Carpenter for 40yrs, apprentice trained time served, I don't have an apprentice of my own so to share my knowledge I put videos on YouTube.

YouTube videos - https://www.youtube.com/c/Gidjoiner

 

Joseph-Pace wrote on 7/1/2024, 12:40 PM

@RogerS Thankyou, precisely 👍

@Joseph-Pace Your replies are rude & my comment isn't stupid, both me & RogerS gave you all the info needed as to why you're having problems & solutions, I did try it & I do know what I'm talking about, you'd understand what has been written if as you say 'and not state the obvious what I already know', but if you don't understand & you'd replied politely with questions I'd have taken the time to make a video for you, but not with that attitude.

You don't get to choose what kind of help you receive on a public forum.

If you are unwilling to make any effort to understand the advice you are given or even to try the solutions presented I doubt you will find others willing to help you.

Three tools that should work: track motion (track level- like pan/crop). Use it with crop Fx (only crops) or alternatively use picture in picture Fx (can move and resize wherever you want). Place these Fx after AI Smart Mask so as not to interfere with its processing. Pan/crop placed before the Smart Mask Fx will change the data going into smart mask.

Good luck.

 

Again, I'm sorry, can you please make a video, thanks!

 

Honestly, if it was me, I would of helped and make a video regardless of person's attitude.. Sorry for defending myself or not, again, it's up to you.. it just bums me out to see people stoop down to these excuses, so if you actually want to actually help and make a video or not, it's up to you, if not for me, then do it for the others who will search these problems finding this. I will edit the top post including your video tutorial helping saving others time.

Personally, I would help, because I love helping people for a living for free especially if it benefits us all, humanity, regardless of the person's attitude, because it's worth helping more than being the opposite that chooses NOT to over you know.. but again, that's me, I'm sorry if I'm blunt but this isn't really an excuse to NOT help..

Again, please, I'm NOT looking to waste MORE time arguing, I'm just looking for actual help and hope others will also get help too while looking at this. I don't see why it's a big deal to help show a video as it's already lacking video tutorials, instead of making it harder for others to figure these problems out, try helping with a video and I promise you, it will help not just me, but others as well by A LOT!

The choices are yours, not mine.. I can't force you to help me and others lol, and if you want to make more excuses on not wanting to help, that's totally up to you. Personally, I would of helped already understanding the other person's frustration and not get angry attacking the person that's asking for help.... again, I'm sorry, if you can help by taking maybe 5, 10 minutes tops to record, demonstrate how to make it work, and make everyone's lives a lot easier, that'd be great!

 

Also one more thing, it's not the reading that's the issue, it's people that handles the software visually and may not know which one of the buttons that you're referring TO! There could be 3 buttons that may do the same or slightly bit different than the others, that's why I said to make a video to SHOW which ones and how YOU got it working. Again, there really are no tutorials for this, so if you want to actually PLEASE help show it for the people that will come and look at this, and not waste their time reading through these arguments, again, that would be great!

I promise I will edit top post and include your video as solution, and no, I'm not mad or I don't hate you lol, I'm just bummed out on the results because I was expecting having help than.. if I could record, share showing the problem, I don't see why you can't too helping out not just me, but OTHERS too. I WILL edit top post including yours so others don't bother scrolling down reading these pointless arguments lol.. If I can do better, so can you! :)

 

P.S. I LOVE AI! I would LOVE to see more working versions, I understand this is only starting and this is getting better overtime no doubt! I included that video showing the problem in HOPES that it would be made better to handle pan/crop.

Mohammed_Anis wrote on 7/2/2024, 3:33 AM

Was gonna make a video till I read the immature tirade.

@RogerS is a seasoned VEGAS user and one of the longest contributors in the forum. A little patience would've gotten what you wanted.

Onto the next thread.

Last changed by Mohammed_Anis on 7/2/2024, 3:38 AM, changed a total of 1 times.

"I'm a part of all that I've met." Alfred Lord Tennyson

Youtube Channel: https://www.youtube.com/c/VEGASCREATIVEACADEMY


Card name: AMD Radeon RX 6800 XT
Processor: AMD Ryzen 9 5900X 12-Core Processor             (24 CPUs), ~3.7GHz
Memory: 32768MB RAM
Monitor Id: PHLC18F
Native Mode: 3840 x 2160(p) (59.997Hz)
Storage Devices: 2 SSDS, One large HD. VEGAS is installed on SSD

 

Joseph-Pace wrote on 7/5/2024, 3:52 PM

Was gonna make a video till I read the immature tirade.

@RogerS is a seasoned VEGAS user and one of the longest contributors in the forum. A little patience would've gotten what you wanted.

Onto the next thread.

Again..? Grow up..... if you wanna have that attitude.. and not be open minded, understanding, helping.. that's YOUR choice..

 

I already apologized, explained, wanting to move on, and help but.. yeah nothing I can do right now.. I'm sorry to others that looked this up and wasted their time...