Auto Reframe Vegas Pro 22

Ruby888 wrote on 8/25/2024, 6:57 AM

Hi everyone., I am using Vegas Pro 22 on a Windows 11 machine. I am trying to learn the new AI Auto Reframe. I can't seem to find much info on this, how to make 16:9 to 9:16. I can get it to works sometimes and others nothing. Any ideas?

Comments

Dexcon wrote on 8/25/2024, 7:36 AM

My understanding is that Auto Reframe adapts the video media on the timeline to the aspect ratio set in Project Properties. Are the Project Properties in your project set to 9:16 (H 3840 x W 2160 for 4K or half those dimensions for HD)?

As a test, setting a Portrait (9:16) project via the Welcome screen created a 9:16 project. 16:9 video on the timeline was able to be reframed to 9:16 vertical using Auto Reframe. 'Frame centre' in the FX window allows you to adjust reframing positioning.

Cameras: Sony FDR-AX100E; GoPro Hero 11 Black Creator Edition

Installed: Vegas Pro 15, 16, 17, 18, 19, 20, 21 & 22, HitFilm Pro 2021.3, DaVinci Resolve Studio 19.0.3, BCC 2025, Mocha Pro 2024.5, NBFX TotalFX 7, Neat NR, DVD Architect 6.0, MAGIX Travel Maps, Sound Forge Pro 16, SpectraLayers Pro 11, iZotope RX10 Advanced and many other iZ plugins, Vegasaur 4.0

Windows 11

Dell Alienware Aurora 11:

10th Gen Intel i9 10900KF - 10 cores (20 threads) - 3.7 to 5.3 GHz

NVIDIA GeForce RTX 2080 SUPER 8GB GDDR6 - liquid cooled

64GB RAM - Dual Channel HyperX FURY DDR4 XMP at 3200MHz

C drive: 2TB Samsung 990 PCIe 4.0 NVMe M.2 PCIe SSD

D: drive: 4TB Samsung 870 SATA SSD (used for media for editing current projects)

E: drive: 2TB Samsung 870 SATA SSD

F: drive: 6TB WD 7200 rpm Black HDD 3.5"

Dell Ultrasharp 32" 4K Color Calibrated Monitor

 

LAPTOP:

Dell Inspiron 5310 EVO 13.3"

i5-11320H CPU

C Drive: 1TB Corsair Gen4 NVMe M.2 2230 SSD (upgraded from the original 500 GB SSD)

Monitor is 2560 x 1600 @ 60 Hz

Ruby888 wrote on 8/25/2024, 8:16 AM

My understanding is that Auto Reframe adapts the video media on the timeline to the aspect ratio set in Project Properties. Are the Project Properties in your project set to 9:16 (H 3840 x W 2160 for 4K or half those dimensions for HD)?

As a test, setting a Portrait (9:16) project via the Welcome screen created a 9:16 project. 16:9 video on the timeline was able to be reframed to 9:16 vertical using Auto Reframe. 'Frame centre' in the FX window allows you to adjust reframing positioning.

I was using it to convert 16:9 wide screen to 9:16 vertical video, like for TIK TOK and Instagram, that how i interoperate how it works and what its meant for,

Dexcon wrote on 8/25/2024, 8:23 AM

I was using it to convert 16:9 wide screen to 9:16 vertical video, like for TIK TOK and Instagram, that how i interoperate how it works and what its meant for,

That's fine ...but are your project properties set to 9:16 (so not 16:9) as I highlighted in my comment? I repeat, Auto Reframe adjusts framing to the aspect ratio set in project properties, it is not a generalised FX to reframe all video media to an aspect ratio of your choice that is different to that set in project properties - use pan/crop or track motion to do that.

Cameras: Sony FDR-AX100E; GoPro Hero 11 Black Creator Edition

Installed: Vegas Pro 15, 16, 17, 18, 19, 20, 21 & 22, HitFilm Pro 2021.3, DaVinci Resolve Studio 19.0.3, BCC 2025, Mocha Pro 2024.5, NBFX TotalFX 7, Neat NR, DVD Architect 6.0, MAGIX Travel Maps, Sound Forge Pro 16, SpectraLayers Pro 11, iZotope RX10 Advanced and many other iZ plugins, Vegasaur 4.0

Windows 11

Dell Alienware Aurora 11:

10th Gen Intel i9 10900KF - 10 cores (20 threads) - 3.7 to 5.3 GHz

NVIDIA GeForce RTX 2080 SUPER 8GB GDDR6 - liquid cooled

64GB RAM - Dual Channel HyperX FURY DDR4 XMP at 3200MHz

C drive: 2TB Samsung 990 PCIe 4.0 NVMe M.2 PCIe SSD

D: drive: 4TB Samsung 870 SATA SSD (used for media for editing current projects)

E: drive: 2TB Samsung 870 SATA SSD

F: drive: 6TB WD 7200 rpm Black HDD 3.5"

Dell Ultrasharp 32" 4K Color Calibrated Monitor

 

LAPTOP:

Dell Inspiron 5310 EVO 13.3"

i5-11320H CPU

C Drive: 1TB Corsair Gen4 NVMe M.2 2230 SSD (upgraded from the original 500 GB SSD)

Monitor is 2560 x 1600 @ 60 Hz

Ruby888 wrote on 8/25/2024, 8:32 AM

I was using it to convert 16:9 wide screen to 9:16 vertical video, like for TIK TOK and Instagram, that how i interoperate how it works and what its meant for,

That's fine ...but are your project properties set to 9:16 (so not 16:9) as I highlighted in my comment? I repeat, Auto Reframe adjusts framing to the aspect ratio set in project properties, it is not a generalised FX to reframe all video media to an aspect ratio of your choice that is different to that set in project properties - use pan/crop or track motion to do that.

Where are more info on the new AI features? I can't seem to find them.

RogerS wrote on 8/25/2024, 8:33 AM

There's a link to a document about the new features here: https://www.vegascreativesoftware.info/us/forum/vegas-pro-22-now-available--146668/

Ruby888 wrote on 8/25/2024, 8:53 AM

Here is what I am doing with the effect

Dexcon wrote on 8/25/2024, 8:55 AM

It would be most helpful if the OP would advise if the project properties are set at 9:16 and not 16:9.

Cameras: Sony FDR-AX100E; GoPro Hero 11 Black Creator Edition

Installed: Vegas Pro 15, 16, 17, 18, 19, 20, 21 & 22, HitFilm Pro 2021.3, DaVinci Resolve Studio 19.0.3, BCC 2025, Mocha Pro 2024.5, NBFX TotalFX 7, Neat NR, DVD Architect 6.0, MAGIX Travel Maps, Sound Forge Pro 16, SpectraLayers Pro 11, iZotope RX10 Advanced and many other iZ plugins, Vegasaur 4.0

Windows 11

Dell Alienware Aurora 11:

10th Gen Intel i9 10900KF - 10 cores (20 threads) - 3.7 to 5.3 GHz

NVIDIA GeForce RTX 2080 SUPER 8GB GDDR6 - liquid cooled

64GB RAM - Dual Channel HyperX FURY DDR4 XMP at 3200MHz

C drive: 2TB Samsung 990 PCIe 4.0 NVMe M.2 PCIe SSD

D: drive: 4TB Samsung 870 SATA SSD (used for media for editing current projects)

E: drive: 2TB Samsung 870 SATA SSD

F: drive: 6TB WD 7200 rpm Black HDD 3.5"

Dell Ultrasharp 32" 4K Color Calibrated Monitor

 

LAPTOP:

Dell Inspiron 5310 EVO 13.3"

i5-11320H CPU

C Drive: 1TB Corsair Gen4 NVMe M.2 2230 SSD (upgraded from the original 500 GB SSD)

Monitor is 2560 x 1600 @ 60 Hz

Gid wrote on 8/25/2024, 3:54 PM

it is not a generalised FX to reframe all video media to an aspect ratio of your choice that is different to that set in project properties -

@Dexcon I don't know if that's right? Why would it give you 'Show Preview For' as an option & If you apply the fx to a 16:9 project you get the option to move the on-screen 9:16 preview box with a hand tool or a slider if you double click a keyframe. (You don't get the hand tool if it's applied to a 9:16 project)

(This is just to show the controls not how well it tracks/follows the subject)

,

'We' tried it on a couple of videos inc one of a widescreen 007 Bond clip. it worked quite well.

https://www.vegascreativesoftware.info/us/forum/ai-auto-reframe-giving-inaccurate-tracking-in-my-footage--146771/#ca922017

Last changed by Gid on 8/25/2024, 4:00 PM, changed a total of 2 times.

Vegas Pro 21
Vegas Pro/Post 19
Boris Continuum & Sapphire, 
Silhouette Standalone + Plugin, 
Mocha Pro Standalone + Plugin, 
Boris Optics,
NewBlue TotalFX
Desktop PC Microsoft Windows 10 Pro - 64-Bit
ASUS PRO WS WRX80E-SAGE SE WIFI AMD Motherboard
AMD Ryzen Threadripper PRO 3975WX 3.5GHz 32 Core
Corsair iCUE H150i RGB PRO XT 360mm All-in-One Liquid CPU Cooler
RAM 256GB ( 8x Micron 32GB (1x 32GB) 2666MHz DDR4 RAM )
2x Western Digital Black SN850 2TB M.2-2280 SSD, 7000MB/s Read, 5100MB/s Write
(programs on one, project files on the other)
Graphics MSI GeForce RTX 3090 SUPRIM X 24GB OC GPU
ASUS ROG Thor 1200W Semi-Modular 80+ Platinum PSU 
Fractal Design Define 7 XL Dark TG Case with 3 Fans
Dell SE3223Q 31.5 Inch 4K UHD (3840x2160) Monitor, 60Hz, & an Acer 24" monitor.

At the moment my filming is done with a Samsung Galaxy S23 Ultra 5G & a GoPro11

I've been a Joiner/Carpenter for 40yrs, apprentice trained time served, I don't have an apprentice of my own so to share my knowledge I put videos on YouTube.

YouTube videos - https://www.youtube.com/c/Gidjoiner

Lots of work photos on Facebook - https://www.facebook.com/gid.joiner/photos_albums

Dexcon wrote on 8/25/2024, 7:19 PM

@Gid  ... what you have shown in the video is correct - but it's only a preview until you hit the 'Project Aspect Ratio' button which applies what has been set in the preview phase; BUT hitting the 'Project Aspect Ratio' button changes the project's aspect ratio properties to whatever AR has been set in the preview phase.

In a 16:9 project such as you've demonstrated in the video, hitting the 'Project Aspect Ratio' button will have changed the project's properties from 16:9 to 9:16 thus making the entire project 9:16 vertical. In any event, this is the behaviour that I've seen each time while testing the Auto Reframe FX.

Also, the Auto Reframe description in the user manual shows the intended use of the FX:

  • This AI-assisted tool automatically reframes your video when the delivery size of your final render does not match the original aspect ratio. For instance, if you have a standard widescreen video and need to deliver it in a square format for Instagram or other channels, this tool shifts focus to the most important object in the video and keeps it centered in the new frame size while other material is cropped out.

Cameras: Sony FDR-AX100E; GoPro Hero 11 Black Creator Edition

Installed: Vegas Pro 15, 16, 17, 18, 19, 20, 21 & 22, HitFilm Pro 2021.3, DaVinci Resolve Studio 19.0.3, BCC 2025, Mocha Pro 2024.5, NBFX TotalFX 7, Neat NR, DVD Architect 6.0, MAGIX Travel Maps, Sound Forge Pro 16, SpectraLayers Pro 11, iZotope RX10 Advanced and many other iZ plugins, Vegasaur 4.0

Windows 11

Dell Alienware Aurora 11:

10th Gen Intel i9 10900KF - 10 cores (20 threads) - 3.7 to 5.3 GHz

NVIDIA GeForce RTX 2080 SUPER 8GB GDDR6 - liquid cooled

64GB RAM - Dual Channel HyperX FURY DDR4 XMP at 3200MHz

C drive: 2TB Samsung 990 PCIe 4.0 NVMe M.2 PCIe SSD

D: drive: 4TB Samsung 870 SATA SSD (used for media for editing current projects)

E: drive: 2TB Samsung 870 SATA SSD

F: drive: 6TB WD 7200 rpm Black HDD 3.5"

Dell Ultrasharp 32" 4K Color Calibrated Monitor

 

LAPTOP:

Dell Inspiron 5310 EVO 13.3"

i5-11320H CPU

C Drive: 1TB Corsair Gen4 NVMe M.2 2230 SSD (upgraded from the original 500 GB SSD)

Monitor is 2560 x 1600 @ 60 Hz

Gid wrote on 8/25/2024, 7:40 PM

@Dexcon Yep I read the quote that is in @RogerS link but it's a bit vague about 'delivery size', I know that is what you want to render out at but does the project need to be set at that first...

The rest of what you have written is a bit of a circular statement, 'It's only a preview until you hit Project Aspect Ratio which changes project's aspect ratio ... ' , Yes hitting Project Aspect Ratio does change the project settings so no the project doesn't need to be set to 9:16 first, & the main questions are why have a preview option if you should set to 9:16 first & why can the on-screen preview box be moved with the hand tool but that option isn't available if you set the project to 9:16 first 🤷‍♂️,..

In that link I shared @UltraVista showed 3 different reframers, I'm guessing they have a clue about using this fx but didn't mention anything about setting the properties first

I wish Vegas would give at least some sort of direction because it seems like we're all guessing.

Vegas Pro 21
Vegas Pro/Post 19
Boris Continuum & Sapphire, 
Silhouette Standalone + Plugin, 
Mocha Pro Standalone + Plugin, 
Boris Optics,
NewBlue TotalFX
Desktop PC Microsoft Windows 10 Pro - 64-Bit
ASUS PRO WS WRX80E-SAGE SE WIFI AMD Motherboard
AMD Ryzen Threadripper PRO 3975WX 3.5GHz 32 Core
Corsair iCUE H150i RGB PRO XT 360mm All-in-One Liquid CPU Cooler
RAM 256GB ( 8x Micron 32GB (1x 32GB) 2666MHz DDR4 RAM )
2x Western Digital Black SN850 2TB M.2-2280 SSD, 7000MB/s Read, 5100MB/s Write
(programs on one, project files on the other)
Graphics MSI GeForce RTX 3090 SUPRIM X 24GB OC GPU
ASUS ROG Thor 1200W Semi-Modular 80+ Platinum PSU 
Fractal Design Define 7 XL Dark TG Case with 3 Fans
Dell SE3223Q 31.5 Inch 4K UHD (3840x2160) Monitor, 60Hz, & an Acer 24" monitor.

At the moment my filming is done with a Samsung Galaxy S23 Ultra 5G & a GoPro11

I've been a Joiner/Carpenter for 40yrs, apprentice trained time served, I don't have an apprentice of my own so to share my knowledge I put videos on YouTube.

YouTube videos - https://www.youtube.com/c/Gidjoiner

Lots of work photos on Facebook - https://www.facebook.com/gid.joiner/photos_albums

Gid wrote on 8/29/2024, 7:09 PM

@Dexcon @Ruby888 This Vegas Reel doesn't show much but it does show he's applying Reframe to a landscape clip & adjusting the on-screen box as I showed.

https://www.facebook.com/reel/522849830245131

Last changed by Gid on 8/29/2024, 7:10 PM, changed a total of 1 times.

Vegas Pro 21
Vegas Pro/Post 19
Boris Continuum & Sapphire, 
Silhouette Standalone + Plugin, 
Mocha Pro Standalone + Plugin, 
Boris Optics,
NewBlue TotalFX
Desktop PC Microsoft Windows 10 Pro - 64-Bit
ASUS PRO WS WRX80E-SAGE SE WIFI AMD Motherboard
AMD Ryzen Threadripper PRO 3975WX 3.5GHz 32 Core
Corsair iCUE H150i RGB PRO XT 360mm All-in-One Liquid CPU Cooler
RAM 256GB ( 8x Micron 32GB (1x 32GB) 2666MHz DDR4 RAM )
2x Western Digital Black SN850 2TB M.2-2280 SSD, 7000MB/s Read, 5100MB/s Write
(programs on one, project files on the other)
Graphics MSI GeForce RTX 3090 SUPRIM X 24GB OC GPU
ASUS ROG Thor 1200W Semi-Modular 80+ Platinum PSU 
Fractal Design Define 7 XL Dark TG Case with 3 Fans
Dell SE3223Q 31.5 Inch 4K UHD (3840x2160) Monitor, 60Hz, & an Acer 24" monitor.

At the moment my filming is done with a Samsung Galaxy S23 Ultra 5G & a GoPro11

I've been a Joiner/Carpenter for 40yrs, apprentice trained time served, I don't have an apprentice of my own so to share my knowledge I put videos on YouTube.

YouTube videos - https://www.youtube.com/c/Gidjoiner

Lots of work photos on Facebook - https://www.facebook.com/gid.joiner/photos_albums

MikeLV wrote on 10/27/2024, 6:58 PM

I am testing this feature with a tutorial I Found here:

But what I'm noticing is that at 35 secs into the video, after reframing it, it jumps all over the place about every second, and it's not due to the keyframes. Is anyone else experiencing this? See video: