Improve the Stabilization.

alifftudm95 wrote on 5/31/2019, 11:30 AM

VEGAS Pro 16 is one big step from the previous version where it has fully redesign and new Video Stabilization OFX that includes warp stabilization.

But what really annoy me is that VEGAS Pro 16 Warp Stabilization can only tackle and fix small shaky footage.

I had to use Pr just to use the Warp Stabilization to fix the Jitter/Shake from my gimbal running shot.

Here I have my stabilization settings. Footage was shot on Sony a6500 at 30FPS. All video was stabilised & exported in 30FPS timeline.

I wish VEGAS Pro have pin point stabilisation/Tripod Tracking stabilisation too just like in FCPX

Last changed by alifftudm95

Editor and Colorist (Kinda) from Malaysia

MYPOST Member

Laptop

MacBook Pro M4 Max

16 Core CPU and 40 Core GPU

64GB Memory

2TB Internal SSD Storage

Anti-Glare 4K HDR Screen

 

PC DEKSTOP

CPU: Ryzen 9 5900x

GPU: RTX3090 24GB

RAM: 64GB 3200MHZ

MOBO: X570-E

Storage:

C DRIVE NVME M.2 1TB SSD GEN 4

D DRIVE NVME M.2 2TB SSD GEN 4

E DRIVE SATA SSD 2TB

F DRIVE SATA SSD 2TB

G DRIVE HDD 1TB

Monitor: Asus ProArt PA279CV 4K HDR (Bought on 30 August 2023)

Monitor: BenQ PD2700U 4K HDR (RIP on 30 August 2023)

 

 

 

Comments

Kinvermark wrote on 5/31/2019, 12:12 PM

Hi @alifftudm95

If you post a downloadable copy of the original footage, I will run some tests with Vegas' (and some other) stabilizers to see what can be done. I agree, the results in your video above are not satisfactory.

alifftudm95 wrote on 5/31/2019, 12:32 PM

Hi @alifftudm95

If you post a downloadable copy of the original footage, I will run some tests with Vegas' (and some other) stabilizers to see what can be done. I agree, the results in your video above are not satisfactory.

You can download the original footage here:

https://drive.google.com/open?id=17NTL_qXtQjbyh-8b5K-Fr07PxZ0-E238

4K 29.97FPS Video Clip.

Editor and Colorist (Kinda) from Malaysia

MYPOST Member

Laptop

MacBook Pro M4 Max

16 Core CPU and 40 Core GPU

64GB Memory

2TB Internal SSD Storage

Anti-Glare 4K HDR Screen

 

PC DEKSTOP

CPU: Ryzen 9 5900x

GPU: RTX3090 24GB

RAM: 64GB 3200MHZ

MOBO: X570-E

Storage:

C DRIVE NVME M.2 1TB SSD GEN 4

D DRIVE NVME M.2 2TB SSD GEN 4

E DRIVE SATA SSD 2TB

F DRIVE SATA SSD 2TB

G DRIVE HDD 1TB

Monitor: Asus ProArt PA279CV 4K HDR (Bought on 30 August 2023)

Monitor: BenQ PD2700U 4K HDR (RIP on 30 August 2023)

 

 

 

Marco. wrote on 6/1/2019, 6:57 AM

If you have a CMOS fixer plug-in available – applying a CMOS fixing before using stabilization can help. Also cut-off start and end of your clip and make a subclip before using stabilization.

alifftudm95 wrote on 6/1/2019, 10:44 AM

If you have a CMOS fixer plug-in available – applying a CMOS fixing before using stabilization can help. Also cut-off start and end of your clip and make a subclip before using stabilization.

Means I need to have another plug in to fix the problem. plus even with CMOS plugin, it does fix the shake but in the same time it add that weird bump in the middle.

Editor and Colorist (Kinda) from Malaysia

MYPOST Member

Laptop

MacBook Pro M4 Max

16 Core CPU and 40 Core GPU

64GB Memory

2TB Internal SSD Storage

Anti-Glare 4K HDR Screen

 

PC DEKSTOP

CPU: Ryzen 9 5900x

GPU: RTX3090 24GB

RAM: 64GB 3200MHZ

MOBO: X570-E

Storage:

C DRIVE NVME M.2 1TB SSD GEN 4

D DRIVE NVME M.2 2TB SSD GEN 4

E DRIVE SATA SSD 2TB

F DRIVE SATA SSD 2TB

G DRIVE HDD 1TB

Monitor: Asus ProArt PA279CV 4K HDR (Bought on 30 August 2023)

Monitor: BenQ PD2700U 4K HDR (RIP on 30 August 2023)

 

 

 

Kinvermark wrote on 6/1/2019, 10:51 AM

@alifftudm95

Sorry, for the delay... very very busy.

In short: so far no luck getting good result with Vegas' stabilizer. Don't think it likes short/sharp shocks. Better with larger sweeping motions.

Mercalli plug-in does a great job of this; as good or better than PP warp. Resolve looks OK too. Will keep trying in spare time.

3POINT wrote on 6/1/2019, 10:56 AM

Same result at my place, Mercalli 4 SAL and plug-in gives as good result as PP. Vegas stabs result is even worse than original.

wwaag wrote on 6/1/2019, 11:19 AM

Here's a comparison of three alternate stabilizers, the venerable Deshaker, Mercalli 2 and Mercalli 4. Of the three Mercalli 4 appears best to me. Interestingly enough, Deshaker appears most similar to the Premiere Pro stabilization. You will note the large zoom in at the end of the clip.

AKA the HappyOtter at https://tools4vegas.com/. System 1: Intel i7-8700k with HD 630 graphics plus an Nvidia RTX4070 graphics card. System 2: Intel i7-3770k with HD 4000 graphics plus an AMD RX550 graphics card. System 3: Laptop. Dell Inspiron Plus 16. Intel i7-11800H, Intel Graphics. Current cameras include Panasonic FZ2500, GoPro Hero11 and Hero8 Black plus a myriad of smartPhone, pocket cameras, video cameras and film cameras going back to the original Nikon S.

alifftudm95 wrote on 6/1/2019, 11:24 AM

Here's a comparison of three alternate stabilizers, the venerable Deshaker, Mercalli 2 and Mercalli 4. Of the three Mercalli 4 appears best to me. Interestingly enough, Deshaker appears most similar to the Premiere Pro stabilization. You will note the large zoom in at the end of the clip.

I did use Free Trial mercalli 4 plugins, but the results sometimes is not that good. So I still thinking in buying one the plugins. Anyway is the Deshaker is a 3rd party plugins for VEGAS Pro? how much does it cost?

Editor and Colorist (Kinda) from Malaysia

MYPOST Member

Laptop

MacBook Pro M4 Max

16 Core CPU and 40 Core GPU

64GB Memory

2TB Internal SSD Storage

Anti-Glare 4K HDR Screen

 

PC DEKSTOP

CPU: Ryzen 9 5900x

GPU: RTX3090 24GB

RAM: 64GB 3200MHZ

MOBO: X570-E

Storage:

C DRIVE NVME M.2 1TB SSD GEN 4

D DRIVE NVME M.2 2TB SSD GEN 4

E DRIVE SATA SSD 2TB

F DRIVE SATA SSD 2TB

G DRIVE HDD 1TB

Monitor: Asus ProArt PA279CV 4K HDR (Bought on 30 August 2023)

Monitor: BenQ PD2700U 4K HDR (RIP on 30 August 2023)

 

 

 

wwaag wrote on 6/1/2019, 11:53 AM

Deshaker https://www.guthspot.se/video/deshaker.htm is a VirtualDub plugin and as such is considered freeware. You can download both and do such stabilization in a standalone mode at no cost.

Deshaker is also included in the HappyOtterScripts toolset https://tools4vegas.com/ and as such is integrated with Vegas. Be warned that there is a bit of a learning curve for using Deshaker as a standalone and as part of HOS. Deshaker is also a lot slower than either Mercalli 2 or Mercalli 4, but it does work reasonably well and there are advanced options not available in other stabilizers.

Here is a screengrab of the Deshaker dialog in HOS, that is similar to the dialog found when using VirtualDub.

 

AKA the HappyOtter at https://tools4vegas.com/. System 1: Intel i7-8700k with HD 630 graphics plus an Nvidia RTX4070 graphics card. System 2: Intel i7-3770k with HD 4000 graphics plus an AMD RX550 graphics card. System 3: Laptop. Dell Inspiron Plus 16. Intel i7-11800H, Intel Graphics. Current cameras include Panasonic FZ2500, GoPro Hero11 and Hero8 Black plus a myriad of smartPhone, pocket cameras, video cameras and film cameras going back to the original Nikon S.

3POINT wrote on 6/1/2019, 1:55 PM

After several years of stabilizing in Vegas with the different available stabilizers for Vegas, for me Mercalli 4 plugin is still the best. Just for stabilizing interlaced footage, I use the SAL version of Mercalli 4.

I liked years ago deshaker, also with good results, but when using deshaker you also need lots of time.

I would also like the new Vegas stabilizer, because the analyse and the final render is very fast, but the results are too unpredictable. Hopefully this will change in future updates.

AVsupport wrote on 6/2/2019, 1:59 AM

^ +1 VP stabilize doesn't like complex gimbal / warp moves on a w/angle

my current Win10/64 system (latest drivers, water cooled) :

Intel Coffee Lake i5 Hexacore (unlocked, but not overclocked) 4.0 GHz on Z370 chipset board,

32GB (4x8GB Corsair Dual Channel DDR4-2133) XMP-3000 RAM,

Intel 600series 512GB M.2 SSD system drive running Win10/64 home automatic driver updates,

Crucial BX500 1TB EDIT 3D NAND SATA 2.5-inch SSD

2x 4TB 7200RPM NAS HGST data drive,

Intel HD630 iGPU - currently disabled in Bios,

nVidia GTX1060 6GB, always on latest [creator] drivers. nVidia HW acceleration enabled.

main screen 4K/50p 1ms scaled @175%, second screen 1920x1080/50p 1ms.

TheRhino wrote on 6/6/2019, 10:23 AM

For a number of years I opened 5 instances of Deshaker & had them all working on different source videos using some tried & true templates. However, I now use Mercalli 4 stand-alone & have 2 instances per workstation batch-processing source video. Running 2 with 9900K at 100% my Mercalli settings take 2X-3X the length of the video, so together about 1.5X the length of video needing processed. On a 2nd track I drop the source footage so if Mercalli didn't handle it in batch, I can manually reapply Mercalli 4 in Vegas with more aggressive settings. The 4.0 Xeons are much slower but they can run when I am editing on the 9900K...

It would have been nice for Vegas to bundle Mercalli 4 plugins & stand-alone with Vegas 16, but they didn't, so I didn't buy 16 & am waiting to see what 17 does with GPU enhanced renders, etc... I would have been willing to pay more for a Mercalli-specific bundle - as long as it saved me some over buying it separate...

Workstation C with $600 USD of upgrades in April, 2021
--$360 11700K @ 5.0ghz
--$200 ASRock W480 Creator (onboard 10G net, TB3, etc.)
Borrowed from my 9900K until prices drop:
--32GB of G.Skill DDR4 3200 ($100 on Black Friday...)
Reused from same Tower Case that housed the Xeon:
--Used VEGA 56 GPU ($200 on eBay before mining craze...)
--Noctua Cooler, 750W PSU, OS SSD, LSI RAID Controller, SATAs, etc.

Performs VERY close to my overclocked 9900K (below), but at stock settings with no tweaking...

Workstation D with $1,350 USD of upgrades in April, 2019
--$500 9900K @ 5.0ghz
--$140 Corsair H150i liquid cooling with 360mm radiator (3 fans)
--$200 open box Asus Z390 WS (PLX chip manages 4/5 PCIe slots)
--$160 32GB of G.Skill DDR4 3000 (added another 32GB later...)
--$350 refurbished, but like-new Radeon Vega 64 LQ (liquid cooled)

Renders Vegas11 "Red Car Test" (AMD VCE) in 13s when clocked at 4.9 ghz
(note: BOTH onboard Intel & Vega64 show utilization during QSV & VCE renders...)

Source Video1 = 4TB RAID0--(2) 2TB M.2 on motherboard in RAID0
Source Video2 = 4TB RAID0--(2) 2TB M.2 (1) via U.2 adapter & (1) on separate PCIe card
Target Video1 = 32TB RAID0--(4) 8TB SATA hot-swap drives on PCIe RAID card with backups elsewhere

10G Network using used $30 Mellanox2 Adapters & Qnap QSW-M408-2C 10G Switch
Copy of Work Files, Source & Output Video, OS Images on QNAP 653b NAS with (6) 14TB WD RED
Blackmagic Decklink PCie card for capturing from tape, etc.
(2) internal BR Burners connected via USB 3.0 to SATA adapters
Old Cooler Master CM Stacker ATX case with (13) 5.25" front drive-bays holds & cools everything.

Workstations A & B are the 2 remaining 6-core 4.0ghz Xeon 5660 or I7 980x on Asus P6T6 motherboards.

$999 Walmart Evoo 17 Laptop with I7-9750H 6-core CPU, RTX 2060, (2) M.2 bays & (1) SSD bay...

D7K wrote on 6/6/2019, 11:00 AM

I got Mercalli 4 and after expirinmenting with it for several years feel if it can't fix your footage to usable, you should reshoot:)

wwaag wrote on 6/6/2019, 11:24 AM

While I agree that Mercalli 4 is about as good as it gets, there are situations where it simply doesn't work. E.g. I like to do road trip documentaries. If a very large object comes into view such as a large truck or a tree on the side of the road, Mercalli always drifts toward that object making the stabilized video pretty unrealistic at best. In such situations, I've fallen back to using Deshaker in which one can select which part of the visual field is to be used for computing the stabilization parameters. You can also create a mask on the track above so that only a portion of the video is used (I haven't tried this trick with Mercalli, but I doubt it would work since it uses only the clip itself for its first pass). In any case, having both in your toolbox is better than just one.

AKA the HappyOtter at https://tools4vegas.com/. System 1: Intel i7-8700k with HD 630 graphics plus an Nvidia RTX4070 graphics card. System 2: Intel i7-3770k with HD 4000 graphics plus an AMD RX550 graphics card. System 3: Laptop. Dell Inspiron Plus 16. Intel i7-11800H, Intel Graphics. Current cameras include Panasonic FZ2500, GoPro Hero11 and Hero8 Black plus a myriad of smartPhone, pocket cameras, video cameras and film cameras going back to the original Nikon S.

3POINT wrote on 6/6/2019, 12:42 PM

@.wwaag

You are aware that Mercalli has different presets for different scenarios?

wwaag wrote on 6/6/2019, 1:48 PM

@3POINT

Of course. I've been a user of Mercalli since V1 and have purchased and used all versions except V3. Although slow, their CMOS fixer is terrific when needed IMHO. While Mercalli 4 is the best all around in my view, at $400 for a complete package, it's a bit pricey for some users and there are still some things it doesn't do well.

AKA the HappyOtter at https://tools4vegas.com/. System 1: Intel i7-8700k with HD 630 graphics plus an Nvidia RTX4070 graphics card. System 2: Intel i7-3770k with HD 4000 graphics plus an AMD RX550 graphics card. System 3: Laptop. Dell Inspiron Plus 16. Intel i7-11800H, Intel Graphics. Current cameras include Panasonic FZ2500, GoPro Hero11 and Hero8 Black plus a myriad of smartPhone, pocket cameras, video cameras and film cameras going back to the original Nikon S.

3POINT wrote on 6/6/2019, 2:56 PM

OK, that shows that you're experienced user. At the moment, I'm redoing some older HDV projects with Mercalli 4 SAL because the results are each time astonishing. Nevertheless there are scenes where I had better results with Newdeshaker at the time that I edited those projects the first time. I think there's no Stabilizer which can handle all scenarios.

Indeed, in combination with CMOSfixer the results of Mercalli are even incredible.

I really hope that also the Vegas stabilizer will become as good as Mercalli.

TheRhino wrote on 6/6/2019, 4:09 PM

I skipped upgrading to Vegas 16 with built-in Mercalli 2 (?) to pay for Mercalli 4 & CMOSfixer stand-alone plus the included Vegas plugins. The cost was $290 US after a 20% OFF coupon & tax... If I shoot it myself, it is relatively stable but I often get footage clients shot themselves. I apply my Mercalli presets as a part of the up-front quote. If they want more tweaks, they pay by the hour. Usually Mercalli is enough & the customer is happy the final is much better than the original. Yes, for shots that involve a lot of panning I sometimes still have to go back to some Deshaker templates I created for that very reason.

Workstation C with $600 USD of upgrades in April, 2021
--$360 11700K @ 5.0ghz
--$200 ASRock W480 Creator (onboard 10G net, TB3, etc.)
Borrowed from my 9900K until prices drop:
--32GB of G.Skill DDR4 3200 ($100 on Black Friday...)
Reused from same Tower Case that housed the Xeon:
--Used VEGA 56 GPU ($200 on eBay before mining craze...)
--Noctua Cooler, 750W PSU, OS SSD, LSI RAID Controller, SATAs, etc.

Performs VERY close to my overclocked 9900K (below), but at stock settings with no tweaking...

Workstation D with $1,350 USD of upgrades in April, 2019
--$500 9900K @ 5.0ghz
--$140 Corsair H150i liquid cooling with 360mm radiator (3 fans)
--$200 open box Asus Z390 WS (PLX chip manages 4/5 PCIe slots)
--$160 32GB of G.Skill DDR4 3000 (added another 32GB later...)
--$350 refurbished, but like-new Radeon Vega 64 LQ (liquid cooled)

Renders Vegas11 "Red Car Test" (AMD VCE) in 13s when clocked at 4.9 ghz
(note: BOTH onboard Intel & Vega64 show utilization during QSV & VCE renders...)

Source Video1 = 4TB RAID0--(2) 2TB M.2 on motherboard in RAID0
Source Video2 = 4TB RAID0--(2) 2TB M.2 (1) via U.2 adapter & (1) on separate PCIe card
Target Video1 = 32TB RAID0--(4) 8TB SATA hot-swap drives on PCIe RAID card with backups elsewhere

10G Network using used $30 Mellanox2 Adapters & Qnap QSW-M408-2C 10G Switch
Copy of Work Files, Source & Output Video, OS Images on QNAP 653b NAS with (6) 14TB WD RED
Blackmagic Decklink PCie card for capturing from tape, etc.
(2) internal BR Burners connected via USB 3.0 to SATA adapters
Old Cooler Master CM Stacker ATX case with (13) 5.25" front drive-bays holds & cools everything.

Workstations A & B are the 2 remaining 6-core 4.0ghz Xeon 5660 or I7 980x on Asus P6T6 motherboards.

$999 Walmart Evoo 17 Laptop with I7-9750H 6-core CPU, RTX 2060, (2) M.2 bays & (1) SSD bay...

alifftudm95 wrote on 6/7/2019, 9:37 AM

I got Mercalli 4 and after expirinmenting with it for several years feel if it can't fix your footage to usable, you should reshoot:)

I use premiere pro warp stabilizer and it does fix the jitter. Every gimbal will produce micro jitter and later on they fix it in post.

Editor and Colorist (Kinda) from Malaysia

MYPOST Member

Laptop

MacBook Pro M4 Max

16 Core CPU and 40 Core GPU

64GB Memory

2TB Internal SSD Storage

Anti-Glare 4K HDR Screen

 

PC DEKSTOP

CPU: Ryzen 9 5900x

GPU: RTX3090 24GB

RAM: 64GB 3200MHZ

MOBO: X570-E

Storage:

C DRIVE NVME M.2 1TB SSD GEN 4

D DRIVE NVME M.2 2TB SSD GEN 4

E DRIVE SATA SSD 2TB

F DRIVE SATA SSD 2TB

G DRIVE HDD 1TB

Monitor: Asus ProArt PA279CV 4K HDR (Bought on 30 August 2023)

Monitor: BenQ PD2700U 4K HDR (RIP on 30 August 2023)

 

 

 

Kinvermark wrote on 6/7/2019, 10:10 AM

Best would be to eliminate the jitter / sharp movements during filming, otherwise you are always having to deal with the CMOS rolling shutter distortion. Sure, PP can warp it to look ok, as can Mercalli & CMOS fixer, but the footage is still damaged from the start.

A camera with good IBIS would likely help a lot. Probably, so would a bigger / better gimbal - but I don't use one, so just a guess. :) Maybe you could rent a bigger gimbal?

fr0sty wrote on 6/7/2019, 10:46 AM

"Every gimbal will produce micro jitter and later on they fix it in post."

This is far from true.

I passed the sample clip posted here along to the team so they can use it to improve the stabilizer's performance.

Last changed by fr0sty on 6/7/2019, 10:48 AM, changed a total of 1 times.

Systems:

Desktop

AMD Ryzen 7 1800x 8 core 16 thread at stock speed

64GB 3000mhz DDR4

Geforce RTX 3090

Windows 10

Laptop:

ASUS Zenbook Pro Duo 32GB (9980HK CPU, RTX 2060 GPU, dual 4K touch screens, main one OLED HDR)

alifftudm95 wrote on 6/8/2019, 12:19 AM

Best would be to eliminate the jitter / sharp movements during filming, otherwise you are always having to deal with the CMOS rolling shutter distortion. Sure, PP can warp it to look ok, as can Mercalli & CMOS fixer, but the footage is still damaged from the start.

A camera with good IBIS would likely help a lot. Probably, so would a bigger / better gimbal - but I don't use one, so just a guess. :) Maybe you could rent a bigger gimbal?

Well I've tried few types of gimbals including DJI Ronin S. Gimbal Tend to create micro jitter. For running shot the jitter getting more obvious.

 

Editor and Colorist (Kinda) from Malaysia

MYPOST Member

Laptop

MacBook Pro M4 Max

16 Core CPU and 40 Core GPU

64GB Memory

2TB Internal SSD Storage

Anti-Glare 4K HDR Screen

 

PC DEKSTOP

CPU: Ryzen 9 5900x

GPU: RTX3090 24GB

RAM: 64GB 3200MHZ

MOBO: X570-E

Storage:

C DRIVE NVME M.2 1TB SSD GEN 4

D DRIVE NVME M.2 2TB SSD GEN 4

E DRIVE SATA SSD 2TB

F DRIVE SATA SSD 2TB

G DRIVE HDD 1TB

Monitor: Asus ProArt PA279CV 4K HDR (Bought on 30 August 2023)

Monitor: BenQ PD2700U 4K HDR (RIP on 30 August 2023)