Vegas Pro 16 stabilization introducing jitter

ken-dehoff wrote on 10/20/2018, 12:40 PM

All:

I wanted to demonstrate the annoying jitter I got after running a clip through the new video stabilizer. The original content was filmed with a sony ax53 that does some built in optical stabilization and was recorded at 4k 30fps. I used Accurate, Similarity, left the smoothing to 2.5 seconds. I disabled zoom which makes it easier to see the jitter on the edges, the original video is the bottom half of the video and the top half is the stabilized version. I'd like to report this as a bug - I want to use this feature but can't until this is resolved!

 

Comments

3POINT wrote on 10/20/2018, 1:16 PM

It's quite normal that you get jitter when running a clip through a video stabilizer. For this reason you have a rolling shutter correction or cmos correction, an option I didn't discover yet in the new stabilizer.

ryclark wrote on 10/21/2018, 7:30 AM

I don't thing that it is a bug IMHO. Part of the problem is that you are panning across a background at the same time as tracking the balloon. Panning can always cause problems with simple stabilising effects. Different settings might improve the situation or, alternatively, using a more sophisticated plugin such as proDad Mercalli.

Vegas_Sebastian wrote on 10/31/2018, 7:28 AM

All:

I wanted to demonstrate the annoying jitter I got after running a clip through the new video stabilizer. The original content was filmed with a sony ax53 that does some built in optical stabilization and was recorded at 4k 30fps. I used Accurate, Similarity, left the smoothing to 2.5 seconds. I disabled zoom which makes it easier to see the jitter on the edges, the original video is the bottom half of the video and the top half is the stabilized version. I'd like to report this as a bug - I want to use this feature but can't until this is resolved!

 

Have you tried build 307 (Update 2)?

ken-dehoff wrote on 10/31/2018, 9:34 AM

I have tested build 307 and while better it still has the judder in the 2nd half of the video. Curiously, the video starts out looking very good but the 2nd half the judder returns.

I started a new project for this, used the default smoothing value of 6.2 - is this a change from v1?

I set zoom to 0 to help see the stabilizer behavior.

Kinvermark wrote on 10/31/2018, 10:59 AM

I would agree with the above comments - this is a lot to ask of any stabilization software. It's a long clip with a lot of movement. Amazing that it smooths so much of it so well. Would be interesting to see of Mercalli does any better. Maybe download a trial and see.

As an aside, very long scenes are a little hard on the audience. You could easily divide into shorter clips (most of my edits are 3-5 seconds long) with jump cuts and get a more interesting & dynamic video.

 

Eagle Six wrote on 10/31/2018, 11:10 AM

In my build 307 the default Smoothing is still 2.5. BTW have you tried Translation for the Motion Compensation?

After testing the Video Stabilization FX in all the released builds, so far, Mercalli 4 Plugin does a much better job for my stuff, but as ryclark pointed out, panning adds for difficulty to the stabilization process. If you haven't tried it, ProDad offers a trial version of Mercalli 4 Plugin for Vegas. Try it straight out of the box with defaults, I bet you will like it better and it has additional controls, although you may not like it enough to justify the price. If you do like it, get on their mailing list as they do from time to time run specials, especially Black Friday and Cyber Monday.

System Specs......
Corsair Obsidian Series 450D ATX Mid Tower
Asus X99-A II LGA 2011-v3, Intel X99 SATA 6 Gb/s USB 3.1/3.0 ATX Intel Motherboard
Intel Core i7-6800K 15M Broadwell-E, 6 core 3.4 GHz LGA 2011-v3 (overclocked 20%)
64GB Corsair Vengeance LPX DDR4 3200
Corsair Hydro Series H110i GTX 280mm Extreme Performance Liquid CPU Cooler
MSI Radeon R9 390 DirectX 12 8GB Video Card
Corsair RMx Series RM750X 740W 80 Plus Gold power pack
Samsung 970 EVO NVMe M.2 boot drive
Corsair Neutron XT 2.5 480GB SATA III SSD - video work drive
Western Digitial 1TB 7200 RPM SATA - video work drive
Western Digital Black 6TB 7200 RPM SATA 6Bb/s 128MB Cache 3.5 data drive

Bluray Disc burner drive
2x 1080p monitors
Microsoft Window 10 Pro
DaVinci Resolve Studio 16 pb2
SVP13, MVP15, MVP16, SMSP13, MVMS15, MVMSP15, MVMSP16

VEGASPascal wrote on 11/1/2018, 3:10 AM

In my build 307 the default Smoothing is still 2.5. BTW have you tried Translation for the Motion Compensation?

The result looks quite good to me and 'Similarity' is the correct model (because of the rotation and zoom) for you. Could you send us your sample? We improve continously... 😉

ken-dehoff wrote on 11/1/2018, 10:21 AM

So I've gotten a good result by running the video through ProDAD's CMOS Fixr before stabilizing and using translation instead of similarity. Similarity definitely introduces alot of erroneous corrections. So I'd say the jitter I'm seeing is both rolling shutter artifact and Similarity bugs. My best result so far is posted below. Good enough to keep me going, especially since I already have Mercalli. The problem I had with Mercalli's stabilization is an annoying perspective shift that happens at the nexus of sudden movements