Video stabilisation - removing Jello effect - Pro 14 crashes

peterh337 wrote on 6/27/2017, 5:25 AM

Here, after about 00:30 you can see it

https://vimeo.com/223096669

It seems to be caused by camera vibration and could be due to an interaction between vibration and the camera's stabilisation (in this case, Sony X3000, it was optical stabilisation only).

I tried Vegas 14's Stabilise function but it crashes the program. It just sits there, not responding to anything, but Task Manager shows it as responding OK.

Can anyone think of a way to remove the jello effect?

I might have to abandon 4K shooting and shoot in 1080P in which you can have both optical and software stabilisation. The 1080P mode, same camera, doesn't appear to show any jello

https://vimeo.com/223097766

Comments

set wrote on 6/27/2017, 9:41 AM

Hmm, try download the source of the first vimeo link, and stabilize...

This is what I've got:

Setiawan Kartawidjaja
Bandung, West Java, Indonesia (UTC+7 Time Area)

Personal FB | Personal IG | Personal YT Channel
Chungs Video FB | Chungs Video IG | Chungs Video YT Channel
Personal Portfolios YouTube Playlist
Pond5 page: My Stock Footage of Bandung city

 

System 5-2021:
Processor: Intel(R) Core(TM) i7-10700 CPU @ 2.90GHz   2.90 GHz
Video Card1: Intel UHD Graphics 630 (Driver 31.0.101.2127 (Feb 1 2024 Release date))
Video Card2: NVIDIA GeForce RTX 3060 Ti 8GB GDDR6 (Driver Version 551.23 Studio Driver (Jan 24 2024 Release Date))
RAM: 32.0 GB
OS: Windows 10 Pro Version 22H2 OS Build 19045.3693
Drive OS: SSD 240GB
Drive Working: NVMe 1TB
Drive Storage: 4TB+2TB

 

System 2-2018:
ASUS ROG Strix Hero II GL504GM Gaming Laptop
Processor: Intel(R) Core(TM) i7 8750H CPU @2.20GHz 2.21 GHz
Video Card 1: Intel(R) UHD Graphics 630 (Driver 31.0.101.2111)
Video Card 2: NVIDIA GeForce GTX 1060 6GB GDDR5 VRAM (Driver Version 537.58)
RAM: 16GB
OS: Win11 Home 64-bit Version 22H2 OS Build 22621.2428
Storage: M.2 NVMe PCIe 256GB SSD & 2.5" 5400rpm 1TB SSHD

 

* I don't work for VEGAS Creative Software Team. I'm just Voluntary Moderator in this forum.

peterh337 wrote on 6/27/2017, 10:30 AM

Did you manage to stabilise in Vegas Pro 14 without it crashing or hanging the program?

What settings did you use? Did you check the checkbox for rolling shutter removal?

I think I can still see some jello there but it could just be the low resolution of youtube.

set wrote on 6/27/2017, 10:41 AM

No crash happening... but, the source I got from Vimeo is 1080-30p - is this the same source as you use?

I only use Light Stabilization preset without rolling shutter removal.

Let me try once more with rolling shutter removal.

Setiawan Kartawidjaja
Bandung, West Java, Indonesia (UTC+7 Time Area)

Personal FB | Personal IG | Personal YT Channel
Chungs Video FB | Chungs Video IG | Chungs Video YT Channel
Personal Portfolios YouTube Playlist
Pond5 page: My Stock Footage of Bandung city

 

System 5-2021:
Processor: Intel(R) Core(TM) i7-10700 CPU @ 2.90GHz   2.90 GHz
Video Card1: Intel UHD Graphics 630 (Driver 31.0.101.2127 (Feb 1 2024 Release date))
Video Card2: NVIDIA GeForce RTX 3060 Ti 8GB GDDR6 (Driver Version 551.23 Studio Driver (Jan 24 2024 Release Date))
RAM: 32.0 GB
OS: Windows 10 Pro Version 22H2 OS Build 19045.3693
Drive OS: SSD 240GB
Drive Working: NVMe 1TB
Drive Storage: 4TB+2TB

 

System 2-2018:
ASUS ROG Strix Hero II GL504GM Gaming Laptop
Processor: Intel(R) Core(TM) i7 8750H CPU @2.20GHz 2.21 GHz
Video Card 1: Intel(R) UHD Graphics 630 (Driver 31.0.101.2111)
Video Card 2: NVIDIA GeForce GTX 1060 6GB GDDR5 VRAM (Driver Version 537.58)
RAM: 16GB
OS: Win11 Home 64-bit Version 22H2 OS Build 22621.2428
Storage: M.2 NVMe PCIe 256GB SSD & 2.5" 5400rpm 1TB SSHD

 

* I don't work for VEGAS Creative Software Team. I'm just Voluntary Moderator in this forum.

peterh337 wrote on 6/27/2017, 10:45 AM

OK, yes, I rendered the video to 1080P 30fps and that is what the Vimeo download will give you.

I was trying to stabilise a 4K clip and maybe that is what crashes Vegas.

The stabilisation defaults are 0.5 and 0.5.

set wrote on 6/27/2017, 11:03 AM

Setiawan Kartawidjaja
Bandung, West Java, Indonesia (UTC+7 Time Area)

Personal FB | Personal IG | Personal YT Channel
Chungs Video FB | Chungs Video IG | Chungs Video YT Channel
Personal Portfolios YouTube Playlist
Pond5 page: My Stock Footage of Bandung city

 

System 5-2021:
Processor: Intel(R) Core(TM) i7-10700 CPU @ 2.90GHz   2.90 GHz
Video Card1: Intel UHD Graphics 630 (Driver 31.0.101.2127 (Feb 1 2024 Release date))
Video Card2: NVIDIA GeForce RTX 3060 Ti 8GB GDDR6 (Driver Version 551.23 Studio Driver (Jan 24 2024 Release Date))
RAM: 32.0 GB
OS: Windows 10 Pro Version 22H2 OS Build 19045.3693
Drive OS: SSD 240GB
Drive Working: NVMe 1TB
Drive Storage: 4TB+2TB

 

System 2-2018:
ASUS ROG Strix Hero II GL504GM Gaming Laptop
Processor: Intel(R) Core(TM) i7 8750H CPU @2.20GHz 2.21 GHz
Video Card 1: Intel(R) UHD Graphics 630 (Driver 31.0.101.2111)
Video Card 2: NVIDIA GeForce GTX 1060 6GB GDDR5 VRAM (Driver Version 537.58)
RAM: 16GB
OS: Win11 Home 64-bit Version 22H2 OS Build 22621.2428
Storage: M.2 NVMe PCIe 256GB SSD & 2.5" 5400rpm 1TB SSHD

 

* I don't work for VEGAS Creative Software Team. I'm just Voluntary Moderator in this forum.

peterh337 wrote on 6/27/2017, 11:18 AM

I think I still see jello there.

Let me upload a 4K video somewhere...

I have crashed Pro 14 again. The progress bar quickly runs up to 9 seconds and then freezes

http://peter-ftp.co.uk/screenshots/2017-06-27_172717.jpg

set wrote on 6/27/2017, 11:31 AM

The jello will not be easy to be minimized... but I'll try experiment with your 4K video, especially to check if it is crashing my VP14...

Setiawan Kartawidjaja
Bandung, West Java, Indonesia (UTC+7 Time Area)

Personal FB | Personal IG | Personal YT Channel
Chungs Video FB | Chungs Video IG | Chungs Video YT Channel
Personal Portfolios YouTube Playlist
Pond5 page: My Stock Footage of Bandung city

 

System 5-2021:
Processor: Intel(R) Core(TM) i7-10700 CPU @ 2.90GHz   2.90 GHz
Video Card1: Intel UHD Graphics 630 (Driver 31.0.101.2127 (Feb 1 2024 Release date))
Video Card2: NVIDIA GeForce RTX 3060 Ti 8GB GDDR6 (Driver Version 551.23 Studio Driver (Jan 24 2024 Release Date))
RAM: 32.0 GB
OS: Windows 10 Pro Version 22H2 OS Build 19045.3693
Drive OS: SSD 240GB
Drive Working: NVMe 1TB
Drive Storage: 4TB+2TB

 

System 2-2018:
ASUS ROG Strix Hero II GL504GM Gaming Laptop
Processor: Intel(R) Core(TM) i7 8750H CPU @2.20GHz 2.21 GHz
Video Card 1: Intel(R) UHD Graphics 630 (Driver 31.0.101.2111)
Video Card 2: NVIDIA GeForce GTX 1060 6GB GDDR5 VRAM (Driver Version 537.58)
RAM: 16GB
OS: Win11 Home 64-bit Version 22H2 OS Build 22621.2428
Storage: M.2 NVMe PCIe 256GB SSD & 2.5" 5400rpm 1TB SSHD

 

* I don't work for VEGAS Creative Software Team. I'm just Voluntary Moderator in this forum.

peterh337 wrote on 6/27/2017, 12:09 PM

1.4GB 4K video here: http://peter-ftp.co.uk/videos/x3000-test2-4k.MXF

However, when I load that into Vegas 14 and run stabilise on it, Vegas doesn't crash! So the crashing is size based, or maybe limited to the video coming out of the Sony camera. The above clip has been rendered by Vegas using the stock XAVC template.

However Vegas does crash immediate when I click on Undo (stabilise); it offers to send some info to Vegas. So at least somebody ought to be able to reproduce this.

3POINT wrote on 6/27/2017, 1:48 PM

I had also several crashes when trying to stabilize 4k video with Vegas 14 internal stabilizer, with is based on Mercalli2 (seems a bug to me). Peter did you try the Mercalli 4 plugin that came with VegasPro 14, it has a very good filter for minimizing jello?

peterh337 wrote on 6/27/2017, 3:22 PM

Mecalli 4 doesn't seem to do anything, although I don't know if I was using it correctly. The rendered video looks just the same. Vegas also still crashed at the end of the rendering

http://peter-ftp.co.uk/screenshots/2017-06-27_211130.jpg

This software is all so buggy it is basically useless. Vegas Movie Studio 11, running under winXP, never crashed and I never found a bug in it. The only reason I moved on from it was for lens correction, but the X3000 camera needs little or no lens correction. And of course it doesn't support 4K at all. But I might have to go back to shooting 1080P anyway, to get the camera to stabilise the video.

3POINT wrote on 6/27/2017, 3:29 PM

Mecalli 4 doesn't seem to do anything, although I don't know if I was using it correctly. The rendered video looks just the same.

Did you use the CMOS Fixer? After applying this fixer to an event you have to press "Estimate".

peterh337 wrote on 6/27/2017, 4:55 PM

I think the CMOS fixr worked! I will upload the resulting file overnight.

peterh337 wrote on 6/28/2017, 12:45 AM

Here it is http://peter-ftp.co.uk/videos/jello4.MP4

However the result is nowhere near as good as shooting in 1080P 50fps with the old X1000 camera:
https://vimeo.com/221749045
(similar scenery from 2:50) which is vastly smoother and with zero distortion. And that video is after substantial lens correction which required a crop and thus involved pixel replication.

I have modded to camera mount to be even stiffer and will re-test in about a week. But in the end I might have to abandon 4K shooting.

I will delete these files in about a week because while the server has loads of BW it has only limited space.

peterh337 wrote on 6/28/2017, 2:23 AM

I have done one render with Mercalli 4 on the "precise" setting. It uses a lot more memory and even with 24GB I had to shut down some apps. The result is:  http://peter-ftp.co.uk/videos/jello5.MP4

I can't see it is any better.

Nothing gets remotely close to shooting in 50 or 60fps...

peterh337 wrote on 7/11/2017, 5:28 AM

An update: the Sony X3000 seems to suffer from jello if optical stabilisation is being used and there is virtually any vibration. And in the 4K setting, optical stabilisation is the only available option because the sensor itself is 4K-sized.

One solution which works is to disable the stabilisation:

https://vimeo.com/224740265

I never found anything in Vegas that does anything worthwhile with this issue.

The other solution is to shoot in 1080 and then one can use software stabilisation, which doesn't seem to have the jello problem. The problem is that if you want to do lens correction, you end up replicating pixels. But you can get 60fps or even 120fps.

D7K wrote on 7/11/2017, 2:41 PM

I work with Panasonic 30 fps 4K all day and no issues. Its either your camera or you. I've worked with Mercalli PRO 4.0 since it came out and if you can not fix it with Mercalli you shot it wrong and need to shoot it again. Real problem here is pilot error.

Kinvermark wrote on 7/11/2017, 3:08 PM

Totally right! I think peterh337 would be far better off asking respectful questions rather than just dissing' Vegas and Mercalli. I will give you one hint: you should be using Mercalli 4 NOT cmos fixer, use progressive footage, and make sure your project frame rate and footage frame rate match exactly. Then it is simply apply the effect, click analyse and it works perfectly 90% of the time. No crashes.

peterh337 wrote on 7/11/2017, 3:20 PM

I am always happy to learn something.

Just tried Mercalli 4, applied to the event (tried timeline before that) and it doesn't do anything. Clicking on Analyse does nothing.

I am working with 29.97P video and have the project set the same way. As of now I am running the latest update of Vegas Pro 14.

peterh337 wrote on 7/11/2017, 3:31 PM

The Analyse issue has been solved. The program silently fails to work if the event is longer than a certain time. I had a 30 minute video.

Mercalli 4 doesn't fix the jello either. No visible difference.

Kinvermark wrote on 7/11/2017, 7:45 PM

In my experience, nothing really does a good job of repairing "jello" Sometimes a combination of CMOS fixer and Mercalli makes it acceptable (subjective); sometimes it makes it worse. You might want to try dividing your 30 minute clip into much smaller pieces (as events on the timeline, not the original source) and try stabilizing each individually - might look OK, but I suspect the transition between each event may be off.

Other than that, you would have to try something hard-core like Mocha's planer tracker. Boris offers it in one of their effects packages for Vegas, but I think it is expensive.

 

D7K wrote on 7/11/2017, 8:45 PM

In my experience, nothing really does a good job of repairing "jello" Sometimes a combination of CMOS fixer and Mercalli makes it acceptable (subjective); sometimes it makes it worse. You might want to try dividing your 30 minute clip into much smaller pieces (as events on the timeline, not the original source) and try stabilizing each individually - might look OK, but I suspect the transition between each event may be off.

Other than that, you would have to try something hard-core like Mocha's planer tracker. Boris offers it in one of their effects packages for Vegas, but I think it is expensive.

 


+1 I'd never try and stabilize anything longer than 10-15 seconds even Mercalli PRO can have problems with longer videos.

peterh337 wrote on 7/12/2017, 2:14 AM

One problem is that once I have disabled optical stabilisation, the jello is only in parts of the image. It is visible in the bottom right, rarely in the middle.

I reckon that even when the stabilisation is disabled, the lens module is wobbling around. The only solution would be a camera without this feature, or to open the camera and epoxy the lens module in place :)

peterh337 wrote on 7/16/2017, 4:22 PM

I solved this problem by modifying the camera, to disable optical stabilisation. Here is a rather bad video showing how: https://vimeo.com/225384978

And this is the result; no jello: https://vimeo.com/225686907