How Best/Easiest to Reduce Shaky Phone Video

Soniclight-2.0 wrote on 4/20/2023, 11:03 PM

Vegas Pro 19, Windows 10

The below is a 25 sec. edit of an impromptu, only hand-held 720p video taken of my cat in his carrier back from the vet - as I carried him - on the top of the trunk I built for my 1992 Honda CBR600 motorcycle.

Had I known I had to make the excruciating decision to put him to "sleep" in the midst of Covid in June 2020, I wish I had a better quality record of this albeit odd set up, but so it goes.

This is part of a longer project of mine on the evolution of my bike through various DIY stuff I've done to it since 2005. It's been the only personal form of transportation I have had since then.

As to the issue:

Besides my walking towards the back of the bike, then backwards, the shaking is the worst in the latter. My guess is that using some form of motion tracking would be best, but I've never done that. The other is to just scrub it and keep adjusting in pan/crop with keyframes, but that can be rather hit and miss.

Either way, I know I can't really improve it by much and I also don't want to spend an insane amount of time on it.

But I welcome any suggestions.
Thanks.

PS: If curious about what the bike looks like, here's a pic of it. The front signals are also my DIY and all white stripes as is the red and white of the upper faring under the windshield are night reflective here it is:



 

Comments

EricLNZ wrote on 4/20/2023, 11:12 PM

Personally I didn't find the shaking objectionable. I barely noticed it as I was concentrating on the cat. I'd leave it as it is.

Former user wrote on 4/21/2023, 12:11 AM

I had a look at mercalli 5 stabilizer, Resolve and Topaz VAI

Resolve did a great job on default settings as as a stabilizer but it can't detect and fix cmos wobble. Mercalli did not do a good job with cmos fix turned on using various presets. I have not delved into that software beyond presets, it's possible it can do a better job.

This is Topaz VAI. It did the best job, but something looks strange about, some morphing and micro jitter I think.

(Won't upload)

Soniclight-2.0 wrote on 4/21/2023, 12:18 AM

Small important note: I only have Vegas and Boris Continuum, no other fancy plugins.

Former user wrote on 4/21/2023, 12:20 AM

Resolve free version will stabilize , but as said has no cmos wobble fix.

Anyway this is the Topaz result which I thought was best, but try Resolve, also others may know if there's a boris continuum option.

Dexcon wrote on 4/21/2023, 12:45 AM

BCC has an Optical Stabilizer FX in the Image Restoration unit.

Vegas Pro 19's native Video Stabilizer in Expert mode with the grid adjusted to cover just the phone image did quite a good job, but that CMOS jello is perhaps too strong to be able to be corrected very much. But the Topaz result is very good.

You might want to test both of the above stabilisers in VP19 using the original phone footage with the project properties set to vertical 9:16 (i.e. 1920 H x 1080 W if the original video is HD) so that the stbilisers have the maximum video size/quality to work with.

Cameras: Sony FDR-AX100E; GoPro Hero 11 Black Creator Edition

Installed: Vegas Pro 15, 16, 17, 18, 19, 20, 21 & 22, HitFilm Pro 2021.3, DaVinci Resolve Studio 19.0.3, BCC 2025, Mocha Pro 2025.0, NBFX TotalFX 7, Neat NR, DVD Architect 6.0, MAGIX Travel Maps, Sound Forge Pro 16, SpectraLayers Pro 11, iZotope RX11 Advanced and many other iZ plugins, Vegasaur 4.0

Windows 11

Dell Alienware Aurora 11:

10th Gen Intel i9 10900KF - 10 cores (20 threads) - 3.7 to 5.3 GHz

NVIDIA GeForce RTX 2080 SUPER 8GB GDDR6 - liquid cooled

64GB RAM - Dual Channel HyperX FURY DDR4 XMP at 3200MHz

C drive: 2TB Samsung 990 PCIe 4.0 NVMe M.2 PCIe SSD

D: drive: 4TB Samsung 870 SATA SSD (used for media for editing current projects)

E: drive: 2TB Samsung 870 SATA SSD

F: drive: 6TB WD 7200 rpm Black HDD 3.5"

Dell Ultrasharp 32" 4K Color Calibrated Monitor

 

LAPTOP:

Dell Inspiron 5310 EVO 13.3"

i5-11320H CPU

C Drive: 1TB Corsair Gen4 NVMe M.2 2230 SSD (upgraded from the original 500 GB SSD)

Monitor is 2560 x 1600 @ 60 Hz

Soniclight-2.0 wrote on 4/21/2023, 12:59 AM

@Former user - Wow, your use of Resolve came out pretty smooth, definitely better than I could expect. Since I don't have DaVinci (free or otherwise), not sure I want to go through the whole install process just to use the stabilizer. Though my 1TB OS NVMe drive still has almost 2/3 of free space... so it wouldn't choke it. :)

@Dexcon - Thanks. Considering what Todd-A0 pulled off (he did do the vertical 9:16), if BCC's Image Restoration does similar, that will be more than sufficient. It's getting close to bed time here, so will give it a shot tomorrow.

Former user wrote on 4/21/2023, 6:49 AM

@Soniclight-2.0 Hi, BCC Optical Stabilizer, I haven't used this fx before & things are quite as I'd like, 🙈, I screen captured your vid & reduced it to 9:16, BCC doesn't seem to like it but prob user error, I'll have another play later

One of Boris's vids

This is with Auto scale 🤣

This is without Auto scale so you can see why the vid above is why it is

Dexcon wrote on 4/21/2023, 7:06 AM

 I screen captured your vid & reduced it to 9:16, BCC doesn't seem to like it but prob user error,

When I tested the video in VP19 yesterday with BCC Optical Stab, there was no discernable difference to the non-stabbed original, but then I was using the uploaded video with the L/R 16:9 fill still in place so that may not have been a good test for the BCC stab - @Former user  ... thus probably not user error if it didn't work well for you also but using 9:16 AR.

Cameras: Sony FDR-AX100E; GoPro Hero 11 Black Creator Edition

Installed: Vegas Pro 15, 16, 17, 18, 19, 20, 21 & 22, HitFilm Pro 2021.3, DaVinci Resolve Studio 19.0.3, BCC 2025, Mocha Pro 2025.0, NBFX TotalFX 7, Neat NR, DVD Architect 6.0, MAGIX Travel Maps, Sound Forge Pro 16, SpectraLayers Pro 11, iZotope RX11 Advanced and many other iZ plugins, Vegasaur 4.0

Windows 11

Dell Alienware Aurora 11:

10th Gen Intel i9 10900KF - 10 cores (20 threads) - 3.7 to 5.3 GHz

NVIDIA GeForce RTX 2080 SUPER 8GB GDDR6 - liquid cooled

64GB RAM - Dual Channel HyperX FURY DDR4 XMP at 3200MHz

C drive: 2TB Samsung 990 PCIe 4.0 NVMe M.2 PCIe SSD

D: drive: 4TB Samsung 870 SATA SSD (used for media for editing current projects)

E: drive: 2TB Samsung 870 SATA SSD

F: drive: 6TB WD 7200 rpm Black HDD 3.5"

Dell Ultrasharp 32" 4K Color Calibrated Monitor

 

LAPTOP:

Dell Inspiron 5310 EVO 13.3"

i5-11320H CPU

C Drive: 1TB Corsair Gen4 NVMe M.2 2230 SSD (upgraded from the original 500 GB SSD)

Monitor is 2560 x 1600 @ 60 Hz

Former user wrote on 4/21/2023, 8:08 AM

@Dexcon Hi, yeah i tried it full 16:9 screen capture 1st too 🤦‍♂️😂

I've had a bit more of a play, the red lines are what I tried changing & so far this is the best result, prob could be refined but it doesn't like that weird jelly wobble of the camera whatever that is, Is that what you refer to as 'CMOS jello' ?

 

Dexcon wrote on 4/21/2023, 8:45 AM

 Is that what you refer to as 'CMOS jello' ?

Yes. I've long used Samsung phone cameras but, IMO, phone video suffers badly from image wobble/CMOS issues, particularly with Samsung phones, in the four corners of the image no doubt due to the small size and type of the image sensor. Presumably other phone brands also suffer the same fate due to having such small sensors. Always using 16:9 framing with phone cameras, the best stabiliser I have used thus far for phone video is daVinci Resolve's stablisier - it leaves Mercalli 5 SAL far behind because Merc can't properly address that wobble (even though DV stab doesn't have CMOS correction whereas Merc does).

In the past, I've used Mocha Pro to stabilise a central section of phone video only to find that other areas of the image wobble at an unrelated rate.

In my experience, using phones for handheld moving shots is an exercise in frustration in comparison to using a camera such as a GoPro. Of course, I've used a phone for video because that's all I had available at the time - which is probably the case for most people these days.

Cameras: Sony FDR-AX100E; GoPro Hero 11 Black Creator Edition

Installed: Vegas Pro 15, 16, 17, 18, 19, 20, 21 & 22, HitFilm Pro 2021.3, DaVinci Resolve Studio 19.0.3, BCC 2025, Mocha Pro 2025.0, NBFX TotalFX 7, Neat NR, DVD Architect 6.0, MAGIX Travel Maps, Sound Forge Pro 16, SpectraLayers Pro 11, iZotope RX11 Advanced and many other iZ plugins, Vegasaur 4.0

Windows 11

Dell Alienware Aurora 11:

10th Gen Intel i9 10900KF - 10 cores (20 threads) - 3.7 to 5.3 GHz

NVIDIA GeForce RTX 2080 SUPER 8GB GDDR6 - liquid cooled

64GB RAM - Dual Channel HyperX FURY DDR4 XMP at 3200MHz

C drive: 2TB Samsung 990 PCIe 4.0 NVMe M.2 PCIe SSD

D: drive: 4TB Samsung 870 SATA SSD (used for media for editing current projects)

E: drive: 2TB Samsung 870 SATA SSD

F: drive: 6TB WD 7200 rpm Black HDD 3.5"

Dell Ultrasharp 32" 4K Color Calibrated Monitor

 

LAPTOP:

Dell Inspiron 5310 EVO 13.3"

i5-11320H CPU

C Drive: 1TB Corsair Gen4 NVMe M.2 2230 SSD (upgraded from the original 500 GB SSD)

Monitor is 2560 x 1600 @ 60 Hz

Former user wrote on 4/21/2023, 9:22 AM

I use my phone because it's always in my pocket, when working I don't want to be fannying around with a video camera, I try to buy the best phone camera i can afford, at the moment I've just upgraded from a Samsung S21 Ultra to a Samsung S23 Ultra, I haven't noticed this jello on my clips, if it's there it's nowhere near as bad as this cat clip.

Yeah sometimes my vids have a bit of shake, either it's caffeine related shake or it's a machine shaking the camera & when I've used Mocha it does a good job of locking down the item of interest but the surrounding can get messed up, Tracking more than one area using the spline with a + so the splines are all in the same layer helps a bit, but it can also jello the image as Mocha tries to stretch & stabilize multiple areas,

I have the trial of Topaz Video AI but i just get an error msg on this 9:16 clip 🤷‍♂️

PS. I just had a really quick go with Mocha but it doesn't like tracking it because it zooms in & the only thing on screen half the time are the bars & a moggy that's moving 🐱‍👤

Dexcon wrote on 4/21/2023, 9:31 AM

Tracking more than one area using the spline with a + so the splines are all in the same layer helps a bit, but it can also jello the image as Mocha tries to stretch & stabilize multiple areas

Yes, that's been my experience. Give daVinci Resolve a try for comparison as well as Vegas Pro in expert mode with all the grid settings set to maximum (i.e. 20).

Cameras: Sony FDR-AX100E; GoPro Hero 11 Black Creator Edition

Installed: Vegas Pro 15, 16, 17, 18, 19, 20, 21 & 22, HitFilm Pro 2021.3, DaVinci Resolve Studio 19.0.3, BCC 2025, Mocha Pro 2025.0, NBFX TotalFX 7, Neat NR, DVD Architect 6.0, MAGIX Travel Maps, Sound Forge Pro 16, SpectraLayers Pro 11, iZotope RX11 Advanced and many other iZ plugins, Vegasaur 4.0

Windows 11

Dell Alienware Aurora 11:

10th Gen Intel i9 10900KF - 10 cores (20 threads) - 3.7 to 5.3 GHz

NVIDIA GeForce RTX 2080 SUPER 8GB GDDR6 - liquid cooled

64GB RAM - Dual Channel HyperX FURY DDR4 XMP at 3200MHz

C drive: 2TB Samsung 990 PCIe 4.0 NVMe M.2 PCIe SSD

D: drive: 4TB Samsung 870 SATA SSD (used for media for editing current projects)

E: drive: 2TB Samsung 870 SATA SSD

F: drive: 6TB WD 7200 rpm Black HDD 3.5"

Dell Ultrasharp 32" 4K Color Calibrated Monitor

 

LAPTOP:

Dell Inspiron 5310 EVO 13.3"

i5-11320H CPU

C Drive: 1TB Corsair Gen4 NVMe M.2 2230 SSD (upgraded from the original 500 GB SSD)

Monitor is 2560 x 1600 @ 60 Hz

Soniclight-2.0 wrote on 4/21/2023, 1:31 PM

@Former user & @Dexcon - All things considered, I'm going to try doing it in the free version of Resolve, which I just installed. Hopefully I can do as well as @Former user did.
I found a couple of how-to-videos on YT. I just have to get my brain to wrap around the different GUI - my 68 y.o. brain can be a bit laggy or uh, Jello-y on stuff like that. :)

Former user wrote on 4/21/2023, 1:36 PM

@Soniclight-2.0 I've had Resolve free on my PC for 2yrs, hardly know much about it still 🤣

Soniclight-2.0 wrote on 4/21/2023, 3:22 PM

Ha! I'm in the middle of using the in-Resolve Stabilization and looks like I might do almost as good a job as Todd did. Once done, I'll render and import into Vegas. So thanks to all for this.
_________________

On a totally OT aside, one reason this short segment has a bittersweet meaning for me:

On that fateful day in 2020, I went to an emergency vet for my cat (ZIggy) was periodically howling with pain and I was freaking out for him. Being Covid, I couldn't go into the building, so I waited in a patio area outside, sitting with him in the carrier next to me.

He was so out of it, yet... at one point, he looked at me straight in the eyes through that carrier bars. There was a soft intensity to it, and only later did I realize what may have happened.

Until then, I was still willing to fight for him to take care of him, do whatever it took. Then he was taken inside, and I had to wait until the doctor came out. Verdict was in;

No point prolonging his agony, he'd just have a heart attack within the next 24 hours.

Long story short, even though I was with him as they put him to "sleep", that moment of us looking at each... was the last time we communicated. He was already prone and going-to-sleep by the time I saw him again.

It was like he knew it was over before I or the vet did, and was saying good-bye.
I had a hard time seeing any cat in any video, especially any pix or videos I had for a couple of years.

But he had a good life.

I'd even walk him at night with a harness since I live in a 1-bedroom apt. Estimated to be born in 2001 or 2003, I essentially adopted him from the alley in late 2003. So we had almost 17 years together.

This is what is my home screen on my smartphone as a form of closure. Titled "Ziggy in Peaceful Place" - one of my early and few attempts with Dall-e AI with input of something like "cat watching sunrise in forest".

I chose the best one and edited it to remove artifacts, etc. and added the water reflection to stretch the image resolution to fit my phone.

Funny how life works...

Former user wrote on 4/21/2023, 6:15 PM

That photo looks really good. I forgot to show the Capcut stabilized version. It also looks pretty good, and looks to have CMOS wobble fix built in. Capcut is a small free basic editor, the controls are on or off for many things with no options, Stabilization has 3 options, I used the default 'recommended'. If you're very important or famous and plan to visit China I wouldn't install it because it's 20% owned by the Chinese government