Fix tripod video that got moved very slightly up and down

RonB_USA wrote on 9/9/2022, 5:01 PM

Someone shot a 4K video for me that was a fixed shot of the full stage. But someone repeatedly leaned on the shelf where the camera tripod was, so there is very slight movement up and down during the 30-minute video. Is there a way to use masks, motion tracking or stabilization to easily KEEP the video precisely in the same spot for the 40 minutes? I don't want anything to move vertically at all because there are many editing effects throughout the video. There is no rotation or scaling. Just location up and down. Suggestions appreciated.

RonB_USA (VEGAS Pro 19, Ver. 643)

RonB_USA

Operating System: Windows 10 Pro

Dual Monitors: Now have TWO Samsung 4K 27-in (3840x2160) monitors both using DisplayPort

Desktop Sound: Stereo speakers with sub-woofer. Headphones. Earbuds.

VEGAS Pro 21.0, version 208. Have used VEGAS Pro since Sony days. Movie Studio also.

Voukoder 1.7.1.0

Source Footage: Mostly XAVC-S 4K MP4 with some MTS HD at times. Have used Samsung S21Ultra 5G footage.

Some upscaling of older videos. Many videos are more than 10 years old. Trying to learn more color correction and grading techniques. Any help with flicker reduction without motion blur is welcome!

Motherboard: ASUS PRIME X299-A II (3.7GHz)

CPU: Intel i9-10920X 12 Core 24 Thread

GPU: Quadro RTX-4000 8GB

RAM: 64GB DDR4

C-Drive SSD: M.2 2TB + Video SSDs: Two M.2 2TB + Internal HDDs: Several TB + External HDDs + External SSDs

Comments

john_dennis wrote on 9/9/2022, 5:16 PM

Are you delivering in 4K?

RonB_USA wrote on 9/9/2022, 9:13 PM

Yes, 4K. But since it's a full screen shot, I can sacrifice some zoom and will probably end up running it through Upscale or Sharpen, if needed. Thanks, John. I was thinking that someone might have a script to create keyframes to move it up and down the opposite direction of the movements. Or some other techniques. Since it was telephoto, the movements are bigger than ideal, but still very subtle. It wouldn't take very much zoom to make them perfect.

RonB_USA

Operating System: Windows 10 Pro

Dual Monitors: Now have TWO Samsung 4K 27-in (3840x2160) monitors both using DisplayPort

Desktop Sound: Stereo speakers with sub-woofer. Headphones. Earbuds.

VEGAS Pro 21.0, version 208. Have used VEGAS Pro since Sony days. Movie Studio also.

Voukoder 1.7.1.0

Source Footage: Mostly XAVC-S 4K MP4 with some MTS HD at times. Have used Samsung S21Ultra 5G footage.

Some upscaling of older videos. Many videos are more than 10 years old. Trying to learn more color correction and grading techniques. Any help with flicker reduction without motion blur is welcome!

Motherboard: ASUS PRIME X299-A II (3.7GHz)

CPU: Intel i9-10920X 12 Core 24 Thread

GPU: Quadro RTX-4000 8GB

RAM: 64GB DDR4

C-Drive SSD: M.2 2TB + Video SSDs: Two M.2 2TB + Internal HDDs: Several TB + External HDDs + External SSDs

Grazie wrote on 9/9/2022, 9:22 PM

I was thinking that someone might have a script to create keyframes to move it up and down the opposite direction of the movements. Or some other techniques. Since it was telephoto, the movements are bigger than ideal, but still very subtle. It wouldn't take very much zoom to make them perfect.

@RonB_USA - Understood. I don’t know of a script, but I’m thinking some form of Rotoscoping-Tracking? Perhaps MOCHA Pro?

RonB_USA wrote on 9/9/2022, 9:22 PM

If I don't get any solutions, I will do it manually JUST for the bigger up and down movements. It's easy to scan across the timeline to see where the big ones are. Then drop Markers. But very labor intensive. When I greatly magnify vertically, I can actually see when the graphics tech was breathing as he leaned on the media shelf where the tripod was sitting.

RonB_USA

Operating System: Windows 10 Pro

Dual Monitors: Now have TWO Samsung 4K 27-in (3840x2160) monitors both using DisplayPort

Desktop Sound: Stereo speakers with sub-woofer. Headphones. Earbuds.

VEGAS Pro 21.0, version 208. Have used VEGAS Pro since Sony days. Movie Studio also.

Voukoder 1.7.1.0

Source Footage: Mostly XAVC-S 4K MP4 with some MTS HD at times. Have used Samsung S21Ultra 5G footage.

Some upscaling of older videos. Many videos are more than 10 years old. Trying to learn more color correction and grading techniques. Any help with flicker reduction without motion blur is welcome!

Motherboard: ASUS PRIME X299-A II (3.7GHz)

CPU: Intel i9-10920X 12 Core 24 Thread

GPU: Quadro RTX-4000 8GB

RAM: 64GB DDR4

C-Drive SSD: M.2 2TB + Video SSDs: Two M.2 2TB + Internal HDDs: Several TB + External HDDs + External SSDs

RonB_USA wrote on 9/9/2022, 9:43 PM

As far as I know, the movements are 0-degrees straight up and 180-degrees straight down. So the motion tracking should be simple. How to transfer that data to move the zoom-pan-crop or motion tracking up and down might be a solution. Any more ideas? So I DON'T want to change anything or stabilize any movements within the frames. I just want to move the ENTIRE frames up and down as they were shot. It will require a very small zoom to keep the edges looking the same in either of the three positions: up, down, and normal.

RonB_USA

Operating System: Windows 10 Pro

Dual Monitors: Now have TWO Samsung 4K 27-in (3840x2160) monitors both using DisplayPort

Desktop Sound: Stereo speakers with sub-woofer. Headphones. Earbuds.

VEGAS Pro 21.0, version 208. Have used VEGAS Pro since Sony days. Movie Studio also.

Voukoder 1.7.1.0

Source Footage: Mostly XAVC-S 4K MP4 with some MTS HD at times. Have used Samsung S21Ultra 5G footage.

Some upscaling of older videos. Many videos are more than 10 years old. Trying to learn more color correction and grading techniques. Any help with flicker reduction without motion blur is welcome!

Motherboard: ASUS PRIME X299-A II (3.7GHz)

CPU: Intel i9-10920X 12 Core 24 Thread

GPU: Quadro RTX-4000 8GB

RAM: 64GB DDR4

C-Drive SSD: M.2 2TB + Video SSDs: Two M.2 2TB + Internal HDDs: Several TB + External HDDs + External SSDs

Musicvid wrote on 9/9/2022, 9:47 PM

Vegas Stabilization isn't working well enough? Upload your video (or a short sample) to Drive or Dropbox. I'm sure you will get plenty of takers . . . ;?)

bvideo wrote on 9/9/2022, 10:00 PM

Trying video stabilization, after running the stabilizing survey, chose the "freeze motion" mode in stabilization options? Also in "expert mode" you can try choosing a grid that covers an area with the least program motion around the stage.

RonB_USA wrote on 9/9/2022, 10:32 PM

I tightly zoomed into a very small part of the video frame that has a level line (almost like cross-hairs) in the video as a vertical reference point for the entire 40 minutes. The goal is to set every single frame of this video so that the small part shows the same vertical level on ALL frames. Using the very fastest Rate of Timeline Speed (which is 20X), I can go across the timeline quickly and see each and every vertical movement. Then put in M markers. I can drop in Pan/Crop Position Keyframes by using the Insert key on my keyboard and then move the Pan/Crop up and down to that correct vertical reference point line. (I lock the Pan/Crop X so that only the Y can move up and down.) Eventually, the full 40 minutes will be perfectly movement-free (or close enough for when I zoom back out to see the normal view). Then I will render that corrected video file and put it in my edited project as a SWAP VIDEO. Hope this works! Give me a day or so to mark a Solution. I'm still open to other ideas that are more automated. I know a good script would do this in seconds! But I have good patience and like good results. I also have a couple of other videos like this one, so that is why I am spending time on this solution. Thanks for your thoughts on this.

RonB_USA

Operating System: Windows 10 Pro

Dual Monitors: Now have TWO Samsung 4K 27-in (3840x2160) monitors both using DisplayPort

Desktop Sound: Stereo speakers with sub-woofer. Headphones. Earbuds.

VEGAS Pro 21.0, version 208. Have used VEGAS Pro since Sony days. Movie Studio also.

Voukoder 1.7.1.0

Source Footage: Mostly XAVC-S 4K MP4 with some MTS HD at times. Have used Samsung S21Ultra 5G footage.

Some upscaling of older videos. Many videos are more than 10 years old. Trying to learn more color correction and grading techniques. Any help with flicker reduction without motion blur is welcome!

Motherboard: ASUS PRIME X299-A II (3.7GHz)

CPU: Intel i9-10920X 12 Core 24 Thread

GPU: Quadro RTX-4000 8GB

RAM: 64GB DDR4

C-Drive SSD: M.2 2TB + Video SSDs: Two M.2 2TB + Internal HDDs: Several TB + External HDDs + External SSDs

3d87c4 wrote on 9/9/2022, 10:51 PM

Thinking outside the box: use the Stereoscopic 3D Adjust to align to a reference frame.

Use a frame grab to create a reference image from the video.

If the movement happens at known times, split it up into separate clips where the vertical shift is steady throughout. (Or do it frame by frame?)

Create a 3D project, put the reference image on the first timeline and one of the clips on the second, then combine them as a stereo clip. Use the Stereoscopic 3D Adjust fx to line up the "right" video to the "left" reference image---either automatically or manually. Repeat for each clip where the vertical alignment has changed. You can do your full edit using the stereo clips then finally render only the "right" view.

If you click on video preview preferences and select Stereographic 3D Mode to Difference it is very easy to see whether the left and right images are aligned.



Just a thought...

 

Last changed by 3d87c4 on 9/9/2022, 11:05 PM, changed a total of 2 times.

Del XPS 17 laptop

Processor    13th Gen Intel(R) Core(TM) i9-13900H   2.60 GHz
Installed RAM    32.0 GB (31.7 GB usable)
System type    64-bit operating system, x64-based processor
Pen and touch    Touch support with 10 touch points

Edition    Windows 11 Pro
Version    22H2
Installed on    ‎6/‎8/‎2023
OS build    22621.1848
Experience    Windows Feature Experience Pack 1000.22642.1000.0

NVIDIA GeForce RTX 4070 Laptop GPU
Driver Version: 31.0.15.2857
8GB memory
 

john_dennis wrote on 9/9/2022, 11:29 PM

I tightly zoomed into a very small part of the video frame that has a level line (almost like cross-hairs) in the video as a vertical reference point for the entire 40 minutes. The goal is to set every single frame of this video so that the small part shows the same vertical level on ALL frames. Using the very fastest Rate of Timeline Speed (which is 20X), I can go across the timeline quickly and see each and every vertical movement. Then put in M markers. I can drop in Pan/Crop Position Keyframes by using the Insert key on my keyboard and then move the Pan/Crop up and down to that correct vertical reference point line. (I lock the Pan/Crop X so that only the Y can move up and down.) Eventually, the full 40 minutes will be perfectly movement-free (or close enough for when I zoom back out to see the normal view). Then I will render that corrected video file and put it in my edited project as a SWAP VIDEO. Hope this works! Give me a day or so to mark a Solution. I'm still open to other ideas that are more automated. I know a good script would do this in seconds! But I have good patience and like good results. I also have a couple of other videos like this one, so that is why I am spending time on this solution. Thanks for your thoughts on this.

I've actually used that method, even to the extent of putting a Post-it note on the screen to give me a reference point. I didn't do forty minutes, though.

Consider using a whole integer true 16:9 crop box between 3712x2088 and 3840x2160 or just large enough to account for the full vertical deviation.

RonB_USA wrote on 9/10/2022, 2:03 AM

Additional info... Luckily, the graphics tech who didn't get the instructions to not lean on that shelf, only did it at certain times, probably as he was about to change the Powerpoint slides a few times. So it is only a few times during the video that need to be corrected. But it has to be done because I use some PIPs and titles that I don't want perceived to be floating up and down.

Additional emphasis and more tricks... To repeat, I find the VP19 Fast Playback feature to be very helpful to easily see and locate these vertical movement spots by playing at 20X. A literal time-saver. Just hold down the left mouse button and release it when you see movement. Then expand the timeline there. Use the left and right cursor keys to move back and forth. This method even works without doing the magnification. Right in the project which saves several steps.

Thanks for the tips, John - several others.

I also use THIS aspect ratio calculator.

RonB_USA

RonB_USA

Operating System: Windows 10 Pro

Dual Monitors: Now have TWO Samsung 4K 27-in (3840x2160) monitors both using DisplayPort

Desktop Sound: Stereo speakers with sub-woofer. Headphones. Earbuds.

VEGAS Pro 21.0, version 208. Have used VEGAS Pro since Sony days. Movie Studio also.

Voukoder 1.7.1.0

Source Footage: Mostly XAVC-S 4K MP4 with some MTS HD at times. Have used Samsung S21Ultra 5G footage.

Some upscaling of older videos. Many videos are more than 10 years old. Trying to learn more color correction and grading techniques. Any help with flicker reduction without motion blur is welcome!

Motherboard: ASUS PRIME X299-A II (3.7GHz)

CPU: Intel i9-10920X 12 Core 24 Thread

GPU: Quadro RTX-4000 8GB

RAM: 64GB DDR4

C-Drive SSD: M.2 2TB + Video SSDs: Two M.2 2TB + Internal HDDs: Several TB + External HDDs + External SSDs

3POINT wrote on 9/11/2022, 10:37 AM

I suppose the static recording is part of a multi cam registration so you could overlay the unusable parts with views from the other cameras. If it's just a single camera registration, it seems to me very boring watching a 30 minute static recording of an event. In that case I would down scale to FHD and use the pan/crop/zoom possibilities of Vegas to make this static recording more dynamic and more attractive to watch.

Last changed by 3POINT on 9/11/2022, 10:39 AM, changed a total of 1 times.

3POINT, Theo Houben, Vegasuser since version 5 and co-founder and moderator of the Dutch Vegasforum https://www.vegas-videoforum.nl/index.php

Recware: DJI Osmo Pocket/Mavic Mini, GoproHero7Black, PanasonicFZ300/HCX909.

Software: Vegaspro365+Vegasaur, PowerDirector365, Davinci Resolve 20

Hardware: i910900k, 32GB, GTX2080super, 2x1920x1200 display

Playware: Samsung Qled QE65Q6FN