Any way to remove object from video (date/time text)?

fifonik wrote on 3/15/2020, 5:15 PM

I was supplied with video (from DV camcorder) where date/time was added in the video during recording.

So I cannot do any video stabilization and even pan/crop as the timestamp text is moving and this looks awful.

Is it possible to remove the text somehow? For example by getting missed data from nearby frames as some stabilizers do with borders? Any hints on plugins/programs that can do this?

Thanks.

Last changed by fifonik

Camcorder: Panasonic X1500 + Panasonic X920 + GoPro Hero 11 Black

Desktop: MB: MSI B450M MORTAR TITANIUM, CPU: AMD Ryzen 5700X, RAM: G'Skill 32 GB DDR4@3200, Graphics card: MSI RX6600 8GB, SSD: Samsung 970 Evo+ 1TB (NVMe, OS), HDD WD 4TB, HDD Toshiba 4TB, OS: Windows 10 Pro 22H2

NLE: Vegas Pro [Edit] 11, 12, 13, 15, 17, 18, 19, 22

Author of FFMetrics and FFBitrateViewer

Comments

john_dennis wrote on 3/15/2020, 5:44 PM

Dexcon wrote on 3/15/2020, 5:49 PM

The Cut Away FX plugin from NewBlueFX has proved useful for me over the years for surgically removing unwanted (usually small) objects replacing them with similar images from surrounding pixels. The success of this approach very much depends on the content of the image - sometimes it works; other times it looks awful. Given that the time stamp is probably large-ish, there would need to be plenty of surrounding image similar to that underneath the time stamp. Sometimes, I've had to use 2 or 3 Cut Away FX to achieve a good result to remove just the one object, especially if the object is not rectangular or circular in shape.

Another approach is to copy the video event on to a lower track, use the mask function in the top track's pan/crop window to eliminate the time stamp and thus expose the lower track, and then use pan/crop or track motion on the lower track to reposition the image so that another area of the image displays in the masked area of the top track.

 

Cameras: Sony FDR-AX100E; GoPro Hero 11 Black Creator Edition

Installed: Vegas Pro 15, 16, 17, 18, 19, 20, 21 & 22, HitFilm Pro 2021.3, DaVinci Resolve Studio 19.0.3, BCC 2025, Mocha Pro 2025.0, NBFX TotalFX 7, Neat NR, DVD Architect 6.0, MAGIX Travel Maps, Sound Forge Pro 16, SpectraLayers Pro 11, iZotope RX11 Advanced and many other iZ plugins, Vegasaur 4.0

Windows 11

Dell Alienware Aurora 11:

10th Gen Intel i9 10900KF - 10 cores (20 threads) - 3.7 to 5.3 GHz

NVIDIA GeForce RTX 2080 SUPER 8GB GDDR6 - liquid cooled

64GB RAM - Dual Channel HyperX FURY DDR4 XMP at 3200MHz

C drive: 2TB Samsung 990 PCIe 4.0 NVMe M.2 PCIe SSD

D: drive: 4TB Samsung 870 SATA SSD (used for media for editing current projects)

E: drive: 2TB Samsung 870 SATA SSD

F: drive: 6TB WD 7200 rpm Black HDD 3.5"

Dell Ultrasharp 32" 4K Color Calibrated Monitor

 

LAPTOP:

Dell Inspiron 5310 EVO 13.3"

i5-11320H CPU

C Drive: 1TB Corsair Gen4 NVMe M.2 2230 SSD (upgraded from the original 500 GB SSD)

Monitor is 2560 x 1600 @ 60 Hz

fifonik wrote on 3/15/2020, 5:53 PM

@john_dennis Thanks. I'll check DeLogo filter at home

Camcorder: Panasonic X1500 + Panasonic X920 + GoPro Hero 11 Black

Desktop: MB: MSI B450M MORTAR TITANIUM, CPU: AMD Ryzen 5700X, RAM: G'Skill 32 GB DDR4@3200, Graphics card: MSI RX6600 8GB, SSD: Samsung 970 Evo+ 1TB (NVMe, OS), HDD WD 4TB, HDD Toshiba 4TB, OS: Windows 10 Pro 22H2

NLE: Vegas Pro [Edit] 11, 12, 13, 15, 17, 18, 19, 22

Author of FFMetrics and FFBitrateViewer

wwaag wrote on 3/15/2020, 11:59 PM

@fifonik

You can try Delogo, but I suspect you won't be very happy with it. If there's a lot of movement in your date/time, the result will be a lot of movement in an amorphous blob--especially with low res footage. I tried that repeatedly with old Hi8 footage converted to DV and finally settled on just adding a date/time png image that completely covers the moving text. It may not be the most attractive, but at least your attention is not always being drawn to the moving text or moving blob. Just an alternative to consider.

Here's an example.

Last changed by wwaag on 3/16/2020, 12:00 AM, changed a total of 1 times.

AKA the HappyOtter at https://tools4vegas.com/. System 1: Intel i7-8700k with HD 630 graphics plus an Nvidia RTX4070 graphics card. System 2: Intel i7-3770k with HD 4000 graphics plus an AMD RX550 graphics card. System 3: Laptop. Dell Inspiron Plus 16. Intel i7-11800H, Intel Graphics. Current cameras include Panasonic FZ2500, GoPro Hero11 and Hero8 Black plus a myriad of smartPhone, pocket cameras, video cameras and film cameras going back to the original Nikon S.

fifonik wrote on 3/16/2020, 12:54 AM

Unfortunately, covering the text with image is not an option in my case. The text is huge:

I'm almost sure that I will not be happy with result :)

However, who knows? Ten years ago I know nothing about avisynth's upscaler and was really impressed. The same way I was very impressed with deshaker, neatvideo and some other programs.

P.S. It is better try and learn something new then do nothing.

Camcorder: Panasonic X1500 + Panasonic X920 + GoPro Hero 11 Black

Desktop: MB: MSI B450M MORTAR TITANIUM, CPU: AMD Ryzen 5700X, RAM: G'Skill 32 GB DDR4@3200, Graphics card: MSI RX6600 8GB, SSD: Samsung 970 Evo+ 1TB (NVMe, OS), HDD WD 4TB, HDD Toshiba 4TB, OS: Windows 10 Pro 22H2

NLE: Vegas Pro [Edit] 11, 12, 13, 15, 17, 18, 19, 22

Author of FFMetrics and FFBitrateViewer

wwaag wrote on 3/16/2020, 10:24 AM

Agree that it's definitely worth a try.

Another option would be to try Adobe After Effects content aware fill option (which I don't have). Apparently, this option was introduced in the last year or so.

Another option might be Photoshop. I have been using some of the Content Aware options in Photoshop for years which work amazingly well in certain situations. If you do have Photoshop, you could export from Vegas as an image sequence and then create your mask and do the fill in Photoshop. You should be able to batch process such an operation and then re-import the images back into Vegas.

AKA the HappyOtter at https://tools4vegas.com/. System 1: Intel i7-8700k with HD 630 graphics plus an Nvidia RTX4070 graphics card. System 2: Intel i7-3770k with HD 4000 graphics plus an AMD RX550 graphics card. System 3: Laptop. Dell Inspiron Plus 16. Intel i7-11800H, Intel Graphics. Current cameras include Panasonic FZ2500, GoPro Hero11 and Hero8 Black plus a myriad of smartPhone, pocket cameras, video cameras and film cameras going back to the original Nikon S.

fifonik wrote on 3/17/2020, 3:57 AM

Tried Delogo (VDub) and InpaintDelogo (avisynth). Was not satisfied. You knew that :)

Looks like both programs only use one frame to re-build the missed part(s).

Going to try Prodad ERAZR (trial) to check if it can do this.

Camcorder: Panasonic X1500 + Panasonic X920 + GoPro Hero 11 Black

Desktop: MB: MSI B450M MORTAR TITANIUM, CPU: AMD Ryzen 5700X, RAM: G'Skill 32 GB DDR4@3200, Graphics card: MSI RX6600 8GB, SSD: Samsung 970 Evo+ 1TB (NVMe, OS), HDD WD 4TB, HDD Toshiba 4TB, OS: Windows 10 Pro 22H2

NLE: Vegas Pro [Edit] 11, 12, 13, 15, 17, 18, 19, 22

Author of FFMetrics and FFBitrateViewer

Grazie wrote on 3/17/2020, 4:05 AM

Going to try Prodad ERAZR (trial) to check if it can do this.

@fifonik - I’ve bought E, bad mistake, you won’t like it. Apart from NOT having an UNDO f you haven’t got enough underlying REPLACEMENT frames, it’s a bust. Oh yeah, I run MOCHA PRO, so I know what should happen, anywhoo try it and report back.

Former user wrote on 3/17/2020, 4:25 AM

@Grazie in this scenario where the time stamps are static what is proceedure with mocha pro removal. Should it be an auto, walk away and let it run job, even for a 30min video because you aren't really tracking the time stamp you just need to key frame it?, so the track shouldn't move anywhere or is it time consuming and have to monitor it?

 

Grazie wrote on 3/17/2020, 4:55 AM

@Former user - Yeah, but what are yer gonna replace it with? Need to make Clean Plattes. There’s a great MP YT about doing complex Layers. I’ll try and search it down.

Dexcon wrote on 3/17/2020, 5:18 AM

That's a good point @Former user I thought about suggesting the Mocha Pro removal tool in my earlier comment, but didn't mention it because I couldn't see how it would work in this situation other than if you were removing the time stamp area of the image and replacing it with a plate (still image) as demonstrated in a couple of BorisFX tutorials on the Removal tool.

The most common use of the MP Removal tool is to remove a moving object from within a usual static or stable shot, the Removal tool replacing the chosen tracked area of the moving object with a frame from within the same shot which is clear of the moving object. The method is to create a spline around the object and then track it, possibly adjusting spline keyframing along the way if necessary. Then create another but static spline covering a much larger area of the image that includes all areas of the image in which the tracked object spline occurs. The Removal tool then compares then replaces the tracked object with similar frames the tool finds within the 2nd spline that do not include the object.

It is often miraculous what it can do. In the past, I've not had success with MP's Removal tool in removing a static object from within a static shot (because there were no frames at all within the shot that showed an image of the what was behind the object that I was wanting to remove), but I did get success with using NBFX's Cut Away plugin for the object removal.

If there is a method of removing a static object using MP's Removal tool, I would be most grateful to learn about how to do that. While writing this, I see that Grazie has said that he will seek out a MP YT. It will be great to see this if he's locates it.

With regard to the need to keyframe MP splines. If the area covered by the spline is static and does not have any movement, then just hit save within MP and all it will work. But if there is any movement in the image that the spline needs to follow and then the track may require keyframe adjustment during the track, depending on how accurately the track follows the object/item being tracked. For example, tracking a picture frame within an image that is smoothly zooming/panning/tilting may not any keyframe adjustment, but a track of a moving person will possibly need keyframe adjustment at some point during the track. It's so very dependent on the characteristics of each shot.

Cameras: Sony FDR-AX100E; GoPro Hero 11 Black Creator Edition

Installed: Vegas Pro 15, 16, 17, 18, 19, 20, 21 & 22, HitFilm Pro 2021.3, DaVinci Resolve Studio 19.0.3, BCC 2025, Mocha Pro 2025.0, NBFX TotalFX 7, Neat NR, DVD Architect 6.0, MAGIX Travel Maps, Sound Forge Pro 16, SpectraLayers Pro 11, iZotope RX11 Advanced and many other iZ plugins, Vegasaur 4.0

Windows 11

Dell Alienware Aurora 11:

10th Gen Intel i9 10900KF - 10 cores (20 threads) - 3.7 to 5.3 GHz

NVIDIA GeForce RTX 2080 SUPER 8GB GDDR6 - liquid cooled

64GB RAM - Dual Channel HyperX FURY DDR4 XMP at 3200MHz

C drive: 2TB Samsung 990 PCIe 4.0 NVMe M.2 PCIe SSD

D: drive: 4TB Samsung 870 SATA SSD (used for media for editing current projects)

E: drive: 2TB Samsung 870 SATA SSD

F: drive: 6TB WD 7200 rpm Black HDD 3.5"

Dell Ultrasharp 32" 4K Color Calibrated Monitor

 

LAPTOP:

Dell Inspiron 5310 EVO 13.3"

i5-11320H CPU

C Drive: 1TB Corsair Gen4 NVMe M.2 2230 SSD (upgraded from the original 500 GB SSD)

Monitor is 2560 x 1600 @ 60 Hz

Grazie wrote on 3/17/2020, 5:35 AM

If there is a method of removing a static object using MP's Removal tool, I would be most grateful to learn about how to do that. While writing this, I see that Grazie has said that he will seek out a MP YT. It will be great to see this if he's locates it.

@Dexcon - Your wish is my Command 🙏 https://borisfx.com/videos/mocha-pro-patching-removing-obscured-objects-with-insert-module/

This is purely about the need to create Clean Plates; how to feather them in and layering in those elements. I’ve used this process to Remove a Wall Plug I hadn’t been aware of whilst filming a politician. Used a Clean Plate created in PSP. It worked.

Dexcon wrote on 3/18/2020, 8:14 AM

@Grazie ... thank you for locating that tutorial. I think that I need to revisit how I do Removal because the example in the YT shows the splines located out-of-frame, but when I do that the track usually collapses.

The tutorial highlights the use of Photoshop, but I think that anyone with Corel PaintShop will be able to achieve a similar result with PaintShop's own clone tool.

Cameras: Sony FDR-AX100E; GoPro Hero 11 Black Creator Edition

Installed: Vegas Pro 15, 16, 17, 18, 19, 20, 21 & 22, HitFilm Pro 2021.3, DaVinci Resolve Studio 19.0.3, BCC 2025, Mocha Pro 2025.0, NBFX TotalFX 7, Neat NR, DVD Architect 6.0, MAGIX Travel Maps, Sound Forge Pro 16, SpectraLayers Pro 11, iZotope RX11 Advanced and many other iZ plugins, Vegasaur 4.0

Windows 11

Dell Alienware Aurora 11:

10th Gen Intel i9 10900KF - 10 cores (20 threads) - 3.7 to 5.3 GHz

NVIDIA GeForce RTX 2080 SUPER 8GB GDDR6 - liquid cooled

64GB RAM - Dual Channel HyperX FURY DDR4 XMP at 3200MHz

C drive: 2TB Samsung 990 PCIe 4.0 NVMe M.2 PCIe SSD

D: drive: 4TB Samsung 870 SATA SSD (used for media for editing current projects)

E: drive: 2TB Samsung 870 SATA SSD

F: drive: 6TB WD 7200 rpm Black HDD 3.5"

Dell Ultrasharp 32" 4K Color Calibrated Monitor

 

LAPTOP:

Dell Inspiron 5310 EVO 13.3"

i5-11320H CPU

C Drive: 1TB Corsair Gen4 NVMe M.2 2230 SSD (upgraded from the original 500 GB SSD)

Monitor is 2560 x 1600 @ 60 Hz

Grazie wrote on 3/18/2020, 8:44 AM

@Dexcon - Yup, I did it in PsP, now that would be Affinity Photo.