Video object remover

marcinzm wrote on 1/22/2024, 1:40 PM

Hello,

 

DaVinci Resolve has such option which is called: "Video object remover". It lets user to specify the object which would be removed from a video. The effect analyse the neighbourhood area and fits it to the object to remove.

I would like to use this effect mostly in some particial situation -> when I have a dust on camera digital sensor. In preview monitor I don`t see such dust and I even don`t know there is such problem. This effect could let me remove such dust from a video.

Does Vegas have such AI effect?

Are Vegas developer team going to create such effect in Vegas in nearest future?

 

Regards
Marcin

 

 

If you are bored, drink water, you will want to pee. -> Albert Einstein - my idol!

I am 42. I have been creating videos since 2009 (the date when my first daughter was born in). My first video software was Pinnacle, next one was Sony Vegas 8 (I am not sure if remember it correctly). I am also a developer and wedding movie operator and editor. For example: I have created an Android app which let me control Vegas Pro rendering progress level on Android smartphone. I created it for fun, because I also love programming. I also created my own plugin for Audio To Text feature specified usage from Vegas Pro 19. I created proxy creation plugin which uses multiple GPU threads (maximum 3) to create proxy files for Vegas Pro. I also written many others plugin/softwares which enhance my video editing, also wedding editing.

Camera/video camera: Sony FX3, Sony A7 III, Sony FDR AX 100, Canon 5D Mark III, GoPro Hero Black 7,8,9,10

Lenses for Sony: Tamron 28-75mm F/2.8 Di III , Sony 24mm gm 1.4 FE, Sony 20 mm G FE 1.8

Lenses for Canon: Canon EF 24-70 mm F/2.8 L USM, Canon 70-200 f/2.8 L

Drone: DJI Mavic 3 & DJI Phantom 4 Pro v2.0

 

Editing: Vegas Pro 20 (365) with a lot of third party plugins, also my own plugins written in C#

 

PC:

CPU: Intel(R) Core(TM) i9-7900X CPU @ 3.30GHz   3.31 GHz

RAM: 128 GB

GPU: Nvidia RTX 2080 TI

storage: 4 SSD drives (including two M.2 flash drives) and two HDD drives

Windows system: 10 Home edition

Comments

monoparadox wrote on 1/22/2024, 4:08 PM

Nothing in Vegas I am aware of. I use the Boris BCC dust removal when needed.

3d87c4 wrote on 1/22/2024, 4:42 PM

A nice feature indeed...

I have used masking to hide things.

If you have an image or clip of the same location as the offending object you can place them on a lower timeline and use masking so you see the clean version.

Similarly, you could save a frame grab with the blemish, remove it using photoshop or affinity photo, and place the modified image on a lower timeline and use masking.

Not a general solution, but can work in a pinch.

Del XPS 17 laptop

Processor    13th Gen Intel(R) Core(TM) i9-13900H   2.60 GHz
Installed RAM    32.0 GB (31.7 GB usable)
System type    64-bit operating system, x64-based processor
Pen and touch    Touch support with 10 touch points

Edition    Windows 11 Pro
Version    22H2
Installed on    ‎6/‎8/‎2023
OS build    22621.1848
Experience    Windows Feature Experience Pack 1000.22642.1000.0

NVIDIA GeForce RTX 4070 Laptop GPU
Driver Version: 31.0.15.2857
8GB memory
 

mark-y wrote on 1/22/2024, 6:51 PM

"Object Removal" from moving scenes is one of the more basic features of Mocha, an advanced tracking software.

Mocha for Vegas plugin is included as part of Vegas Pro 21. In their demo they remove a jeep, so I think a dust spot would be a fairly easy candidate.

Former user wrote on 1/22/2024, 7:00 PM

"Object Removal" from moving scenes is one of the more basic features of Mocha, an advanced tracking software.

Mocha for Vegas plugin is included as part of Vegas Pro 21.


@mark-y I don't have the Vegas version but I have free adobe plugin version, you don't get the remove module, that is an upsell to the full featured Mocha Pro.

RogerS wrote on 1/22/2024, 7:21 PM

Sensor dust doesn't move so I don't see the point in tracking it. 3d87c4's advice should work.

Dexcon wrote on 1/22/2024, 7:30 PM

I haven't used it myself, but I recall a BorisFX BCC new features video years ago which demonstrated how 'Pixel Fixer' could be used to clean-up something like a dead camera sensor pixel or a dust speck. Pixel Fixer is still there in BCC's Image Restoration Unit.

Cameras: Sony FDR-AX100E; GoPro Hero 11 Black Creator Edition

Installed: Vegas Pro 15, 16, 17, 18, 19, 20, 21 & 22, HitFilm Pro 2021.3, DaVinci Resolve Studio 19.0.3, BCC 2025, Mocha Pro 2025.0, NBFX TotalFX 7, Neat NR, DVD Architect 6.0, MAGIX Travel Maps, Sound Forge Pro 16, SpectraLayers Pro 11, iZotope RX11 Advanced and many other iZ plugins, Vegasaur 4.0

Windows 11

Dell Alienware Aurora 11:

10th Gen Intel i9 10900KF - 10 cores (20 threads) - 3.7 to 5.3 GHz

NVIDIA GeForce RTX 2080 SUPER 8GB GDDR6 - liquid cooled

64GB RAM - Dual Channel HyperX FURY DDR4 XMP at 3200MHz

C drive: 2TB Samsung 990 PCIe 4.0 NVMe M.2 PCIe SSD

D: drive: 4TB Samsung 870 SATA SSD (used for media for editing current projects)

E: drive: 2TB Samsung 870 SATA SSD

F: drive: 6TB WD 7200 rpm Black HDD 3.5"

Dell Ultrasharp 32" 4K Color Calibrated Monitor

 

LAPTOP:

Dell Inspiron 5310 EVO 13.3"

i5-11320H CPU

C Drive: 1TB Corsair Gen4 NVMe M.2 2230 SSD (upgraded from the original 500 GB SSD)

Monitor is 2560 x 1600 @ 60 Hz

Reyfox wrote on 1/23/2024, 8:41 AM

I had a slight finger smudge that I didn't notice when I was shooting. You can see if plainly in the sky when I was panning. But once I panned to a structure, you could not see it.

I used Cookie Cutter and another clip shifted over a bit, so the sky from the lower clip showed in the cookie cutter clip above. Worked like a charm.

wwaag wrote on 1/25/2024, 12:41 AM

Just remembered that PixelPatcher was a free tool that I acquired sometime ago. Apparently it works in V21 since its an OFX plug-in.

Here's a screengrab. I have not or at least I don't remember using it.

If there's any interest, I'll upload it and share.

AKA the HappyOtter at https://tools4vegas.com/. System 1: Intel i7-8700k with HD 630 graphics plus an Nvidia RTX4070 graphics card. System 2: Intel i7-3770k with HD 4000 graphics plus an AMD RX550 graphics card. System 3: Laptop. Dell Inspiron Plus 16. Intel i7-11800H, Intel Graphics. Current cameras include Panasonic FZ2500, GoPro Hero11 and Hero8 Black plus a myriad of smartPhone, pocket cameras, video cameras and film cameras going back to the original Nikon S.

Reyfox wrote on 1/25/2024, 5:35 AM

@wwaag of course!!! Thanks in advance!

Newbie😁

Vegas Pro 22 (VP18-21 also installed)

Win 11 Pro always updated

AMD Ryzen 9 5950X 16 cores / 32 threads

32GB DDR4 3200

Sapphire RX6700XT 12GB Driver: 25.3.1

Gigabyte X570 Elite Motherboard

Panasonic G9, G7, FZ300

wwaag wrote on 1/25/2024, 9:55 AM

Here's the link where it can be downloaded. https://www.dropbox.com/scl/fi/i0zy927nbwp3yyrop1312/PixelPatcher_1.3_Setup.exe?rlkey=ucuyuy0ocpp6js6374p86g1fm&dl=0

Years ago I had a Hi8 camcorder with a dead pixel that showed up as a white dot. Here's what I used to do: duplicate the track; then move the duplicate track a few pixels using track motion, and then create a mask. Worked reasonably well--at least good enough for home videos.

AKA the HappyOtter at https://tools4vegas.com/. System 1: Intel i7-8700k with HD 630 graphics plus an Nvidia RTX4070 graphics card. System 2: Intel i7-3770k with HD 4000 graphics plus an AMD RX550 graphics card. System 3: Laptop. Dell Inspiron Plus 16. Intel i7-11800H, Intel Graphics. Current cameras include Panasonic FZ2500, GoPro Hero11 and Hero8 Black plus a myriad of smartPhone, pocket cameras, video cameras and film cameras going back to the original Nikon S.

marcinzm wrote on 1/25/2024, 2:25 PM

Thank you all for your posts.

@wwaag Thank you for your efforts. I downloaded PixelPatcher plugin. Can you record some videos to show how to use this plugin? I know that there are some situations that there are a few (i.e. more than 2) dustes on sensor on the same video. Can this plugin fix this? Or maybe I should apply three times PixelPatcher?
Can you demostrate a video with using this plugin. I think that many people would be happy of it?

Thank you in advance and thank you for your efforts.

Regards

Marcin

If you are bored, drink water, you will want to pee. -> Albert Einstein - my idol!

I am 42. I have been creating videos since 2009 (the date when my first daughter was born in). My first video software was Pinnacle, next one was Sony Vegas 8 (I am not sure if remember it correctly). I am also a developer and wedding movie operator and editor. For example: I have created an Android app which let me control Vegas Pro rendering progress level on Android smartphone. I created it for fun, because I also love programming. I also created my own plugin for Audio To Text feature specified usage from Vegas Pro 19. I created proxy creation plugin which uses multiple GPU threads (maximum 3) to create proxy files for Vegas Pro. I also written many others plugin/softwares which enhance my video editing, also wedding editing.

Camera/video camera: Sony FX3, Sony A7 III, Sony FDR AX 100, Canon 5D Mark III, GoPro Hero Black 7,8,9,10

Lenses for Sony: Tamron 28-75mm F/2.8 Di III , Sony 24mm gm 1.4 FE, Sony 20 mm G FE 1.8

Lenses for Canon: Canon EF 24-70 mm F/2.8 L USM, Canon 70-200 f/2.8 L

Drone: DJI Mavic 3 & DJI Phantom 4 Pro v2.0

 

Editing: Vegas Pro 20 (365) with a lot of third party plugins, also my own plugins written in C#

 

PC:

CPU: Intel(R) Core(TM) i9-7900X CPU @ 3.30GHz   3.31 GHz

RAM: 128 GB

GPU: Nvidia RTX 2080 TI

storage: 4 SSD drives (including two M.2 flash drives) and two HDD drives

Windows system: 10 Home edition

wwaag wrote on 1/25/2024, 2:28 PM

@marcinzm

As I said before, I haven't used this plugin or if I did many years ago, I don't remember. Wish I could be of more help.

AKA the HappyOtter at https://tools4vegas.com/. System 1: Intel i7-8700k with HD 630 graphics plus an Nvidia RTX4070 graphics card. System 2: Intel i7-3770k with HD 4000 graphics plus an AMD RX550 graphics card. System 3: Laptop. Dell Inspiron Plus 16. Intel i7-11800H, Intel Graphics. Current cameras include Panasonic FZ2500, GoPro Hero11 and Hero8 Black plus a myriad of smartPhone, pocket cameras, video cameras and film cameras going back to the original Nikon S.

mark-y wrote on 1/25/2024, 3:28 PM

Here is the object removal demo I saw for Mocha Vegas 21.