Video Enhancement

Richvideo wrote on 2/19/2020, 6:12 PM

Hi

I was curious to see if anyone knows of a plugin for Vegas or After Effects that uses this type of technology to recreate frames

https://sites.google.com/view/wenbobao/dain

I was impressed with the use of it in this old film

https://www.engadget.com/2020/02/04/how-ai-helped-upscale-an-antique-1896-film-to-4k/

I want to enhance some 8MM film footage that was taken in 60's of my parent's wedding

I have the Topaz software so I can do the upscale but I want to change the framerate to 60FPS to give the footage the "live" look

 

 

Comments

JN- wrote on 2/19/2020, 6:35 PM

@Richvideo I'm curious about this also, I have a lot of old 15fps SD material and hope to convert to either 25 or 30 fps using AI tech when it's ready.

I downloaded the Topaz sharpening app and played with it using an old fuzzy photo, scanned from print, poor enough quality.

The software is easy to use, simple controls, quick enough for photos on my laptop. My intention was to check out the photo app first then move on to testing their upscaling for video app.

I was very impressed with the results. Viewed on screen normally it looked very improved from the original.

The problem is that in this case, when you have a person in the photo, and zoom in on the face you realise that it's just very ugly, (zooming in on the original is ok, just still fuzzy) especially around the eyes. If you don’t zoom in, say just print the photo, and don’t expect others to check it out with a magnifying glass then its ok, and appears better.

I have seen other mention/example of this eye replacement parts using AI, so for me its not there yet for people.

 

 

Last changed by JN- on 2/19/2020, 6:38 PM, changed a total of 1 times.

---------------------------------------------

VFR2CFR, Variable frame rate to Constant frame rate link to zip here.

Copies Video Converts Audio to AAC, link to zip here.

Convert 2 Lossless, link to ZIP here.

Convert Odd 2 Even (frame size), link to ZIP here

Benchmarking Continued thread + link to zip here

Codec Render Quality tables zip

---------------------------------------------

PC ... Corsair case, own build ...

CPU .. i9 9900K, iGpu UHD 630

Memory .. 32GB DDR4

Graphics card .. MSI RTX 2080 ti

Graphics driver .. latest studio

PSU .. Corsair 850i

Mboard .. Asus Z390 Code

 

Laptop… XMG

i9-11900k, iGpu n/a

Memory 64GB DDR4

Graphics card … Laptop RTX 3080

Richvideo wrote on 2/19/2020, 6:44 PM

@Richvideo I'm curious about this also, I have a lot of old 15fps SD material and hope to convert to either 25 or 30 fps using AI tech when it's ready.

I downloaded the Topaz sharpening app and played with it using an old fuzzy photo, scanned from print, poor enough quality.

The software is easy to use, simple controls, quick enough for photos on my laptop. My intention was to check out the photo app first then move on to testing their upscaling for video app.

I was very impressed with the results. Viewed on screen normally it looked very improved from the original.

The problem is that in this case, when you have a person in the photo, and zoom in on the face you realise that it's just very ugly, especially around the eyes. If you don’t zoom in, say just print the photo, and don’t expect others to check it out with a magnifying glass then its ok.

I have seen other mention/example of this eye replacement parts using AI, so for me its not there yet for people.

 

 

I assume that this gives better results for video than the Topaz sharpening tool https://topazlabs.com/video-enhance-ai/

In regards to basic sharping, I have been using this plugin for After Effects for a while and it really does a great job. I wish that they would make a Vegas version

https://digitalanarchy.com/Samurai-Sharpen-Video/main.html

 

fr0sty wrote on 2/19/2020, 6:53 PM

Nothing currently, but I do hear that it is being looked into for various future NLEs. Adobe has already said they have an AI engine in development (The Sensei Engine). I imagine Vegas Creative Software wouldn't want to let them get too far ahead in that area, so it wouldn't surprise me to see something along those lines being investigated on their end as well.

JN- wrote on 2/19/2020, 7:04 PM

@Richvideo “I assume that this gives better results for video than the Topaz sharpening tool”

I didn’t get around to testing it yet, I assume it will have the same issues that I mentioned above, with peoples faces, but I will test and get back sometime.

Update … @Richvideo Sometime arrived today. I tested using the Video Enhance app. I used a 5 second SD clip and selected a 200% upscale. The results are similar to what I have tested with a photo, poor for people if zoomed in.

Last changed by JN- on 2/21/2020, 6:56 AM, changed a total of 1 times.

---------------------------------------------

VFR2CFR, Variable frame rate to Constant frame rate link to zip here.

Copies Video Converts Audio to AAC, link to zip here.

Convert 2 Lossless, link to ZIP here.

Convert Odd 2 Even (frame size), link to ZIP here

Benchmarking Continued thread + link to zip here

Codec Render Quality tables zip

---------------------------------------------

PC ... Corsair case, own build ...

CPU .. i9 9900K, iGpu UHD 630

Memory .. 32GB DDR4

Graphics card .. MSI RTX 2080 ti

Graphics driver .. latest studio

PSU .. Corsair 850i

Mboard .. Asus Z390 Code

 

Laptop… XMG

i9-11900k, iGpu n/a

Memory 64GB DDR4

Graphics card … Laptop RTX 3080

Former user wrote on 2/19/2020, 10:31 PM

 

The problem is that in this case, when you have a person in the photo, and zoom in on the face you realise that it's just very ugly, (zooming in on the original is ok, just still fuzzy) especially around the eyes. If you don’t zoom in, say just print the photo, and don’t expect others to check it out with a magnifying glass then its ok, and appears better.

I have seen other mention/example of this eye replacement parts using AI, so for me its not there yet for people.

 

I see similar on youtube where people crop in close to a person's face filmed at 1080p. they know the crop will look soft compared to the main non crop video so they use some form of sharpening technique. Makes them look sick/drug addict. Even with simple sharpening AI could help, it would know not to put dark rings under a person's eyes or accentuate blood vessels or skin problems

 

JN- wrote on 2/21/2020, 6:57 AM

@Richvideo

Sometime arrived today.  I tested using the Topaz Labs Video Enhance app.  I used a 5 second SD clip and selected a 200% upscale.  The results are similar to what I have tested with a photo, poor/ugly for people if zoomed in.

---------------------------------------------

VFR2CFR, Variable frame rate to Constant frame rate link to zip here.

Copies Video Converts Audio to AAC, link to zip here.

Convert 2 Lossless, link to ZIP here.

Convert Odd 2 Even (frame size), link to ZIP here

Benchmarking Continued thread + link to zip here

Codec Render Quality tables zip

---------------------------------------------

PC ... Corsair case, own build ...

CPU .. i9 9900K, iGpu UHD 630

Memory .. 32GB DDR4

Graphics card .. MSI RTX 2080 ti

Graphics driver .. latest studio

PSU .. Corsair 850i

Mboard .. Asus Z390 Code

 

Laptop… XMG

i9-11900k, iGpu n/a

Memory 64GB DDR4

Graphics card … Laptop RTX 3080