Normal temporal variations, originating in the source.

Yep

I rather VEGAS Team focus more on improving other OFX tool then colorization OFX. No one gonna use it in daily basis.

I must admit that I appreciate the colorization FX because I have used it successfully for a number of historic B&W stills - and the colorization is amazing. Depending on the still, I do find it necessary to play around with the control settings to avoid artifacts and unnatural discoloring which can sometimes occur.

Though probably of limited interest, there's a slowly growing number of posts on YT where the editor has taken historic footage from the late 19th century or early 20th century and stabilised it, optically smoothed it into 24/25 fps, and colorized it. An example is:

Regardless of the NLE used, it is truly amazing IMO.

I rather VEGAS Team focus more on improving other OFX tool then colorization OFX. No one gonna use it in daily basis.

Sorry Aliff, but I disagree heavily on this.

Image and Video restoration is HUGE. Documentarians, representatives of cultural sector and indeed some marketing agencies can offer top dollar for this type of work.

Prior to this plugin, my method of making this was a mix of image sequencing plus hours and hours on end repeating of working with brushes and masks in Photoshop (until Imerge/VEGAS IMAGE made it so much easier)

Depending on the state of the footage, this plugin saves me days upon days of work. After rending the clip, I simply bring it back and dial down whatever saturation levels or highlights that come out in excess.

 

I rather VEGAS Team focus more on improving other OFX tool then colorization OFX. No one gonna use it in daily basis.

Sorry Aliff, but I disagree heavily on this.

Image and Video restoration is HUGE. Documentarians, representatives of cultural sector and indeed some marketing agencies can offer top dollar for this type of work.

Prior to this plugin, my method of making this was a mix of image sequencing plus hours and hours on end repeating of working with brushes and masks in Photoshop (until Imerge/VEGAS IMAGE made it so much easier)

Depending on the state of the footage, this plugin saves me days upon days of work. After rending the clip, I simply bring it back and dial down whatever saturation levels or highlights that come out in excess.

 

From my experience, they often will paid a proper VFX post house to restore Black & White video which take months to do so. And also the color is not that accurate coming from VEGAS AI colorization. I think its a long way to make it perfect.

I would say fixing the playback & adding mainstream OFX plugins is a top priority in my opinion.

I would say fixing the playback & adding mainstream OFX plugins is a top priority in my opinion.

+1

I rather VEGAS Team focus more on improving other OFX tool then colorization OFX. No one gonna use it in daily basis.

Sorry Aliff, but I disagree heavily on this.

Image and Video restoration is HUGE. Documentarians, representatives of cultural sector and indeed some marketing agencies can offer top dollar for this type of work.

Prior to this plugin, my method of making this was a mix of image sequencing plus hours and hours on end repeating of working with brushes and masks in Photoshop (until Imerge/VEGAS IMAGE made it so much easier)

 

They're a small team, we need them to fix actual core vegas, not do side projects like this that almost nobody uses. The other problem is that they've reinvented the wheel when there was no need to do so, as DAIN and DeOldify do colourisation and interframes at much higher quality than Vegas can do, and it's all free and was all available before the Vegas feature. From what I've heard everything is free and open source so they've advanced since I last had a look into this, they used to use the paid Topaz Gigapixel for uprez'ing frames.

Look into these professional grade restoration groups, nobody is using vegas, you will need an Nvidia GPU though, the more powerful the better,

Except there isn't much "PROGRAMMING" required. Machine learning evolves exactly through what the name suggests, machine learning.

There's nothing remarkably exhaustive about the suggestion that I made. Its either a possible addition or it isn't.

I'll take up your suggestion on Delodify and see how that fairs, however.

I rather VEGAS Team focus more on improving other OFX tool then colorization OFX. No one gonna use it in daily basis.

Sorry Aliff, but I disagree heavily on this.

Image and Video restoration is HUGE. Documentarians, representatives of cultural sector and indeed some marketing agencies can offer top dollar for this type of work.

Prior to this plugin, my method of making this was a mix of image sequencing plus hours and hours on end repeating of working with brushes and masks in Photoshop (until Imerge/VEGAS IMAGE made it so much easier)

 

They're a small team, we need them to fix actual core vegas, not do side projects like this that almost nobody uses. The other problem is that they've reinvented the wheel when there was no need to do so, as DAIN and DeOldify do colourisation and interframes at much higher quality than Vegas can do, and it's all free and was all available before the Vegas feature. From what I've heard everything is free and open source so they've advanced since I last had a look into this, they used to use the paid Topaz Gigapixel for uprez'ing frames.

Look into these professional grade restoration groups, nobody is using vegas, you will need an Nvidia GPU though, the more powerful the better,

 

Its either a possible addition or it isn't.

Mohammed_Anis wrote on 12/26/2020, 4:03 AM

Normal temporal variations, originating in the source.

Yep

So you see you have answered your question before you asked it. Your solution lies in going after source of the problem, not the result.

Do what the studios do: Correct the luminance and range dynamics first, one captured frame at a time, then apply the colorization to the normalized source. Then you can start on Citizen Kane.

Its either a possible addition or it isn't.

Mohammed_Anis wrote on 12/26/2020, 4:03 AM

Normal temporal variations, originating in the source.

Yep

So you see you have answered your question before you asked it. Your solution lies in going after source of the problem, not the result.

Do what the studios do: Correct the luminance and range dynamics first, one captured frame at a time, then apply the colorization to the normalized source. Then you can start on Citizen Kane.

While I am flattered that you thnk im working on a citizen kane, I didnt exactly answer my own question.

(1) "shot in rhe 1960s" infers that its something inherent in the film

(2) Knowing what the issue is does not take away that I'm making a suggestion

(3) If I did what studios do, one frame at a time (which I do when working outside of A.I) then I wouldnt even bother with the plugin in the first place.

Gentlemen.

While I appreciate that you all have a prioritized list of things that you'd like to see improved, adding a request does not exactly bump it to the top of whatever roadmap Derek and his team are following.

As much as I'd like to believe that I hold sway over what they're going to work on next - I don't.

But incase I do....That audio synchronization and rumored audio engine overhaul would be very much desired.

This is DeOldify on right. source was a 360p YT video

Freezing luma values seems reasonable. Maybe a keyframe like control to start, hold and restart

This is DeOldify on right. source was a 360p YT video

Here's samples of what Delodify did for me. It's incredible


It's much smarter with pigments. VEGAS' colorization sort of makes this into a mix of colored strobes.

This is a result of the A.I being older and having had more training, which is awesome.

I think where VEGAS Colorization wins this one is the ability to manually make adjustment and see the outcome before deciding to render it. I'm sure you can always take a snapshot of the original footage and colorize that first before getting it to work on the entire video though (in Delodify)

For similar results, VEGAS Colorization would require training.

 

I think where VEGAS Colorization wins this one is the ability to manually make adjustment and see the outcome before deciding to render it. I'm sure you can always take a snapshot of the original footage and colorize that first before getting it to work on the entire video though (in Delodify)

 

Yes down the bottom is an option allows for a single frame to be rendered at various render settings to check what best works with a scene . This is something interesting I tried. it's black and white shot of ink drop in water and I wondered what would happen if the AI didn't know what it was. I"M not sure if it knew or not, It does have pulsating colours but looks much more organic then what Vegas does and might even have a use as it is

It's possible the AI believes it's water vapour and the colours it creates are light refraction

I think where VEGAS Colorization wins this one is the ability to manually make adjustment and see the outcome before deciding to render it. I'm sure you can always take a snapshot of the original footage and colorize that first before getting it to work on the entire video though (in Delodify)

 

Yes down the bottom is an option allows for a single frame to be rendered at various render settings to check what best works with a scene . This is something interesting I tried. it's black and white shot of ink drop in water and I wondered what would happen if the AI didn't know what it was. I"M not sure if it knew or not, It does have pulsating colours but looks much more organic then what Vegas does and might even have a use as it is

It's possible the AI believes it's water vapour and the colours it creates are light refraction

Amazing.

 

Anyone tried it on Röntgens:

I did.

In the red it's says: "Pretty amazing, isn't it?!".

Yeah, pretty effin amazing...GTFOH! 😂

Considering that "My Heritage" is a paid service -

I sincerely hope you didn't pay for this :p

Anyone tried it on Röntgens:

I did.

 

 

In the red it's says: "Pretty amazing, isn't it?!".

Yeah, pretty effin amazing...GTFOH! 😂

And My Heritage only does stills at this stage, but motion video is apparently on the horizon.

Plus if I read their FAQs correctly, what you work on using their service as a subscriber remains on their server and website presumably viewable by anyone who accesses their website or is also a subscriber. I wonder if copyright is also assigned to My Heritage for any images processed using their service? And even as a subscriber, a watermark is added to images processed using their service based on the rationale that the watermark will 'differentiate' colorized images from photographs originally shot in color. Mmmm! Not for me, no way.

Even if following the photos or video links under About on DeOldify's webpage, the process given is convoluted and, notwithstanding, it suggests using My Heritage because it has the latest incarnation of DeOldify.

 

Even if following the photos or video links under About on DeOldify's webpage, the process given is convoluted and, notwithstanding, it suggests using My Heritage because it has the latest incarnation of DeOldify.

Unfortunately, this is usually the consequence of Open Source Projects of this nature.

It took me about 15 minutes to grasp how to install and set things up after watching a few tutorials. The results are worth the pain.

If you're going to try it again and get it installed, when you get to uploading it - just boil tea and watch a movie or something, because the process can be really long depending on your GPU.

We are also impressed by Deoldify and worked 3 months to convert this to ONNX (for a colorization plugin). The problem is the Fast.Ai framework with different incompatible layer for ONNX.