I still don't know what the Deep Learning Models are

gary-o wrote on 2/16/2022, 6:57 PM

I decided not to install the Deep Learning Models. Can someone please explain what it is and what benefits/features are available if installed. I found a similar question on Reddit, but only a couple of vague responses. And there's no information about this in the forum, and only a vague mention on the Vegas product description page:

Built into the core of VEGAS Pro is a deep learning module designed for creativity and accelerated editing.

  • Colorization to bring black & white scenes to life
  • Content upscaling to awaken low resolution footage
  • Style transfer to mimic the look of famous artists such as Picasso & Van Gogh

What does this mean? It looks more like a collection of video effects than a core feature of the editor...(And, btw, when selecting it during installation, is "models" a typo for "module"???)

Comments

Musicvid wrote on 2/16/2022, 7:05 PM

If you don't want Artificial Intelligence effects plugins for Colorization, Upscaling, or Style Transfer, don't install the Models, it's that simple. Folks with weaker computer systems may not want to install them. If you want to understand what AI Modeling does, your best learning resource is the internet, because the terminology is not unique to Vegas.

 

Dexcon wrote on 2/16/2022, 7:40 PM

The three DLMs appear in Vegas Pro 19 as VFX:

More information about them can be found in the 'Vegas Pro 19 Features' document via the link in https://www.vegascreativesoftware.info/us/forum/vegas-pro-19-new-feature-descriptions--132372/

Cameras: Sony FDR-AX100E; GoPro Hero 11 Black Creator Edition

Installed: Vegas Pro 15, 16, 17, 18, 19, 20, 21 & 22, HitFilm Pro 2021.3, DaVinci Resolve Studio 19.0.3, BCC 2025, Mocha Pro 2025.0, NBFX TotalFX 7, Neat NR, DVD Architect 6.0, MAGIX Travel Maps, Sound Forge Pro 16, SpectraLayers Pro 11, iZotope RX11 Advanced and many other iZ plugins, Vegasaur 4.0

Windows 11

Dell Alienware Aurora 11:

10th Gen Intel i9 10900KF - 10 cores (20 threads) - 3.7 to 5.3 GHz

NVIDIA GeForce RTX 2080 SUPER 8GB GDDR6 - liquid cooled

64GB RAM - Dual Channel HyperX FURY DDR4 XMP at 3200MHz

C drive: 2TB Samsung 990 PCIe 4.0 NVMe M.2 PCIe SSD

D: drive: 4TB Samsung 870 SATA SSD (used for media for editing current projects)

E: drive: 2TB Samsung 870 SATA SSD

F: drive: 6TB WD 7200 rpm Black HDD 3.5"

Dell Ultrasharp 32" 4K Color Calibrated Monitor

 

LAPTOP:

Dell Inspiron 5310 EVO 13.3"

i5-11320H CPU

C Drive: 1TB Corsair Gen4 NVMe M.2 2230 SSD (upgraded from the original 500 GB SSD)

Monitor is 2560 x 1600 @ 60 Hz

gary-o wrote on 2/16/2022, 7:45 PM
  • Thanks "Musicvid", I did search for Deep Learning Models on the internet, and now AI Modeling as per your suggestion - and I didn't see a single mention about video editing. Hence, my question.
  • So I'm guessing these aren't so much AI models/modules but additional video effects. I guessed that colorization is to color in black & white footage, had to look up upscaling (increase resolution of an image, right?) and style transfer (mimicking the style of an image and applying it to the entire video clip, right?) Not sure what that has to do with AI or Deep Learning, so all in all quite confusing to someone who doesn't already work with these effects.

😀

RogerS wrote on 2/16/2022, 7:54 PM

It refers to the engine that powers these Fx.

Musicvid wrote on 2/16/2022, 10:45 PM

gary, Did you miss this in your search?

https://www.intel.com/content/www/us/en/analytics/data-modeling.html

gary-o wrote on 2/16/2022, 11:12 PM

gary, Did you miss this in your search?

No, I did see this listed, but it's got absolutely nothing to do with video editing as far as I can tell. But never mind, "Dexcon" provided the answer I was looking for: basically that there are three bonus FXs classed as DLM. And the "deep learning" bit is something to do with how the FXs are able to do their thing. :)

Musicvid wrote on 2/16/2022, 11:40 PM

OIC

;?)

Shawn-Giese wrote on 9/3/2022, 11:05 AM

So, the way I understand it is that these models enable a few effects. I do not see any other application of AI / ML.
https://www.intel.cn/content/dam/www/central-libraries/us/en/documents/vegas-pro-ai-solution-brief.pdf
Would be cool if we could add our own models : )

anthony-w4950 wrote on 5/28/2024, 10:42 AM

I have been using Vegas since the Sony days in 2004/2005. I can honestly say that the interface has hardly changed at all. Now onto Vegas 21, Still the same Media generators, credit rolls, effects and layout, et cetera. I downloaded the deep learning modules for Vegas 20 and unless I’m missing something I cannot actually see them in the user interface anywhere. Unless they require some online thing? I always have online disabled with software once fully installed and updated, because I’m quite old school. I have external software that does upscaling et cetera so for me, having these modules installed is pointless because as of yet I have not had any benefit from them.

Dexcon wrote on 5/28/2024, 8:59 PM

@anthony-w4950  ... If you're using Vegas Pro 21, you need the Deep Learning Models for Vegas Pro 21 - the DLMs for Vegas Pro 20 won't work in Vegas Pro 21.

If you go to the Vegas Pro listing under My Products in your MAGIX My Account, the installer will allow you to install VP21's DLM. In Vegas Pro, you'll be able to see the AI FX in the AI/ML tab in the Video FX window:

Cameras: Sony FDR-AX100E; GoPro Hero 11 Black Creator Edition

Installed: Vegas Pro 15, 16, 17, 18, 19, 20, 21 & 22, HitFilm Pro 2021.3, DaVinci Resolve Studio 19.0.3, BCC 2025, Mocha Pro 2025.0, NBFX TotalFX 7, Neat NR, DVD Architect 6.0, MAGIX Travel Maps, Sound Forge Pro 16, SpectraLayers Pro 11, iZotope RX11 Advanced and many other iZ plugins, Vegasaur 4.0

Windows 11

Dell Alienware Aurora 11:

10th Gen Intel i9 10900KF - 10 cores (20 threads) - 3.7 to 5.3 GHz

NVIDIA GeForce RTX 2080 SUPER 8GB GDDR6 - liquid cooled

64GB RAM - Dual Channel HyperX FURY DDR4 XMP at 3200MHz

C drive: 2TB Samsung 990 PCIe 4.0 NVMe M.2 PCIe SSD

D: drive: 4TB Samsung 870 SATA SSD (used for media for editing current projects)

E: drive: 2TB Samsung 870 SATA SSD

F: drive: 6TB WD 7200 rpm Black HDD 3.5"

Dell Ultrasharp 32" 4K Color Calibrated Monitor

 

LAPTOP:

Dell Inspiron 5310 EVO 13.3"

i5-11320H CPU

C Drive: 1TB Corsair Gen4 NVMe M.2 2230 SSD (upgraded from the original 500 GB SSD)

Monitor is 2560 x 1600 @ 60 Hz