Can i speed up Upscaling to 4k? [V20/B411]

Silentium_Tremendum wrote on 9/30/2023, 12:21 PM

Hi.

1st i wish to thank to Vegas developers on your fix of upscaling, which is improved from build 214.

 

Anyway here is the problem.

When i use 1080p video and i want to upscale it to 2160p and i use Scaling: x4, Model: Smooth, my renders are really fast and i dont complain about that. I rendered that 14min video with this setting in just few minutes.

But when i set same thing with Scaling (x4) and when i put Model on Denoise, things start to get really slow.

Image quality is really good with Denoise compared to Smooth. Smooth gives little difference from original video, but Denoise model really makes the difference, but at the cost of render speed.

So im wondering is there any way to speed up the proces? Im getting my average fps speed when rendering at 0.02 fps, and for same 14min video i need to render it 8 days. So is that speed normal for such upscaling settings? My pc is good and i dont know is there anything else i can do to speed up this proces without loosing image quality ofc?

Also i would like to know what hardware is used the most for upscaling? CPU, GPU, RAM or what? When i render i see only that my RAM (Memory) is used, while CPU barely works at all, which is weird to me, bc i think CPU should be used the most for upscaling. I tried different render profiles (GPU, CPU and 3rd one), with same results.

 

Im using Vegas 20 (Build 411)
CPU: AMD Ryzen 9 5950x
GPU: RTX 3080
RAM: 64GB 3200mhz
SSD: M.2 Samsung 980 Pro
Motherboard: ROG Crosshair VIII Hero (Wi-Fi)
Windows 11 Pro

ty

Comments

mark-y wrote on 9/30/2023, 12:43 PM

Thanks for a good question.

"Smooth" is basically no model. "Denoise" is an Artificial Intelligence model that puts a heavy load on resources. Even the older "kernel" plugin denoisers are incredibly slow bc they are computationally intensive.

If playing with your GPU options doesn't get you any improvement, I am afraid that is the best you will get. BTW, Topaz Video AI is even slower than Vegas, on many systems.

I avoid the AI models completely when using Upscale, choosing instead to place a very light Unsharp Mask plugin in the Media Effects chain, before the Upscale plugin. That has the dual effect of reducing shadow noise with an overall perceived sharpness, without blowing the highlights.

Former user wrote on 9/30/2023, 9:06 PM

Denoise option doesn't work for me, Uses up all my VRAM and Ram and stalls Windows. I am using latest Nvidia Studio drivers

Former user wrote on 10/1/2023, 12:08 PM

Three times i tried this with 3 different clips, 1920x1080 clip on a 3840x2160 project, Upscale - Denoise froze my whole PC inc mouse, it took a minute of the fans going in the PC before it sorted itself out. (& closed Vegas)

Silentium_Tremendum wrote on 10/1/2023, 12:13 PM

I avoid the AI models completely when using Upscale, choosing instead to place a very light Unsharp Mask plugin in the Media Effects chain, before the Upscale plugin. That has the dual effect of reducing shadow noise with an overall perceived sharpness, without blowing the highlights.

I tried that but speed is the same. Image is lil bit brighter with Unsharp, but thats all as i was able to see. For me the main problem is speed of rendering with the Upscale plugin, which i consider useless bc it seems todays PC's hardware is to low for such technology. Maybe in 10y it will be better and worth using.

Anyway ty for trying.

mark-y wrote on 10/1/2023, 4:34 PM

You are entirely welcome.

Former user wrote on 10/1/2023, 5:58 PM

Three times i tried this with 3 different clips, 1920x1080 clip on a 3840x2160 project, Upscale - Denoise froze my whole PC inc mouse, it took a minute of the fans going in the PC before it sorted itself out. (& closed Vegas)

@Former user Identical problem, was starting to think a bad driver install, although I've never had a bad install other than when changing GPU's in and out and also GPU drivers did not crash causing monitors to lose signal. Interesting to see Vegas didn't eat up all your ram which I had thought was responsible for my freeze

Could others try that out, see how you go. From the experiences of Gid and myself wait a minute before doing something rash like force restarting your computer if you experience the same problem

GINO-PERROTTA wrote on 1/21/2024, 6:11 PM

I just upgrade to Vegas 21 Pro. When I use the UPSCALE effect, I can't see any difference on the timeline I rendered it any way but the image came out scrambled see attached screenshots. First image is the timeline the second is that project rendered

Former user wrote on 1/21/2024, 10:01 PM

@GINO-PERROTTA i've seen people present with that problem before, but don't remember the fix. You could try the free Capcut upscaler (online) in the meantime. This is VHS upscaled 2x by capcut, similar pro's and con's to topaz. The common criticism of the Vegas upscaler is that it's slow and results are suble but maybe that's all you need.

Howard-Vigorita wrote on 1/21/2024, 10:50 PM

@GINO-PERROTTA Not clear where you applied it but I don't see blue FX dots on your video events... it's supposed to be applied as an event FX and appear in front of Pan/Crop in the FX chain. It's an AI-FX dependent on the matching Deep Learning Module so make sure you upgraded that too. The video hardware selected in Video Preferences is used, so make sure that driver is up to date also. Btw, if you can't get the AI-FX Upscale working there's an older one in Vegas you can enable in Deprecated Features called Smart Zoom... it's quicker, isn't as high quality, does not use AI, but might work better with a weaker gpu.

Former user wrote on 1/21/2024, 11:33 PM

@Howard-Vigorita I was able to replicate his problem at various upscale ratios using media fx, this is at 1.2x , 2x is fine

Anyway this is Vegas upscale original/denoise/sharp. Denoise looks like the one to use, I get 6-7fps, which actually isn't so bad compared to topaz

GINO-PERROTTA wrote on 1/22/2024, 7:53 AM

Thank you, I'll try again later. The reason the screenshot doesn't show the effect is because this screenshot was supposed the show the image as is without any effects. I first tried to apply the effect at the track level, I couldn't see the pan/crop there. Then I applied it at the end of the clip. I didn't see any difference but decided to render it, I rendered two times the first as HD the second time as just NTS The second screenshot is the result. I could see in the preview window what was happening as it was rendering but I let finish. Thank you

 

mark-y wrote on 1/22/2024, 8:43 AM

@GINO-PERROTTA Disortion of the Preview after applying upscale is sometimes the result of certain Intel Graphics drivers.

One test is to turn off "GPU Acceleration of Video Processing" in your Vegas preferences. Does this make the problem go away after restarting Vegas? Make sure your graphics are the latest recommended version.

Howard-Vigorita wrote on 1/22/2024, 9:45 AM

@Former user Not able to get those raster distortion effects like yours on my laptop (3060+Iris). Either for test renders or playing. I tried some old mpg media still on my drive that was originally captured probably by vp19 from dvd as well as 4k. Tried various upscales between 1 and 4. My Nvidia was selected in gpu prefs and was doing all the AI. Driver versions are in my signature. Also tried vp20, which was allot slower doing upscale than vp21, but no distortion either.

I've never tried upscaling a dvd with the Upscale FX before. Don't really have a clue how best to accomplish that. I've only ever used upscale on 4k footage in selected spots to zoom-in just enough to crop unwanted stuff out of the frame.

GINO-PERROTTA wrote on 1/22/2024, 3:40 PM

I tried two things 1).unchecked use GPU processing for Aces Color management. That didn't work.

2)I turned off Optimal Nivdia force GPU acceleration. That didn't work either.

I get the same results.

I was looking forward to use this effect, I have many old videos!

Thank you.

 

GINO-PERROTTA wrote on 1/23/2024, 3:13 PM

Thank you

Todd-A0 wrote on 1/22/2024, 12:33 AM

I see above you were able to duplicate the problem. I noticed on your screenshot the SCALING SLIDE, left side of the screen, appears to be operational, on my computer it is gray out not working. As is the effect works like a zoom but can't be rendered.

Vegas support told me to clear cache. I did and started a new project with the same file the same problem showed up.

Reading the instructions about using the effects it say something about learning module, I don't know what that is and how to use it. I downloaded and installed every thing that came with the program.

Do you know where I can find an instructional video specific on how to use this effect?

Thank you.

Gino

Former user wrote on 1/23/2024, 10:42 PM

@GINO-PERROTTA I noticed when you get that visual weirdness that Howard described as raster distortion the GPU isn't actually doing anything, so that could be your problem, but why doesn't it work? It could be that your media and project is the same resolution. to upscale your project resolution should be higher than your media. This would still be a bug, Vegas shouldn't do that.

You can see for whatever reason I get the distortion at 1.1x and 1.2x and the GPU is doing nothing, as soon as I raise the Upscale to 1.3x the GPU is activated. This is using upscale via media fx, that's why the slider is not grayed out, you can choose any value.

When you choose upscale via Video Event FX or Video Event Pancrop Vegas will choose the multiplier for you based on the media clip you're using, and the project dimensions. This sample VHS media is 386P so If I chose Pancrop via Video Event FX it will chose the value 2.8x because my project is 1080P - 386p x 2.8 = 1080.8p

Also maybe Howard's answer above is the correct solution https://www.vegascreativesoftware.info/us/forum/can-i-speed-up-upscaling-to-4k-v20-b411--142809/#ca903538

 

GINO-PERROTTA wrote on 1/24/2024, 7:31 AM

I think this is above my head. I thought UPSCALE meant you load a SD grainy video, apply the effect and it would improve.

Let me clarify. I loaded my old grainy video, I applied the UPSCALE Effect I see no difference in the preview, I move the lever on the right it acts as a zoom, if I move the dot in the rectangular box to the left, it acts a positional zoom.

I rendered a little section, I the ALL rendered video came out as you see it in the screenshot posted above. Note the scrambling was showed in the display as it was rendered. If someone can replicate the problem, it should be easy to fix by working backwards. Probably there is something in properties checked that shouldn't be.

Thank you

Gino

RogerS wrote on 1/24/2024, 7:59 AM

@GINO-PERROTTA Is your project resolution still SD? Above it says 720x480. If it's the same as the media resolution upscale won't do anything.

Try a greater project resolution (4K?) render it and compare to the original and see if it's much better. Personally I find it inconsistent/not always useful and sometimes just adding unsharp mask and letting VEGAS do a regular upscale is close enough and much faster.

Howard-Vigorita wrote on 1/24/2024, 8:59 AM

I got similar non-results when I tested it. What I did was load my sd video captured to mpg, set project to hd, put Upscale FX on the event, left all parameters at default, and rendered hd twice... with and without the fx active. Both renders tested as identical. Obviously not the right way to do it. Choosing the Sharpen model does make it look much better... perhaps more natural than the Sharpen FX which does not use Deep Learning. Perhaps stacking a 2nd instance of Upscale in the chain running the Denoise model would be even better. Can't think of an objective way to measure either so you'd have to judge it by eye.

Btw, not able to replicate any scrambling on my laptop with 3060 doing the AI running 546.33 driver.

GINO-PERROTTA wrote on 1/24/2024, 1:01 PM

Thank you Roger. I resolved the problem with the scramble rendering for now, with an update to my video card. I did what you suggested. Maybe it's just me, maybe I don't know how to use this effect but I don't see any difference. The effect works well as a zoom tool! I can get better results by using contrast or any other effects. I f anyone has better results I would like to see a before and after small clip done using this effect. Thank you

Former user wrote on 1/24/2024, 5:55 PM

@GINO-PERROTTA For the amount of work (GPU processing) the results are poor but there is a difference in example I posted, but not a 2.8x increase in resolution difference, also a lack of smoothness in motion, if you look at the balloons with denoise they are more clear, it's more noticeable again with the sharpen option but much more artifacting, poorer result, it may work better with high quality media, not vhs quality. The online capcut upscaler works more like you'd expect but is overly aggressive and has some strange warping.

Also the way you expected it to work is actually how other upscalers work, you give it 480P media, set upscaler to 1x (480P) output and it denoises and depending on media increases the effective resolution of the 480P media, making it clearer. I don't use the Vegas upscaler and judging by lack of responses few do and now you know why.

GINO-PERROTTA wrote on 1/25/2024, 7:40 AM

Todd It appears you started with a good footage, mine has a lot of noise. I also noticed your slider upper left moves as the video proceed. Mine doesn't move it is not doing anything see screenshot

Former user wrote on 1/25/2024, 4:13 PM

@GINO-PERROTTA Right click on your clip in the timeline choose media fx then add upscale. Make sure you have Upscale FX removed from video event FX and anywhere else it's been added. You would use this if in my example project I did not want Vegas choosing 2.8x, for best quality I may have established 2x is as much as I want to upscale.

As mentioned I don't use this Vegas feature, maybe to get best results you're supposed to chain denoise with the sharpening, you'd add the denoise fx first. That's going to be very slow, Smooth chained with sharpen will use a lot less GPU, maybe that gives ok results. I use more effective upscalers and don't have any experience with this one. I just try it out, note it's not for me, and move on.

GINO-PERROTTA wrote on 1/26/2024, 12:58 PM

Thank you for the help. Maybe I had high expectations. Any other effect I use I can see the difference in the preview window. With this effect I don't see any difference, even after rendering I don't see any difference. I use a 42" TV Monitor differences show immediately. I am a musician when I try a new audio effect if I need to to A-B more then a few times to hear a difference the effect is not worth anything.