Thank you for the help.

Do i understand correct, that i need to upscale the whole title first to an Sony XAVC Intra file and then put it into the 4k project?

I am not sure if i do it correct, is it supposed to only use the "upscale" plugin to position & zoom? i always did the crop in the Media crop and then simply put the upscale plugin in fron of the chain.

using the slider only now i can see a upscaled picture, but it takes VERY long to render. 7min for like 80 frames 😲

so when i edit a 30min 4k 60fps clip it will take a very long time!

Do i understand correct, that i need to upscale the whole title first to an Sony XAVC Intra file and then put it into the 4k project?

No, I'm not sure how you got that impression. Apply Upscale as a Media Effect in the Profect Media Window, and proceed according to directions.

Yes, your Project should be 4k as clearly described, as should your remaining project media and assets. Did you know that Generated Media must be initiated in the 4k project? Experiment.

Yes, it will take a very long time to render, bc Upscale uses AI modeling. That is a necessary tradeoff.

All it does (it seems) is needing longer to render.

Unfortunately, I have not been able to achieve any visible improvements with Upscale FX. With the Smooth and Sharp V2 models, a frame takes about 1 second with Sharp about 30 seconds. It may be due to the not optimally supported HW. With me it is the AMD desktop from the signature.

Legacy Smart Upscale, applied as Media FX, runs in realtime and with visible improvement. Just enable it in Preferences - Deprecated Features and restart Vegas. That should be worth a try.

Just checking ... with VP19 Upscale, the Upscale FX is being moved to be positioned before pan/crop in the FX Chain isn't it? - as advised by the Upscale FX window.

My experience with Upscale has been very, very good.

Unfortunately, I have not been able to achieve any visible improvements with Upscale FX. With the Smooth and Sharp V2 models, a frame takes about 1 second with Sharp about 30 seconds. It may be due to the not optimally supported HW. With me it is the AMD desktop from the signature.

The two Sharp models do take much longer, and are useless to me, since most of my work involves deinterlacing and those models leave ugly artifacts.

As described in some of my other posts, I simply add a Light Unsharp Mask before Upscale in the Media fx, with results I consider quite acceptable (image above).

That said, I have not tested the new Upscale with the legacy Smart Upscale, either for output quality or rendering speed.

If cropping in on media, use the slider in the upscale plugin do do the crop on the original 4k media, don't crop first then upscale. As mentioned above, the plugin needs to sit before pan/crop in the plugin chain.

@Dexcon Yes, before Event Pan/Crop, as with conventional deinterlacing, motion stabilization, and several others since VP14. That constitutes the logic for guidance to put it at the Media Level; the Vegas Help article being slightly more conservative that the fX window tooltip.

If cropping in on media, use the slider in the upscale plugin do do the crop on the original 4k media, don't crop first then upscale. As mentioned above, the plugin needs to sit before pan/crop in the plugin chain.

That is correct.

I have not tested Upscale as an Event fX sequentially before Pan/Crop; I apply it at the Media Level as advised in Help.

Upscale and also legacy Smart Upscale were used before pan/crop. I can confirm that there is (apparently) no change, even no deterioration through upscale.  Others have better experiences. Do they all have Intel HW?

All it does (it seems) is needing longer to render.

Unfortunately, I have not been able to achieve any visible improvements with Upscale FX. With the Smooth and Sharp V2 models, a frame takes about 1 second with Sharp about 30 seconds. It may be due to the not optimally supported HW. With me it is the AMD desktop from the signature.

@matthias-krutz It doesn't use discreet GPUs, that's the basic problem. On other software my rtx3080 can be running near 100% for an upscale. Maybe VP20?

The requirement is an Intel discreet GPU which still don't exist, and nobody yet knows if they're any good.

I did some testing with a 20min 4K clip recorded with AMD Adrenalin and i tried to crop with upscale and render it to xavc intra file.

Well, after 1h and an estimated end ~ 31h i stopped the process (vegas 19 used over 50gb of my 64gb Ram!)

I did expect that it might be slow, but i didn't think that it is THAT slow for a 20min clip. Is there a memory hole?

my system:

Ryzen 5950x

6900xt

64gb ddr4 3600mhz

2 .m2 drives

1 normal SSD

3 Harddisks

Ok, yesterday night i started the first upscaling clip to be rendered over night. The result looks pretty good, it was a recording done in VR with MSFS 2020.

But there is a Problem:

The rendered Video is now out of sync with the Audio Stream! I rendered lots of such videos before without upscaling, there was never a issue with the Audio.

How come the Audio is now out of sync?

I rendered in "internet UHD AMD 59.94 preset.

I tried 2x upscale on a low quality/low bitrate Instagram video. Vegas SharpV2 on Left, Topaz ProteusV3 on right. Both gave reasonable results, Topaz attempts to remove pixilaton and that would be a good optional feature for Vegas. Topaz looks more artificial

0s - 15s 1:1
15s - 40s - zoom to 1.5x
40s - end 1.5x

Vegas 3.5fps for 720p to 1440P 100% CPU, No GPU

Topaz 6.6fpz 50% CPU 20%GPU

Original: https://www.instagram.com/tv/CQ6u_nFnGmR/

I tried 2x upscale on a low quality/low bitrate Instagram video. Vegas SharpV2 on Left, Topaz ProteusV3 on right. Both gave reasonable results, Topaz attempts to remove pixilaton and that would be a good optional feature for Vegas. Topaz looks more artificial

0s - 15s 1:1
15s - 40s - zoom to 1.5x
40s - end 1.5x

Vegas 3.5fps for 720p to 1440P 100% CPU, No GPU

Topaz 6.6fpz 50% CPU 20%GPU

Original: https://www.instagram.com/tv/CQ6u_nFnGmR/

I have now good results using this upscaler, lovely feature. It's just it takes very long scaling up to 4k from a small 4k crop but the results are amazing!

I had the Audio sync problem because of unsteady framerate. Guess the upscaler does not know how to handle this, as the normal renderer never had a problem with it.

But ok, love this feature now!

The cool thing about it is, as they continue to update the deep learning models with new versions of VEGAS, this feature will only get better and better with time.

 

 

I had the Audio sync problem because of unsteady framerate. Guess the upscaler does not know how to handle this, as the normal renderer never had a problem with it.

But ok, love this feature now!

@GaryX That is interesting, was there any uniformity to the desync/drift, was it repairable, Did audio have correct timing and length but video was shorter?

It's good you were able to diagnose the problem, it sounds like a bug that could be fixed, but not certain, Optical flow slowmotion as an example does poorly with variable frame rate, it's not smooth, but this is true for all optical flow that I've seen, but It doesn't lose sync.

 

 

I had the Audio sync problem because of unsteady framerate. Guess the upscaler does not know how to handle this, as the normal renderer never had a problem with it.

But ok, love this feature now!

@GaryX That is interesting, was there any uniformity to the desync/drift, was it repairable, Did audio have correct timing and length but video was shorter?

It's good you were able to diagnose the problem, it sounds like a bug that could be fixed, but not certain, Optical flow slowmotion as an example does poorly with variable frame rate, it's not smooth, but this is true for all optical flow that I've seen, but It doesn't lose sync.

It was a Video i recorded while flying MSFS 2020 in VR. I did the record with 60fps but it looks like this framerate couldn't been archieved steady. What i changed was record with 30fps and no A/V sync problems anymore, so i guess it were the dropped frames.