Smart upscale : SD to HD, two quick questions

Bertrand-H wrote on 1/4/2021, 9:53 AM

Hi everyone,

I have read previous discussions on the "Smart Upscale" effect.

For reference, I checked :

https://www.vegascreativesoftware.info/us/forum/how-good-does-upscaling-work-in-vegas-17--118390/

https://www.vegascreativesoftware.info/us/forum/smart-upscale--104135/

https://www.vegascreativesoftware.info/us/forum/sd-hd-upconverter-plugin-for-vegas--85045/

I feel a bit confused. I would still have two questions please.

Question 1:
Smart Upscale was advertised as HD to 4k in version 14. Does it work on SD (480p to 1080p for example) as well please?
Edit : I am using version 18 of Vegas Pro.

Question 2:
One comment says it must be places before the pan/crop in the effects. Was it correct?

If so, just like below?

Thank you for helping me with those two questions.

 

Comments

VEGASPascal wrote on 1/4/2021, 2:29 PM

@Bertrand-H use it as Media effect (this is important)

Bertrand-H wrote on 1/4/2021, 2:32 PM

Ok @VEGASPascal . Thank you. I will have to find how to apply it as a media effect then.
Never used media effects before.

Does it work for SD to HD?

VEGASPascal wrote on 1/4/2021, 2:35 PM

Ok @VEGASPascal . Thank you. I will have to find how to apply it as a media effect then.
Never used media effects before.

Does it work for SD to HD?

I believe this was the initial idea of this plugin.

Bertrand-H wrote on 1/4/2021, 2:36 PM

Ok, thank you.

Musicvid wrote on 1/4/2021, 3:21 PM

You apply MedIa Effects in the

Project Media Window, not to the Event, Track, or Output Levels.

That's what he means.

https://www.vegascreativesoftware.info/us/forum/got-questions-consult-the-tutorials-first-please--120282/

 

JN- wrote on 1/4/2021, 5:43 PM

@Bertrand-H In the project Media Window, either right click the media file and select "Media FX" or select a media file, to highlight it, then click the FX button in the row of icons at the top of the window, then apply the appropriate FX.

As you select/highlight media one by one in this media project window the FX icon will change colour to indicate if it has an FX applied, or not.

If you have say applied an FX at the event level, this project Media FX icon won't reflect this state, (unless also applied at media level) but it will change colour on the event FX icon.

Last changed by JN- on 1/4/2021, 5:54 PM, changed a total of 5 times.

---------------------------------------------

VFR2CFR, Variable frame rate to Constant frame rate link to zip here.

Copies Video Converts Audio to AAC, link to zip here.

Convert 2 Lossless, link to ZIP here.

Convert Odd 2 Even (frame size), link to ZIP here

Benchmarking Continued thread + link to zip here

Codec Render Quality tables zip

---------------------------------------------

PC ... Corsair case, own build ...

CPU .. i9 9900K, iGpu UHD 630

Memory .. 32GB DDR4

Graphics card .. MSI RTX 2080 ti

Graphics driver .. latest studio

PSU .. Corsair 850i

Mboard .. Asus Z390 Code

 

Laptop… XMG

i9-11900k, iGpu n/a

Memory 64GB DDR4

Graphics card … Laptop RTX 3080

Bertrand-H wrote on 1/6/2021, 2:46 AM

Quick message to thank everyone who replied to my questions.

Out of curiosity, I took to the time to compare SmartUpscale with BCC UpRez (followed the instructions available here : ). I can tell results are a lot better with Vegas Smart Upscale on my SD sources.

set wrote on 1/6/2021, 4:52 AM

@Bertrand-H use it as Media effect (this is important)

admit it that I always apply it as VideoFX... didn't know that it should be as MediaFX.

Setiawan Kartawidjaja
Bandung, West Java, Indonesia (UTC+7 Time Area)

Personal FB | Personal IG | Personal YT Channel
Chungs Video FB | Chungs Video IG | Chungs Video YT Channel
Personal Portfolios YouTube Playlist
Pond5 page: My Stock Footage of Bandung city

 

System 5-2021:
Processor: Intel(R) Core(TM) i7-10700 CPU @ 2.90GHz   2.90 GHz
Video Card1: Intel UHD Graphics 630 (Driver 31.0.101.2127 (Feb 1 2024 Release date))
Video Card2: NVIDIA GeForce RTX 3060 Ti 8GB GDDR6 (Driver Version 551.23 Studio Driver (Jan 24 2024 Release Date))
RAM: 32.0 GB
OS: Windows 10 Pro Version 22H2 OS Build 19045.3693
Drive OS: SSD 240GB
Drive Working: NVMe 1TB
Drive Storage: 4TB+2TB

 

System 2-2018:
ASUS ROG Strix Hero II GL504GM Gaming Laptop
Processor: Intel(R) Core(TM) i7 8750H CPU @2.20GHz 2.21 GHz
Video Card 1: Intel(R) UHD Graphics 630 (Driver 31.0.101.2111)
Video Card 2: NVIDIA GeForce GTX 1060 6GB GDDR5 VRAM (Driver Version 537.58)
RAM: 16GB
OS: Win11 Home 64-bit Version 22H2 OS Build 22621.2428
Storage: M.2 NVMe PCIe 256GB SSD & 2.5" 5400rpm 1TB SSHD

 

* I don't work for VEGAS Creative Software Team. I'm just Voluntary Moderator in this forum.

VEGASPascal wrote on 1/7/2021, 2:46 PM

Quick message to thank everyone who replied to my questions.

Out of curiosity, I took to the time to compare SmartUpscale with BCC UpRez (followed the instructions available here : ). I can tell results are a lot better with Vegas Smart Upscale on my SD sources.

@lan-mLMC He compaired it

altarvic wrote on 1/8/2021, 4:06 AM

admit it that I always apply it as VideoFX... didn't know that it should be as MediaFX.

@VEGASPascal

Perhaps it would be better if the plugin notifies the user about this, as Stabilization FX did in previous versions.

VEGASPascal wrote on 1/8/2021, 5:07 AM

admit it that I always apply it as VideoFX... didn't know that it should be as MediaFX.

@VEGASPascal

Perhaps it would be better if the plugin notifies the user about this, as Stabilization FX did in previous versions.

@altarvic Smart Zoom and Smart Upscale is an old plugin but not an original VEGAS plugin with source code. Sony decided in the past to write all additional information into the help files. In newer plugins which the VEGAS team created (stabilizer, mesh warp, warp flow, tracking, Ai plugins etc.) we try to guide the user with message boxes or tooltips. Sorry... I believe, we are not able to add a message box here.

3POINT wrote on 1/8/2021, 5:54 AM

So actually Smart Zoom and Smart Upscale are "third party" plugins like Protype Titler.

@VEGASPascal Can we expect that VEGAS team will replace such not original VEGAS plugins by new VEGAS team created plugins or that they only will be added to the deprecated features list in future?

VEGASPascal wrote on 1/8/2021, 6:12 AM

So actually Smart Zoom and Smart Upscale are "third party" plugins like Protype Titler.

@VEGASPascal Can we expect that VEGAS team will replace such not original VEGAS plugins by new VEGAS team created plugins or that they only will be added to the deprecated features list in future?

The plugins works as expected... so no reason to add them as deprecated feature or to renew.

Protype Titler is loved by the community but for new users it was strange to see different text generators. The reason is more to clean up VEGAS. Projects using it will see it in the plugin window and users who prefer this are able to bring it back. I believe this is a good solution (other video editors would remove it).

The old stabilzer is a third party plugin (Mercalli) within VEGAS but limited in the resolution, MediaFX and some other issues and finally we are not able to extend it with new features... so we create our own. The community could send feature requests (like the customize region for detection) or send us some videos to improve the algorithm.

JN- wrote on 1/8/2021, 6:28 AM

@VEGASPascal Is the smart upscale equally adept at upscaling SD to say FHD? or is it as in the HELP, exclusively only HD to UHD?

Ok, just saw this ...

Does it work for SD to HD?

I believe this was the initial idea of this plugin.

 

Last changed by JN- on 1/8/2021, 6:31 AM, changed a total of 2 times.

---------------------------------------------

VFR2CFR, Variable frame rate to Constant frame rate link to zip here.

Copies Video Converts Audio to AAC, link to zip here.

Convert 2 Lossless, link to ZIP here.

Convert Odd 2 Even (frame size), link to ZIP here

Benchmarking Continued thread + link to zip here

Codec Render Quality tables zip

---------------------------------------------

PC ... Corsair case, own build ...

CPU .. i9 9900K, iGpu UHD 630

Memory .. 32GB DDR4

Graphics card .. MSI RTX 2080 ti

Graphics driver .. latest studio

PSU .. Corsair 850i

Mboard .. Asus Z390 Code

 

Laptop… XMG

i9-11900k, iGpu n/a

Memory 64GB DDR4

Graphics card … Laptop RTX 3080

3POINT wrote on 1/8/2021, 6:38 AM

Thanks for the quick response.

To my opinion, Title&Text the only official VEGAS Titler is derived from the Protype Titler. Can we expect that Title&Text will be improved with more and better features?

Indeed the legacy stabilizer was actually Mercalli2 and limited to FHD. A future request/improvement for the VEGAS stabilizer would be a CMOS/rolling shutter correction.

VEGASPascal wrote on 1/8/2021, 6:42 AM

@VEGASPascal Is the smart upscale equally adept at upscaling SD to say FHD? or is it as in the HELP, exclusively only HD to UHD?

Ok, just saw this ...

Does it work for SD to HD?

I believe this was the initial idea of this plugin.

 

It tries to enhance ("smart") and upscale on a factor of 4 (400% input). I have to check but in old VEGAS versions the help would give the example from SD to FullHD. If the resolution is smaller of the input the adjustment is easier to see.

Dexcon wrote on 1/8/2021, 6:42 AM

@3POINT  ...  

the legacy stabilizer was actually Mercalli2

That's jogged my memory to a long time ago. I think that you are spot on.

Cameras: Sony FDR-AX100E; GoPro Hero 11 Black Creator Edition

Installed: Vegas Pro 15, 16, 17, 18, 19, 20, 21 & 22, HitFilm Pro 2021.3, DaVinci Resolve Studio 19.0.3, BCC 2025, Mocha Pro 2025.0, NBFX TotalFX 7, Neat NR, DVD Architect 6.0, MAGIX Travel Maps, Sound Forge Pro 16, SpectraLayers Pro 11, iZotope RX11 Advanced and many other iZ plugins, Vegasaur 4.0

Windows 11

Dell Alienware Aurora 11:

10th Gen Intel i9 10900KF - 10 cores (20 threads) - 3.7 to 5.3 GHz

NVIDIA GeForce RTX 2080 SUPER 8GB GDDR6 - liquid cooled

64GB RAM - Dual Channel HyperX FURY DDR4 XMP at 3200MHz

C drive: 2TB Samsung 990 PCIe 4.0 NVMe M.2 PCIe SSD

D: drive: 4TB Samsung 870 SATA SSD (used for media for editing current projects)

E: drive: 2TB Samsung 870 SATA SSD

F: drive: 6TB WD 7200 rpm Black HDD 3.5"

Dell Ultrasharp 32" 4K Color Calibrated Monitor

 

LAPTOP:

Dell Inspiron 5310 EVO 13.3"

i5-11320H CPU

C Drive: 1TB Corsair Gen4 NVMe M.2 2230 SSD (upgraded from the original 500 GB SSD)

Monitor is 2560 x 1600 @ 60 Hz

VEGASPascal wrote on 1/8/2021, 6:45 AM

Thanks for the quick response.

To my opinion, Title&Text the only official VEGAS Titler is derived from the Protype Titler. Can we expect that Title&Text will be improved with more and better features?

Indeed the legacy stabilizer was actually Mercalli2 and limited to FHD. A future request/improvement for the VEGAS stabilizer would be a CMOS/rolling shutter correction.

CMOS rolling shutter correction and improvements for Titles&Text is on our (community wish) list.

JN- wrote on 1/8/2021, 11:31 AM

@VEGASPascal Is the smart upscale equally adept at upscaling SD to say FHD? or is it as in the HELP, exclusively only HD to UHD?

Ok, just saw this ...

Does it work for SD to HD?

I believe this was the initial idea of this plugin.

 

It tries to enhance ("smart") and upscale on a factor of 4 (400% input). I have to check but in old VEGAS versions the help would give the example from SD to FullHD. If the resolution is smaller of the input the adjustment is easier to see.

@VEGASPascal Thanks.

---------------------------------------------

VFR2CFR, Variable frame rate to Constant frame rate link to zip here.

Copies Video Converts Audio to AAC, link to zip here.

Convert 2 Lossless, link to ZIP here.

Convert Odd 2 Even (frame size), link to ZIP here

Benchmarking Continued thread + link to zip here

Codec Render Quality tables zip

---------------------------------------------

PC ... Corsair case, own build ...

CPU .. i9 9900K, iGpu UHD 630

Memory .. 32GB DDR4

Graphics card .. MSI RTX 2080 ti

Graphics driver .. latest studio

PSU .. Corsair 850i

Mboard .. Asus Z390 Code

 

Laptop… XMG

i9-11900k, iGpu n/a

Memory 64GB DDR4

Graphics card … Laptop RTX 3080

walter-i. wrote on 1/8/2021, 2:55 PM

CMOS rolling shutter correction and improvements for Titles&Text is on our (community wish) list.

@VEGASPascal
I would like to add a powerful voice to that!
+1

JN- wrote on 3/9/2021, 11:00 AM

It really works!

I hadn’t planned coming back here, but I was adding a simple half (Downscaling) and double (Upscaling) frame size output to my VFR2CFR util and decided to test it against VP.

Downscaling: I found that for both nvenc and cpu encoding there was nothing in it between the quality outputs of VP and ffmpeg's x264. So good news in a sense. Matching the file sizes and data rates is never perfect, but close enough.

Upscaling: I also tested the VP and ffmpeg FHD to UHD, and took the opportunity to also test the “Smart upscale” fx.

So far, unlike the downscaling test where I used both nvenc and cpu, I have only tested with nvenc, will do the cpu some time later. Later: Cpu results slightly better than Nvenc, expected.

Anyway, the VP Smart upscale fx shows a very clear quality difference compared to not using it in VP.

I left the default sensitivity at 200, the check box checked and dragged the slider to 4.

Last changed by JN- on 3/9/2021, 8:07 PM, changed a total of 3 times.

---------------------------------------------

VFR2CFR, Variable frame rate to Constant frame rate link to zip here.

Copies Video Converts Audio to AAC, link to zip here.

Convert 2 Lossless, link to ZIP here.

Convert Odd 2 Even (frame size), link to ZIP here

Benchmarking Continued thread + link to zip here

Codec Render Quality tables zip

---------------------------------------------

PC ... Corsair case, own build ...

CPU .. i9 9900K, iGpu UHD 630

Memory .. 32GB DDR4

Graphics card .. MSI RTX 2080 ti

Graphics driver .. latest studio

PSU .. Corsair 850i

Mboard .. Asus Z390 Code

 

Laptop… XMG

i9-11900k, iGpu n/a

Memory 64GB DDR4

Graphics card … Laptop RTX 3080

lenard wrote on 3/10/2021, 10:29 AM

 

Anyway, the VP Smart upscale fx shows a very clear quality difference compared to not using it in VP.

I left the default sensitivity at 200, the check box checked and dragged the slider to 4.

The main problem I see is the lack of deblocking. Not a problem if it's high bitrate low/lower resolution footage, but if it's DVD, camera phone, internet footage it quite likely will need deblocking. Luckily with the Vegas smart upscale it doesn't seem to make the artifacts worse.

There was a situation recently where I needed to source a hard to find video, and only located a 360p low quality version. left is original, middle Vegas smart upscale, right is deblocking. In my opinion the deblocked version is preferred even though it's not as sharp. If deblocking could be added as part of vegas upscale that would be great.

 

JN- wrote on 3/10/2021, 4:24 PM

The HOS tools can use many filters, set at default of Lanczos4. I tested it against the others, i.e. #1VP, #2 VP Smart upscale, #3 VFR2CFR=ffmpeg x264, bicubic=default. I found that the HOS with Lanczos4 was the best. I'm in the process of testing my util with Lanczos (not 4 just Lanczos, although maybe it is 4, ffmpeg doesn’t specify which?) to check for improvement.

The standard VP, without Smart Upscale was well behind the rest.

I'm using ffmpeg RQM testing, similar to fifoniks tool to measure quality difference.

 

Ok, brillo pads. The Lanczos flags filter I applied gives me similar upscale results to the HOS ones, for CPU encode, I’ll do the Nvenc test sometime later, nice! Later: Similar good results with Nvenc.

Last changed by JN- on 3/11/2021, 2:07 PM, changed a total of 5 times.

---------------------------------------------

VFR2CFR, Variable frame rate to Constant frame rate link to zip here.

Copies Video Converts Audio to AAC, link to zip here.

Convert 2 Lossless, link to ZIP here.

Convert Odd 2 Even (frame size), link to ZIP here

Benchmarking Continued thread + link to zip here

Codec Render Quality tables zip

---------------------------------------------

PC ... Corsair case, own build ...

CPU .. i9 9900K, iGpu UHD 630

Memory .. 32GB DDR4

Graphics card .. MSI RTX 2080 ti

Graphics driver .. latest studio

PSU .. Corsair 850i

Mboard .. Asus Z390 Code

 

Laptop… XMG

i9-11900k, iGpu n/a

Memory 64GB DDR4

Graphics card … Laptop RTX 3080