Wanting in-depth description of CBR, VBR, & NVENC Encoding

Kanile-Scott wrote on 5/25/2022, 8:43 AM

I’ve been working with Vegas Pro for a very long time. I currently use Vegas pro 19 and I’m familiar with lots of features in the program. However, I don’t have in-depth knowledge of certain render settings and want someone to elaborate on them.

I currently use VBR 2-pass for all my videos because I was told that it provides the best rendering quality, but the rendering times are insane, and I want to switch to GPU rendering.

I’m interested in having these questions answered.

 

1. What is CBR, VBR 1-pass, and VBR 2-pass (I want this explained in-depth)

2. Which Intel Quicksync preset provides the best quality?

3. Which NV Encoder preset provides the best quality?

4. Do the NV Encoder provide better quality than Quicksync?

5. What is RC Mode?

6. What RC Mode with the NV Encoder provides the best quality

 

My setup:

I use Windows 11

I work with Vegas Pro 19

CPU: 12th gen 12900h

RAM: 32-gb of DDR5 memory

GPU: RTX 3070 ti (150 watts)

8gb GDDR6 VRAM

Laptop: MSI GE66 Vector

Comments

j-v wrote on 5/25/2022, 9:14 AM

"Best quality" in most cases depends on your goal for rendering, that you don't tell us.

met vriendelijke groet
Marten

Camera : Pan X900, GoPro Hero7 Hero Black, DJI Osmo Pocket, Samsung Galaxy A8
Desktop :MB Gigabyte Z390M, W11 home version 24H2, i7 9700 4.7Ghz,16 DDR4 GB RAM, Gef. GTX 1660 Ti with driver
566.14 Studiodriver and Intel HD graphics 630 with driver 31.0.101.2130
Laptop  :Asus ROG Str G712L, W11 home version 23H2, CPU i7-10875H, 16 GB RAM, NVIDIA GeForce RTX 2070 with Studiodriver 576.02 and Intel UHD Graphics 630 with driver 31.0.101.2130
Vegas software: VP 10 to 22 and VMS(pl) 10,12 to 17.
TV      :LG 4K 55EG960V

My slogan is: BE OR BECOME A STEM CELL DONOR!!! (because it saved my life in 2016)

 

vkmast wrote on 5/25/2022, 9:18 AM

Re your Q. 1: please check https://www.vegascreativesoftware.com/us/video-editing/what-is-video-bitrate-and-how-change-easily/ (if you have not yet done that).

Generally, "a few" articles to peruse here https://www.vegascreativesoftware.com/us/video-editing-academy/ , section "For New & Advanced Video Editors" (see to the end of that page).

See also this thread for some related comments.

Musicvid wrote on 5/25/2022, 10:11 AM

1. What is CBR, VBR 1-pass, and VBR 2-pass (I want this explained in-depth)

This is as detailed as it gets. CBR files are bigger, VBR is more efficient. 2-pass is more precise than 1.

2. Which Intel Quicksync preset provides the best quality?

None of them provide the best quality. Software encoders are best for quality, hardware encoders are good for speed, but the QuickSync files can be twice as large.

3. Which NV Encoder preset provides the best quality?

Refer to answer #2.

4. Do the NV Encoder provide better quality than Quicksync?

Generally speaking, yes. ymmv

5. What is RC Mode?

RC stands for Rate Control. It is useful for containing bitrate spikes during internet streaming, which has a confined bandwidth.

6. What RC Mode with the NV Encoder provides the best quality

None of them provide the best quality. It is a playability feature, not a quality feature.

3POINT wrote on 5/25/2022, 11:07 AM

@Kanile-Scott Try Voukoder for Vegas and all your render questions are past.

Kanile-Scott wrote on 5/25/2022, 12:16 PM

"Best quality" in most cases depends on your goal for rendering, that you don't tell us.

I was referring to PSNR quality, SSIM quality, and the VMAF quality?

Kanile-Scott wrote on 5/25/2022, 12:18 PM

1. What is CBR, VBR 1-pass, and VBR 2-pass (I want this explained in-depth)

This is as detailed as it gets. CBR files are bigger, VBR is more efficient. 2-pass is more precise than 1.

2. Which Intel Quicksync preset provides the best quality?

None of them provide the best quality. Software encoders are best for quality, hardware encoders are good for speed, but the QuickSync files can be twice as large.

3. Which NV Encoder preset provides the best quality?

Refer to answer #2.

4. Do the NV Encoder provide better quality than Quicksync?

Generally speaking, yes. ymmv

5. What is RC Mode?

RC stands for Rate Control. It is useful for containing bitrate spikes during internet streaming, which has a confined bandwidth.

6. What RC Mode with the NV Encoder provides the best quality

None of them provide the best quality. It is a playability feature, not a quality feature.

What about in terms of PSNR quality, SSIM quality, and the VMAF quality?

Former user wrote on 5/25/2022, 1:20 PM

@Kanile-Scott .......No Hi or Hello & No Please or Thankyou for the info you've been given,?? bit rude, this isn't Google.,

RogerS wrote on 5/25/2022, 2:21 PM

1. What is CBR, VBR 1-pass, and VBR 2-pass (I want this explained in-depth)

This is as detailed as it gets. CBR files are bigger, VBR is more efficient. 2-pass is more precise than 1.

2. Which Intel Quicksync preset provides the best quality?

None of them provide the best quality. Software encoders are best for quality, hardware encoders are good for speed, but the QuickSync files can be twice as large.

3. Which NV Encoder preset provides the best quality?

Refer to answer #2.

4. Do the NV Encoder provide better quality than Quicksync?

Generally speaking, yes. ymmv

5. What is RC Mode?

RC stands for Rate Control. It is useful for containing bitrate spikes during internet streaming, which has a confined bandwidth.

6. What RC Mode with the NV Encoder provides the best quality

None of them provide the best quality. It is a playability feature, not a quality feature.

What about in terms of PSNR quality, SSIM quality, and the VMAF quality?

Search the forum for posts where such statistics are listed.

walter-i. wrote on 5/25/2022, 2:28 PM

@Kanile-Scott
Just to clarify @Former user's comments:
We are here a user to user forum, where users like to help each other in their spare time - so we are used to speaking to each other in a friendly manner.

Kanile-Scott wrote on 5/25/2022, 3:01 PM

@Kanile-Scott
Just to clarify @Former user's comments:
We are here a user to user forum, where users like to help each other in their spare time - so we are used to speaking to each other in a friendly manner.

Was I being rude in a way?

fr0sty wrote on 5/25/2022, 3:21 PM

I didn't feel you were, but some are more sensitive than others.

We have a thread somewhere around here where Musicvid did a bunch of quality tests of the various formats to show which did the best... @Musicvid, do you happen to have that link?

Systems:

Desktop

AMD Ryzen 7 1800x 8 core 16 thread at stock speed

64GB 3000mhz DDR4

Geforce RTX 3090

Windows 10

Laptop:

ASUS Zenbook Pro Duo 32GB (9980HK CPU, RTX 2060 GPU, dual 4K touch screens, main one OLED HDR)

Kanile-Scott wrote on 5/25/2022, 3:48 PM

I didn't feel you were, but some are more sensitive than others.

We have a thread somewhere around here where Musicvid did a bunch of quality tests of the various formats to show which did the best... @Musicvid, do you happen to have that link?

I understand--we all have different philosophies. I'll keep looking around and do more research.

Musicvid wrote on 5/25/2022, 7:56 PM

What about in terms of PSNR quality, SSIM quality, and the VMAF quality?

They are separate metrics. What did you want to know?. SSIM and VMAF are perceptually weighted; PSNR is mathematically weighted.

Musicvid wrote on 5/25/2022, 8:05 PM

fr0sty, Is this what you are remembering? It is a test of software intermediates: hardware encoders were left out of the tests purposely bc they do not pass muster as intermediates.

fr0sty wrote on 5/26/2022, 4:00 PM

Ah, yes, sorry.

Systems:

Desktop

AMD Ryzen 7 1800x 8 core 16 thread at stock speed

64GB 3000mhz DDR4

Geforce RTX 3090

Windows 10

Laptop:

ASUS Zenbook Pro Duo 32GB (9980HK CPU, RTX 2060 GPU, dual 4K touch screens, main one OLED HDR)

Musicvid wrote on 5/26/2022, 5:43 PM

@fr0sty so I was using the UT AVI codec in OBS, for lossless captures, but it kept choking the Windows security scan (never-ending green bar) and would need a restart to even delete, so I gave up on that idea. OBS doesn't support Magic YUV, or I would be testing the compact 4:2:0 as an alternative.

So I have settled on x264 zerolatency, which is about the compression equivalent of XDCAM-EX, and has no b-frames. I've had no troubles with webcam, but have yet to try some high-motion video.

Chief24 wrote on 5/26/2022, 7:03 PM

@Musicvid @fr0sty

I am actually using MagicYUV in OBS, as even after you had mentioned using UT AVI, I found the files about the same (size-wise), but with all the cores I have for my processor(s) (24C/48T 3960x on one machine; 16C/32T 2950X on another), I prefer MagicYUV. I can use the files in either VP 18/527 or VP 19/532. I have provided my screenshot of the settings:

MagicYUV version is 2.3.2 Ultimate

Self Build: #1 MSI TRX40 Pro Wi-Fi w/3960X (be Quiet! Dark Rock Pro TR4) @ stock; 128GB Team Group 3200 MHz; OS/Apps - WDSN850X PCI-e 4.0x4 4TB, Documents/Extras - WDSN850X PCI-e 4.0x4 4TB; XFX AMD Radeon 7900XTX (24.12.1); Samsung 32 Inch UHD 3840x2160; Windows 11 Pro 64-Bit (24H2 26100.2894); (2) Inland Performance 2TB/(2) PNY 3040 4TB PCI-e on Asus Quad M.2x16; (2) WD RED 4TB; ProGrade USB CFExpress/SD card Reader; LG 16X Blu-Ray Burner; 32 inch Samsung UHD 3840x2160.

VEGAS Pro 20 Edit (411); VEGAS Pro 21 Suite (315); VEGAS Pro 22 Suite (239) & HOS (Happy Otter Scripts); DVD Architect 7.0 (100);

Sound Forge Audio Studio 15; ACID Music Studio 11; SonicFire Pro 6.6.9 (with Vegas Pro/Movie Studio Plug-in); DaVinci Resolve (Free) 19.1.3

#2: Gigabyte TRX50 Aero D w/7960x (Noctua NH-U14S TR5-SP6) @ stock; 128GB Kingston Fury Beast RDIMM @4800 MHz; OS/Apps - Seagate Firecuda 540 2TB PCI-e 5.0x4; Documents/Extras/Source/Transcodes - 4TB WDSN850X PCI-e 4.0x4; 4TB Inland Performance PCI-e 3.0x4; 2TB Inland Performance PCI-e 4.0x4; BlackMagic PCI-e Decklink 4K Mini-Recorder; ProGrade USB SD & Micro SD card readers; LG 32 Inch UHD 3840.x2160: PowerColor Hellhound RX Radeon 7900XT (24.12.1); Windows 11 Pro 64-Bit (24H2 26100.2894)

VEGAS Pro 20 Edit (411); VEGAS Pro 21 Suite (315); VEGAS Pro 22 Suite (239) & HOS; DVD Architect 7.0 (100); Sound Forge Audo Studio 15; Acid Music Studio 11

Canon EOS R6 MkII, Canon EOS R6, Canon EOS R7 (All three set for 4K 24/30/60 Cinema Gamut/CLog3); GoPro Hero 5+ & 6 Black & (2) 7 Black & 9 Black & 10 Black & 11 Black & 12 Black (All set at highest settings - 4K, 5K, & 5.3K mostly at 29.970); Sony FDR AX-53 HandyCam (4K 100Mbps XAVC-S 23.976/29.970)

Musicvid wrote on 5/26/2022, 8:46 PM

Wow, Thanks!

Musicvid wrote on 5/26/2022, 9:15 PM

It works, going to enjoy testing. Must have appeared in a recent version.

Musicvid wrote on 5/26/2022, 11:00 PM

It works at 1080 p60 screen capture on my i5 processor with Magic YUV. and it's 4:4:4, fwiw (my screen isn't).

@Chief24 thanks again for the tip!

@Kanile-Scott  So yeah, like the man says; please give it a try and give us a report back ;?)

stevecrye wrote on 3/10/2024, 4:15 PM

1. What is CBR, VBR 1-pass, and VBR 2-pass (I want this explained in-depth)

This is as detailed as it gets. CBR files are bigger, VBR is more efficient. 2-pass is more precise than 1.

2. Which Intel Quicksync preset provides the best quality?

None of them provide the best quality. Software encoders are best for quality, hardware encoders are good for speed, but the QuickSync files can be twice as large.

3. Which NV Encoder preset provides the best quality?

Refer to answer #2.

4. Do the NV Encoder provide better quality than Quicksync?

Generally speaking, yes. ymmv

5. What is RC Mode?

RC stands for Rate Control. It is useful for containing bitrate spikes during internet streaming, which has a confined bandwidth.

6. What RC Mode with the NV Encoder provides the best quality

None of them provide the best quality. It is a playability feature, not a quality feature.

This is nice!

Sorry for hijacking an old thread, but I was wondering about RC Mode and yours's was the best answer I found. In VP 20, the RC Mode has three options: CBR, VBR-peak constrained, and VBR - latency constrained. If my goal is to reduce banding artifacts, what would you recommend? I understand peak-constrained, but latency constrained has me scratching my head. My footage is 4K 4:2:0 100 Mbps GoPro paragliding, lots of sky and clouds with panning movements. Quite challenging to render without banding artifacts. Target audience is YouTube. I've been trying a lot of different settings and not seeing much differences. Mostly using the Magix AMD VCE h.264 and h.254 formats.

Thanks,

Steve

V20 build 411 Windows 11 22H3 on ASUS ProArt Z790 Creator WiFi, i9-14900O with 64 GB G.Skill DDR5 XMP. On board graphics is Intel UHD 770, discrete graphics ASUS AMD Dual Radeon RX 7600 XT OC 16GB.  Boot drive Seagate IronWolf 110 980GB, Vegas Project drive Samsung 870 EVO 4TB, Vegas Temp drive Seagate FireCuda 2TB Solid State Hybrid Drive Performance SSHD .
Cameras: Various GoPro, Panasonic GH6 with an assortment of Panasonic Leica lenses.

RogerS wrote on 3/10/2024, 6:11 PM

VBR and increase the bitrate. It you want better file size efficiency try Mainconcept.