Benchmarking results continued

Comments

RogerS wrote on 6/29/2021, 1:16 AM

Looking at the results from page 1 there are completed renders with the 3060Ti and 3080. Is dynamic ram preview set to the default of 200MB or 0? Can you go to help/driver update and share a screenshot of your driver? This project should work on any version of Vegas from VP 16 on.

JN- wrote on 6/29/2021, 2:44 AM

I tried this test with AMD and 3000 series GPU, I can not complete because GPU dedicated memory fills up completely when loading project. This is with default settings, ways to fix is to turn GPU decoding off, or tick Enable Legacy AVC decoding.

Has this been reported before? Hardware decoding not possible on V17 or V18 for this project

@FernC I could only complete the UHD test on my Acer i7-6700HQ laptop until after I set Dynamic Ram preview to zero and increased the built in ram from 16 to 32gb, That test also used VP16, which may not be available to you.

If you can do a FHD test thats fine. The Nvidia RTX 3000 series cards are currently not optimised for non trivial projects within VP such as this 4k project. This shows up in the poorer than expected Nvenc HW encode test, CPU encode will be fine. They do perform as expected for Nvenc HW encoding with trivial projects that have say no FX in the project.

If this is improved in a future VP version then any users that have already posted 3000 series card results can update their test results again, if they wish to do so.

The reason users wished to have a UHD, 4K project like this to do benchmarking with was that the FHD version, and similar like the older Red Car test, were insufficient to properly test playback, as modern powerful machines would often easily give full FPS playback with those FHD projects. It did mean though that older machines like my Acer laptop then struggled with the 4k project, when attempting to render at UHD.

 

Last changed by JN- on 6/29/2021, 3:14 AM, changed a total of 5 times.

---------------------------------------------

VFR2CFR, Variable frame rate to Constant frame rate link to zip here.

Copies Video Converts Audio to AAC, link to zip here.

Convert 2 Lossless, link to ZIP here.

Convert Odd 2 Even (frame size), link to ZIP here

Benchmarking Continued thread + link to zip here

Codec Render Quality tables zip

---------------------------------------------

PC ... Corsair case, own build ...

CPU .. i9 9900K, iGpu UHD 630

Memory .. 32GB DDR4

Graphics card .. MSI RTX 2080 ti

Graphics driver .. latest studio

PSU .. Corsair 850i

Mboard .. Asus Z390 Code

 

Laptop… XMG

i9-11900k, iGpu n/a

Memory 64GB DDR4

Graphics card … Laptop RTX 3080

Howard-Vigorita wrote on 6/29/2021, 5:04 PM

I tried this test with AMD and 3000 series GPU, I can not complete because GPU dedicated memory fills up completely when loading project. This is with default settings, ways to fix is to turn GPU decoding off, or tick Enable Legacy AVC decoding.

Has this been reported before? Hardware decoding not possible on V17 or V18 for this project


@FernC Here's something else you can try that might be helpful if it narrows the issue with the 3000-series Nvidia boards. I just uploaded a couple of modified SampleProject Vegas project files that mute out or replace the footage and some of the generated media. If one of those is the culprit, knowing that might be helpful to Vegas developers fixing the problem. Hopefully the problem is not pervasive. The zip is on a google cloud drive here and contains an explanatory text file:

https://drive.google.com/file/d/1h9QJ2g9ClnqO7H1XvKb2CdN196o_rEFG/view?usp=sharing

JN- wrote on 6/29/2021, 6:43 PM

@Howard-Vigorita This isn’t a general discussion thread, I have asked other users to mostly keep their contributions here in this thread to their results for this Benchmarking project. Thats why its called “Benchmarking results continued” They have mostly done that and I thank them for that, it prevents it rambling all over the place. Of course that's my preference and I can only ask that.

FernC posted here because, as I understand it, he was attempting, has the intention, to complete the results and post here but couldn’t.

You have already removed your results from this project and have made clear your dislike of the methods that I have used. You have no wish to post your results here. Anyone else that is unaware of your antipathy towards this Benchmarking project by you only have to look at your posts from pages 4/5 onwards in the original Benchmarking project that this continues on from.

I fail to understand why you continue to post here, given your stated dislike of my methodology. I do understand that when you lost the users vote to host the benchmarking project to JV's that you were disappointed, and so you are now doing what is best for you, making up your own Benchmarking projects, good luck with that, but please accept that my preference going forward is for users to post their results here. It goes without saying that users may also wish to contribute to your own benchmarking projects, in which case you can use it also for a general discussion on benchmarking if that’s appropriate.

Last changed by JN- on 6/29/2021, 7:08 PM, changed a total of 4 times.

---------------------------------------------

VFR2CFR, Variable frame rate to Constant frame rate link to zip here.

Copies Video Converts Audio to AAC, link to zip here.

Convert 2 Lossless, link to ZIP here.

Convert Odd 2 Even (frame size), link to ZIP here

Benchmarking Continued thread + link to zip here

Codec Render Quality tables zip

---------------------------------------------

PC ... Corsair case, own build ...

CPU .. i9 9900K, iGpu UHD 630

Memory .. 32GB DDR4

Graphics card .. MSI RTX 2080 ti

Graphics driver .. latest studio

PSU .. Corsair 850i

Mboard .. Asus Z390 Code

 

Laptop… XMG

i9-11900k, iGpu n/a

Memory 64GB DDR4

Graphics card … Laptop RTX 3080

Howard-Vigorita wrote on 6/29/2021, 10:20 PM

@JN- Just participating in a discussion of a specific problem running the benchmark which I also use and support. Participated in by yourself and others. But I can understand your wanting this thread to only contain posts of results and not discussion about them... in that case we really need a related thread for the discussion. I think you would probably be the most appropriate host for that. Or perhaps the admins could split off off all the discussion posts here into another thread to separate them from the timing posts and unclutter this one.

IAM4UK wrote on 7/3/2021, 9:30 AM

User Name: IAM4UK
Machine:  Cinema PC
VP Version:  18
VP Build Number:  527
CPU: Intel i7 11700K
Cores:  8
GPU:  AMD VEGA_64 Frontier
iGPU:  UHD 750
OC:  No
Render Frame Size:  FHD 1920x1080
HW Acc:  AMD
Render as:  Magix AVC
Encode Mode:  VCE
Render time:  1:12
AVG FPS (Region 1):  11.08 fps


User Name:  IAM4UK
Machine:  Cinema PC
VP Version:  18
VP Build Number:  527
CPU:  Intel i7 11700K
Cores:  8
GPU:  AMD VEGA_64 Frontier
iGPU:  UHD 750
OC:  No
Render Frame Size:  FHD 1920x1080
HW Acc:  OFF
Render as:  Magix AVC
Encode Mode:  Mainconcept AVC (CPU)
Render time:  1:17
AVG FPS (Region 1):  11.08 fps


User Name:  IAM4UK
Machine:  Cinema PC
VP Version:  18
VP Build Number:  527
CPU:  Intel i7 11700K
Cores:  8
GPU:  AMD VEGA_64 Frontier
iGPU:  UHD 750
OC:  No
Render Frame Size:  UHD 3840x2160
HW Acc:  AMD
Render as:  Magix AVC
Encode Mode:  VCE
Render time:  2:27
AVG FPS (Region 1):  11.08 fps


User Name:  IAM4UK
Machine:  Cinema PC
VP Version:  18
VP Build Number:  527
CPU:  Intel i7 11700K
Cores:  8
GPU:  AMD VEGA_64 Frontier
iGPU:  UHD 750
OC:  No
Render Frame Size:  UHD 3840x2160
HW Acc:  OFF
Render as:  Magix AVC
Encode Mode:  Mainconcept AVC (CPU)
Render time:  3:02
AVG FPS (Region 1):  11.08 fps        

JN- wrote on 7/3/2021, 11:41 AM

@IAM4UK Hi, thank you for posting your results. Just saw them now.

Please update the avg. fps value to a single same value for all 4 tests, it cannot be otherwise once users don't change the project properties.

Not sure if HW Acc. can be CPU, will look at that later. Update: Currently can be Amd, Intel, Nvidia and OFF.

I'm away from PC now but will notify you later when I have updated all of your updated results.

I see that you and JaredF have the new UHD 750 and i7-11700k CPU, nice.

If you are having trouble getting the Intel QSV encoder to work, you can try some of this, though you may have done so already.

In Options/Preferences/File I/O uncheck Enable legacy AVC and hevc decoding. Hardware decoder to use you can experiment with, probably doesn't matter.

Under the "General" tab confirm "Enable QSV encoding ... " is checked.

Under the "Video" tab experiment with the two options (GPU Acceleration of Video Processing) that you should have, AMD and Intel GPU's.

Last changed by JN- on 7/3/2021, 2:02 PM, changed a total of 4 times.

---------------------------------------------

VFR2CFR, Variable frame rate to Constant frame rate link to zip here.

Copies Video Converts Audio to AAC, link to zip here.

Convert 2 Lossless, link to ZIP here.

Convert Odd 2 Even (frame size), link to ZIP here

Benchmarking Continued thread + link to zip here

Codec Render Quality tables zip

---------------------------------------------

PC ... Corsair case, own build ...

CPU .. i9 9900K, iGpu UHD 630

Memory .. 32GB DDR4

Graphics card .. MSI RTX 2080 ti

Graphics driver .. latest studio

PSU .. Corsair 850i

Mboard .. Asus Z390 Code

 

Laptop… XMG

i9-11900k, iGpu n/a

Memory 64GB DDR4

Graphics card … Laptop RTX 3080

IAM4UK wrote on 7/3/2021, 2:19 PM

Thanks for the info, @JN-
I changed "(CPU)" to "OFF" for the HW Accel lines that reflected CPU renders. I averaged the averages of fps; I had not understood those instructions, I guess (but I did use only the Region you specified).
These benchmarks make sense to me; however, I also just did some "new" 4K Red Car benchmarks, and only 1 of my 4 results made any sense on that project.
The bottom line for me on my upgraded CPU (replaced i7-6850K) is that my preview performance is much better (I still render to MagicYUV intermediates for this purpose), and my render speeds for typical 1080p24 AVC outputs are fast enough for time-constrained projects.

JN- wrote on 7/3/2021, 2:28 PM

@IAM4UK “I averaged the averages of fps” Great. This has occurred with several users.

Do you want to do a QSV fhd/uhd render? or is it N/A.

---------------------------------------------

VFR2CFR, Variable frame rate to Constant frame rate link to zip here.

Copies Video Converts Audio to AAC, link to zip here.

Convert 2 Lossless, link to ZIP here.

Convert Odd 2 Even (frame size), link to ZIP here

Benchmarking Continued thread + link to zip here

Codec Render Quality tables zip

---------------------------------------------

PC ... Corsair case, own build ...

CPU .. i9 9900K, iGpu UHD 630

Memory .. 32GB DDR4

Graphics card .. MSI RTX 2080 ti

Graphics driver .. latest studio

PSU .. Corsair 850i

Mboard .. Asus Z390 Code

 

Laptop… XMG

i9-11900k, iGpu n/a

Memory 64GB DDR4

Graphics card … Laptop RTX 3080

JN- wrote on 7/3/2021, 5:50 PM

@IAM4UK I have updated the SS's only at the download location. Can you let me know if you are going to do the QSV HW renders? Then I will update the Screenshots.

---------------------------------------------

VFR2CFR, Variable frame rate to Constant frame rate link to zip here.

Copies Video Converts Audio to AAC, link to zip here.

Convert 2 Lossless, link to ZIP here.

Convert Odd 2 Even (frame size), link to ZIP here

Benchmarking Continued thread + link to zip here

Codec Render Quality tables zip

---------------------------------------------

PC ... Corsair case, own build ...

CPU .. i9 9900K, iGpu UHD 630

Memory .. 32GB DDR4

Graphics card .. MSI RTX 2080 ti

Graphics driver .. latest studio

PSU .. Corsair 850i

Mboard .. Asus Z390 Code

 

Laptop… XMG

i9-11900k, iGpu n/a

Memory 64GB DDR4

Graphics card … Laptop RTX 3080

JN- wrote on 7/3/2021, 6:08 PM

I suspect that the Nvidia 3000 series GPU's (with respect to Nvenc encoding) may not be fully optimised for non-trivial projects such as this Benchmarking project. They appear ok for trivial projects.

If I find that with a subsequent VP version/build that that changes it's my intention to "tag" (if that's the correct term) all users here that have Nvidia 3000 series cards and have submitted results. They might be interested in updating their Nvenc results, or not.

Last changed by JN- on 7/3/2021, 6:19 PM, changed a total of 1 times.

---------------------------------------------

VFR2CFR, Variable frame rate to Constant frame rate link to zip here.

Copies Video Converts Audio to AAC, link to zip here.

Convert 2 Lossless, link to ZIP here.

Convert Odd 2 Even (frame size), link to ZIP here

Benchmarking Continued thread + link to zip here

Codec Render Quality tables zip

---------------------------------------------

PC ... Corsair case, own build ...

CPU .. i9 9900K, iGpu UHD 630

Memory .. 32GB DDR4

Graphics card .. MSI RTX 2080 ti

Graphics driver .. latest studio

PSU .. Corsair 850i

Mboard .. Asus Z390 Code

 

Laptop… XMG

i9-11900k, iGpu n/a

Memory 64GB DDR4

Graphics card … Laptop RTX 3080

IAM4UK wrote on 7/4/2021, 7:36 AM

@IAM4UK

Do you want to do a QSV fhd/uhd render? or is it N/A.

@JN- I will not be doing the QSV renders.

Even following the earlier instructions about File I/O and General settings, QSV is not available among certain render profiles. It may be because I don't hook up the mobo PCIe power, and only hook up the VEGA_64 GPU PCIe power? Or maybe the default is for onboard video to be disabled when dedicated GPU is present? I don't know, but am not bothered by using the VCE-capable VEGA_64 instead of QSV.

JN- wrote on 7/4/2021, 7:59 AM

@IAM4UK Aok, thats perfectly fine. I’ll post here later when the screenshots are updated and done. Thanks.

---------------------------------------------

VFR2CFR, Variable frame rate to Constant frame rate link to zip here.

Copies Video Converts Audio to AAC, link to zip here.

Convert 2 Lossless, link to ZIP here.

Convert Odd 2 Even (frame size), link to ZIP here

Benchmarking Continued thread + link to zip here

Codec Render Quality tables zip

---------------------------------------------

PC ... Corsair case, own build ...

CPU .. i9 9900K, iGpu UHD 630

Memory .. 32GB DDR4

Graphics card .. MSI RTX 2080 ti

Graphics driver .. latest studio

PSU .. Corsair 850i

Mboard .. Asus Z390 Code

 

Laptop… XMG

i9-11900k, iGpu n/a

Memory 64GB DDR4

Graphics card … Laptop RTX 3080

JN- wrote on 7/4/2021, 8:37 AM

@IAM4UK All updated now.

Note that clicking on the two screenshot "results" (sorted on render speed and highest FPS) in the 1st. post in this thread may leave it hard to make out details, depending on viewing device.

If this is the case then, after clicking the screenshot, select it and drag it upwards to automatically create a new tab in your browser, with the screenshot. You can then also zoom the screenshot within your browser (typically CTRL and +) it should be much easier to see then.

Of course the spreadsheets and screenshots are also available in the zip. Note that these files are also located outside of the zip file but within the Benchmarking download folder location. This enables viewing on a device, such as an iPad etc that otherwise may not allow viewing of the files inside of the zip.

---------------------------------------------

VFR2CFR, Variable frame rate to Constant frame rate link to zip here.

Copies Video Converts Audio to AAC, link to zip here.

Convert 2 Lossless, link to ZIP here.

Convert Odd 2 Even (frame size), link to ZIP here

Benchmarking Continued thread + link to zip here

Codec Render Quality tables zip

---------------------------------------------

PC ... Corsair case, own build ...

CPU .. i9 9900K, iGpu UHD 630

Memory .. 32GB DDR4

Graphics card .. MSI RTX 2080 ti

Graphics driver .. latest studio

PSU .. Corsair 850i

Mboard .. Asus Z390 Code

 

Laptop… XMG

i9-11900k, iGpu n/a

Memory 64GB DDR4

Graphics card … Laptop RTX 3080

ScorpioOfShadows wrote on 7/31/2021, 11:36 AM

i tried to download the project sample but it says file has been deleted

RogerS wrote on 8/27/2021, 11:09 PM

i tried to download the project sample but it says file has been deleted

@ScorpioOfShadows Please try the first page of this thread again. There are new links to download the project and to upload data using an online form (multiple submissions for different render resolutions, etc. allowed).

ScorpioOfShadows wrote on 8/28/2021, 3:47 AM

i tried to download the project sample but it says file has been deleted

@ScorpioOfShadows Please try the first page of this thread again. There are new links to download the project and to upload data using an online form (multiple submissions for different render resolutions, etc. allowed).

It worked. Thank you

TheRhino wrote on 9/8/2021, 5:39 PM

After installing V19 I ran all of the benchmarking tests on my 9900K/VEGA 64 & 11700K/VEGA 56 systems & got about the same render times as before for both VCE & QSV renders... However, as others noted elsewhere on the forums, I'm getting slightly better Preview performance & pre-render appears to be able to use more RAM and generally works better than before. My VEGAs are older, so I'm interested if anyone is seeing improvements with the newer AMD & Nvidia GPUs...

Workstation C with $600 USD of upgrades in April, 2021
--$360 11700K @ 5.0ghz
--$200 ASRock W480 Creator (onboard 10G net, TB3, etc.)
Borrowed from my 9900K until prices drop:
--32GB of G.Skill DDR4 3200 ($100 on Black Friday...)
Reused from same Tower Case that housed the Xeon:
--Used VEGA 56 GPU ($200 on eBay before mining craze...)
--Noctua Cooler, 750W PSU, OS SSD, LSI RAID Controller, SATAs, etc.

Performs VERY close to my overclocked 9900K (below), but at stock settings with no tweaking...

Workstation D with $1,350 USD of upgrades in April, 2019
--$500 9900K @ 5.0ghz
--$140 Corsair H150i liquid cooling with 360mm radiator (3 fans)
--$200 open box Asus Z390 WS (PLX chip manages 4/5 PCIe slots)
--$160 32GB of G.Skill DDR4 3000 (added another 32GB later...)
--$350 refurbished, but like-new Radeon Vega 64 LQ (liquid cooled)

Renders Vegas11 "Red Car Test" (AMD VCE) in 13s when clocked at 4.9 ghz
(note: BOTH onboard Intel & Vega64 show utilization during QSV & VCE renders...)

Source Video1 = 4TB RAID0--(2) 2TB M.2 on motherboard in RAID0
Source Video2 = 4TB RAID0--(2) 2TB M.2 (1) via U.2 adapter & (1) on separate PCIe card
Target Video1 = 32TB RAID0--(4) 8TB SATA hot-swap drives on PCIe RAID card with backups elsewhere

10G Network using used $30 Mellanox2 Adapters & Qnap QSW-M408-2C 10G Switch
Copy of Work Files, Source & Output Video, OS Images on QNAP 653b NAS with (6) 14TB WD RED
Blackmagic Decklink PCie card for capturing from tape, etc.
(2) internal BR Burners connected via USB 3.0 to SATA adapters
Old Cooler Master CM Stacker ATX case with (13) 5.25" front drive-bays holds & cools everything.

Workstations A & B are the 2 remaining 6-core 4.0ghz Xeon 5660 or I7 980x on Asus P6T6 motherboards.

$999 Walmart Evoo 17 Laptop with I7-9750H 6-core CPU, RTX 2060, (2) M.2 bays & (1) SSD bay...

RogerS wrote on 9/8/2021, 5:54 PM

Feel free to submit your results if you like.
In other threads Howard and I also found minimal differences between 18 and 19 making re-benchmarking not so interesting at this point. If future builds of 19 come out with some performance improvements it would be good to redo.

Former user wrote on 9/8/2021, 6:54 PM

In a project I was just testing with VP18 39seconds, VP19 29 seconds, VP19 is using 100% CPU while VP18 only maxes out in the 80's . File is 4K60AVC, with 10 BCC transitions , rendered to 1080P60. I don't think the transitions are important, the increase in CPU happens in area without transition or any GPU effect. This is why with your benchmarks you guys may not be seeing any changes. If every part of your project has a GPU effect applied the results may stay the same.

To check I could add a lut to both and see if speeds are now the same

 

RogerS wrote on 9/8/2021, 7:00 PM

This thread is for one particular benchmark project. Please find it on page 1 and you can submit results for both VP 18 and 19. Howard does tests with other benchmarks as well ("Red car"). Techgage uses MedianFx to really push the CPUs. There are many approaches to assessing performance, but let's focus on this particular benchmark in this thread.

Former user wrote on 9/8/2021, 7:12 PM

If I did those benchmarks I have no doubt I'd agree with the results you guys are seeing, no change, but there is change only you're not seeing it with the benchmarks you choose. They are good benchmarks though more representing real world, but for some people who are doing basic cuts and transitions without coloring they may see an advantage with VP19 of 25% increase in render performance

Former user wrote on 9/8/2021, 8:06 PM

Guys you have to change up your benchmarks you're not giving VP19 the accolades it deserves

VP19 in my benchmark test 29 seconds, with Track FX Vegas Autolooks Conception 32 seconds

VP18 same project 39 seconds, with Track FX Vegas Autolooks Conception 54 seconds

 

This are huge improvements, and the most amazing I was still getting 100% CPU with the Autolooks GPU processing engaged. I thought that would reduce CPU, but it didn't. These are ground breaking performance increases and these benchmarks are blind to them

RogerS wrote on 9/8/2021, 8:49 PM

Hi Todd, please create a new thread with your benchmark results and methodology. Even better if you can create a project in VP 18 and make it and sample media available for others to download and test. I would not include paid 3rd party Fx as most users won't have access to them.

Keeping a consistent benchmark to compare systems and versions of Vegas over the years is exactly the thing that gives this benchmark value! That is why I agreed to help keep this particular benchmark going.

There are many potential methodologies which test different aspects of Vegas, but consistency and getting a variety of systems to submit results is the more important thing. You are welcome to submit your own results.