Benchmarking results continued

JN- wrote on 1/18/2020, 12:56 PM

Continued from the now locked “Benchmarking” thread ...

Moderator's Note August 2021:

Project sample for this benchmarking project can be downloaded here:

https://www.dropbox.com/s/3i4xgnhl9fmc0je/BenchmarkProject4K.zip?dl=0

(Project works in Vegas Pro 16 and newer).

The participant's benchmark entry has been changed via Google Form:

Submit your result here : https://forms.gle/2gnzmv93Ar8P1tkx8

And view the result here: https://docs.google.com/spreadsheets/d/1b3ggVifKsuT-cp2kQHjum_KnQ4-2jBmUIvzmu7BQZ34/

Thank you user @RogerS for continuing mantaining this benchmark system.

Please message him if you have questions or problems regarding the render benchmark.

----------------------

Note that the render time results are for the full project duration, the average FPS value is for the “Region 1” duration only. Please enter only the same "Average FPS" value for all of your different encoder and frame size entries.

Don't change the Project properties. Whether checking your FPS/rendering UHD or FHD, leave as is.

Templates and user data input with examples … Use similar for Nvenc, QSV, VCE, and CPU encoders.

The data rates of the 2 templates below is 24/12 for FHD and 50/28 for UHD. So irrespective of which encoder you're using, just use those data rates..

Set the Intel QSV quality slider to 4, default. If this range of 1 to 7 changes in the future leave it at whatever the default is.

My rendered out file sizes on disc. You should get somewhat similar, but not necessarily the exact same results.

FHD size = 48.9 mb ..... Data rate = 9,583 kbps ... Nvenc encoding

FHD size = 50.8 mb ..... Data rate = 9,971 kbps ... Cpu encoding

UHD size = 114 mb ..... Data rate = 22,611 kbps ... Nvenc encoding

UHD size = 117 mb ...... Data rate = 23,308 kbps ... Cpu encoding

If your output file sizes and data rates are not similar, then check that you are using the correct render template settings.

Sample User Data Input with example, text file is in the ZIP file …

Use the instructions in the screenshots below to get the Average FPS value …

If possible set the Dynamic ram Preview to zero while doing so.

Note that the region 1 section above is only used to get the average FPS value, do render out the full length project to get the various render times.

The older "Benchmarking" thread.

Back to post

Comments

JN- wrote on 2/23/2021, 5:11 AM

@Grazie Your FHD results reflect reality, i.e. the nvenc render times are faster than CPU render times. Not so for your UHD render results. You need to do the UHD test again as your CPU results are better than your Nvenc ones, that’s extremely unlikely to be correct.

Grazie wrote on 2/23/2021, 5:17 AM

@JN- and @RogerS

OK, Gents, I believe I've finished. I took the one second off the FHD. Apart from wanting faster times, this is it - yes?

JN- wrote on 2/23/2021, 5:19 AM

@Grazie No. See my last post.

Grazie wrote on 2/23/2021, 5:34 AM

@JN- Ahah! Goood catch Sir! I've further updated the CPU. Now the Nvenc is leading the race by 25 seconds.

RogerS wrote on 2/23/2021, 5:47 AM

This makes way more sense for results. Good to take the time to get it right.

This is a very good result and confirms the latest NVIDIA cards are performing well with VP 18 today.

JN- wrote on 2/23/2021, 5:59 AM

Well, that didn’t take long.

Will update results later.

JN- wrote on 2/23/2021, 7:32 AM

@Grazie @RogerS Is updated now.

Grazie wrote on 2/23/2021, 7:58 AM

@JN- Simple question, this time. Got a link?

RogerS wrote on 2/23/2021, 8:02 AM

It's a picture on the first page. Click on it, wait a bit for it to get full size and then you can drag it to a new tab to see it really clearly.

JN- wrote on 2/23/2021, 8:04 AM

@Grazie Its also updated in the zip download file, as updated spreadsheets X 3 and 2 x screenshot S1.jpg and S2.jpg.

RogerS wrote on 2/23/2021, 8:05 AM

@JN- I think line 17 is in error. It should be encode mode: CPU.

JN- wrote on 2/23/2021, 8:33 AM

@RogerS @Grazie Thanks Roger, good spot, I will update later. I have added in my own PC CPU times, which weren’t done previously. Interesting comparisons indeed.

JN- wrote on 2/23/2021, 9:38 AM

@Grazie @RogerS Is updated now.

JaredF wrote on 4/13/2021, 8:32 AM

User Name: JaredF
Machine: Dell XPS
VP Version: 18
VP Build Number: 482
CPU: Intel i7 11700K
Cores: 8
GPU: Nvidia RTX 3060 TI
iGPU: UHD 750
OC: No
Render Frame Size: FHD
HW Acc: Nvidia
Render as: Magix AVC
Envode Mode: NVENC
Render time: 0:48
AVG FPS: 11

User Name: JaredF
Machine: Dell XPS
VP Version: 18
VP Build Number: 482
CPU: Intel i7 11700K
Cores: 8
GPU: Nvidia RTX 3060 TI
iGPU: UHD 750
OC: No
Render Frame Size: UHD
HW Acc: Nvidia
Render as: Magix AVC
Envode Mode: NVENC
Render time: 1:20
AVG FPS: 11

JN- wrote on 4/13/2021, 9:57 AM

@JaredF Results are added to the s/sheets only at the download zip location. I'll update screenshots etc when you have updated with the Avg. FPS values. Thank you.

JaredF wrote on 4/14/2021, 7:01 AM

OK, results are updated above with AVG FPS.

JN- wrote on 4/14/2021, 7:44 AM

@JaredF I’ll notify shortly when updated, thanks.

JN- wrote on 4/14/2021, 8:25 AM

@JaredF Is updated now. Note that clicking on the screenshot "results" in the 1st. post in this thread can still leave it hard to make out details. If this is the case then, after clicking the screenshot, select it and drag upwards to automatically create a new tab in your browser, with the screenshot. You can then also zoom, it should be much easier to see now.

Of course the spreadsheets are also available to inspect, just download the zip.

Thanks Jared, nice to have 11th. Gen Intel added.

Yelandkeil wrote on 6/7/2021, 10:05 AM

@JN-, OK here's the new one.

SampleProject 4K - Render template 50/28 and result (117MB, 23600kbps; 115MB, 23200kbps):

   User name       : Yellandkeil
   Machine           : OB
   VP version       : 18
   VP Build number       : 527
   CPU           : Ryzen 9 5950x
   Cores           : 16
   GPU           : RX5500XT-O8G
   iGPU           : None
   OC           : No
   Render frame size       : UHD
   HW Acc.           : AMD
   Render As           : Magix AVC
   Encode mode       : CPU
   Render time       : 01m:40s
   FPS           : 6.600
   Comments       : No

   User name       : Yellandkeil
   Machine           : OB
   VP version       : 18
   VP Build number       : 527
   CPU           : Ryzen 9 5950x
   Cores           : 16
   GPU           : RX5500XT-O8G
   iGPU           : None
   OC           : No
   Render frame size       : UHD
   HW Acc.           : AMD
   Render As           : Magix AVC
   Encode mode       : VCE
   Render time       : 01m:25s
   FPS           : 6.600
   Comments       : No

SampleProject 4K - Render template 24/12 and result (51MB, 10200kbps; 50.2MB, 10100kbps):

   User name       : Yellandkeil
   Machine           : OB
   VP version       : 18
   VP Build number       : 527
   CPU           : Ryzen 9 5950x
   Cores           : 16
   GPU           : RX5500XT-O8G
   iGPU           : None
   OC           : No
   Render frame size       : FHD
   HW Acc.           : AMD
   Render As           : Magix AVC
   Encode mode       : CPU
   Render time       : 00m:41s
   FPS           : 6.600
   Comments       : No

   User name       : Yellandkeil
   Machine           : OB
   VP version       : 18
   VP Build number       : 527
   CPU           : Ryzen 9 5950x
   Cores           : 16
   GPU           : RX5500XT-O8G
   iGPU           : None
   OC           : No
   Render frame size       : FHD
   HW Acc.           : AMD
   Render As           : Magix AVC
   Encode mode       : VCE
   Render time       : 00m:39s
   FPS           : 6.600
   Comments       : No

JN- wrote on 6/7/2021, 11:50 AM

@Yelandkeil I appreciate you taking the time to do the test, thank you. This AMD CPU and it's performance will be of interest to users going forward.

Please don't take the following in any other way than that it is intended, that is, to have a conformed and similar set of results from all users, to give clarity, without unnecessary confusion.

I am posting the following items with a view to preventing a lot of backwards and forwards, in getting your results the way that's required.

Do read carefully all of the information in my very first post in this thread to assist in using the correct method for testing. If you would like to test in other ways, PRORES etc, do that in another thread. If you look at any of the other previous results you won't see any PRORES results.

#1 You mention the render templates. Please only use the samples I gave 24/12 for all FHD renders, 50/28 for all UHD renders, AMD, QSV, CPU, Nvenc etc. A simple user input form is supplied in the download zip to assist users formatting their input here in the correct way. Use it or post only similar content.

#2 This thread, already long, is ideally used for Benchmarking Results. Please open, or add to another thread, your own even, "Benchmarking Discussion thread."

#3 If you look at the existing spreadsheet or screenshots that I supply you will see that h264 and hevc are only required, no PRORES.

#4 Please update all of your post above to reflect similar to what has gone before, with other users posts here. Maybe it would be easier to delete it all and just enter the correctly required data. Study carefully what other users have entered, sometimes less is more. At the end of the day a CPU, Nvenc, QSV and AMD encode of FHD is great. If you want to do all of that again in UHD, ok, but not absolutely necessary.

#5 "Encode mode: Internet default" is not a valid entry. Please correct. The only valid Encode modes to enter are CPU, QSV, Nvenc, and VCE. Expanding them at this stage would be unnecessary. The new Intel Xe can come under QSV.

#6 You may be confused by another user on this forum who is doing his own tests. If you have results for that user don't post here. Since you have already done that, please remove all results other than for the Sample Project 4K. It might simply be better if you would delete or remove all of your post and re-post, thanks.

#7 A single FPS result value can only be used for ALL results. It will be identical, across all encode modes, so only do it once following the correct procedure outlined in my first post. The Region 1 section ONLY is used for this.

The reason I prefer not to have long discussions here, in this results thread is to make it more readable, it's already long. Maybe you or someone else could start a Benchmarking Discussion thread if it's of interest to other users.

I cannot stress strongly enough, the necessity on your part to look at other users results, for you to submit similar, and to thoroughly study the 1st. post in this thread (and the zip contents) with all of the instructions on how to submit your data.

For example, you will notice no mention of Prores, MXF, Cineform, ,AVI, .MOV etc etc.

JN- wrote on 6/7/2021, 4:14 PM

@Yelandkeil Thank you, excellent results for the AMD CPU. I have just added the three spreadsheets to the zip at the download location.

Later on tonight I will update the screenshots in the zip and in this thread at 1st post location.

I'll update you when completely done. Congrats on your new machine.

Yelandkeil wrote on 6/7/2021, 5:58 PM

@JN-💯😎

JN- wrote on 6/7/2021, 6:46 PM

@Yelandkeil Is fully updated now. Note that clicking on the two screenshot "results" (sorted on render speed and highest FPS) in the 1st. post in this thread may leave it hard to make out details, depending on viewing device.

If this is the case then, after clicking the screenshot, select it and drag it upwards to automatically create a new tab in your browser, with the screenshot. You can then also zoom the screenshot within your browser (typically CTRL and +) it should be much easier to see then.

Of course the spreadsheets and screenshots are also available in the zip. Note that these 5 files are also located outside of the zip file but within the Benchmarking download folder location. This enables viewing on a device, such as an iPad etc that otherwise may not allow viewing of the files inside of the zip.

FernC wrote on 6/28/2021, 10:56 PM

I tried this test with AMD and 3000 series GPU, I can not complete because GPU dedicated memory fills up completely when loading project. This is with default settings, ways to fix is to turn GPU decoding off, or tick Enable Legacy AVC decoding.

Has this been reported before? Hardware decoding not possible on V17 or V18 for this project

1 … 10 11 12 … 15

of 15