Standard Media Files For Rendering Comparisons And Benchmarking

red-diamond wrote on 10/17/2020, 4:04 PM

Does Vegas Pro (or anyone) have any standardized media files for rendering speed tests for the sake of testing/comparing hardware or for troubleshooting? It would be the same 5 minute video with grading, some VFX and other typical mods used to make to a video, but it would be in true 720, 1080 and 4K; in 24, 25, 30 & 50/60 frame rates and in say 35, 50, 100 & 400 mb/s data rates and in MOV, HEVC, MP4, RED and AVC codecs. Yeah its a lot of clips, but it would make bench marking with new hardware reliable and comparable. it would let one know whether they have the right gear to create and render a project. The more I think about it, the more I think its something that VCS should put out for us.

Comments

Musicvid wrote on 10/17/2020, 4:22 PM

That would be a daunting undertaking, providing every flavor of uniform source for testing.

The better model is "one" source, of sufficiently high quality and characteristics to test any number of encoders comparatively. Of those, two are commonly mentioned:

The red car test, noted in FAQ #29 here. https://www.vegascreativesoftware.info/us/forum/vegas-pro-faqs-and-troubleshooting-guides--104787/
The newer benchmark discussion started by @JN- here, and it's continuation linked at the end of that thread. https://www.vegascreativesoftware.info/us/forum/benchmarking--116285/?page=1

You will learn a lot. That said, the answer to your initial question and closing opinion is, "Sure, when you (not "they") create them."

michael-harrison wrote on 10/17/2020, 4:49 PM

With my software background I'd (reasonably IMO) hope thate Magix has a broad set of files for testing exactly as you are asking about.

They're unlikely to create a standard repo for others to use though.

JN- wrote on 10/18/2020, 9:42 AM

@red-diamond This is the link to the users Benchmarking thread.

red-diamond wrote on 10/18/2020, 4:35 PM

I saw the Red Car video test before but the spreadsheet test is brilliant..Thanks for the advice and comments.

Howard-Vigorita wrote on 10/18/2020, 9:23 PM

I keep the original Red Car as well as the original with updated 4k avc and hevc media online here. I also keep my personal testing spreadsheet online here.

red-diamond wrote on 10/21/2020, 2:19 PM

I ran the benchmark video in v15, v16 and v17. My AMD R9-390 rendered FHD in 01:02 but for the 4K test Vegas wouldn't render in 4K using the MAGIX Internet 4K 2160-25 (AMD VCE) engine. I get the error code shown in the screenshot. I tried other render engines to no avail. I CAN run it using my i7-4400k CPU but that took 05:01. I also tried various bit rate settings. Any ideas?