Surround sound -Youtube downmix to stereo coeficients?

tim-neighbors wrote on 12/20/2022, 4:00 PM

Using VP20. I'm about to output a video with surround sound and my client wants to be sure that if people play it in stereo on YouTube, that the mix will be properly represented. I haven't worked with surround much before. Am I supposed to set up some coefficients or something during export? How can I ensure that the 5.1 surround will be downmixed properly when played in stereo on YouTube?

Comments

fr0sty wrote on 12/21/2022, 8:03 AM

Testing it is the only real way to know, there really isn't much in VEGAS that you can do to guarantee that will happen, it's up to Youtube to do it right... and "we do it" doesn't always mean "we do it to your satisfaction", so be sure to test if first.

Systems:

Desktop

AMD Ryzen 7 1800x 8 core 16 thread at stock speed

64GB 3000mhz DDR4

Geforce RTX 3090

Windows 10

Laptop:

ASUS Zenbook Pro Duo 32GB (9980HK CPU, RTX 2060 GPU, dual 4K touch screens, main one OLED HDR)

Musicvid wrote on 12/21/2022, 8:29 AM

The stereo downmix flags are hard-coded into the surround metadata. Nothing mortals can or should do to change them. I don't suggest uploading PCM to Youtube.

tim-neighbors wrote on 12/21/2022, 9:53 AM

The stereo downmix flags are hard-coded into the surround metadata. Nothing mortals can or should do to change them. I don't suggest uploading PCM to Youtube.

Why not upload PCM audio to YouTube?

I saw that one can use an app called ffmpeg (think thats it) to mux a stereo and surround track together with the video and that YouTube will then choose to play the appropriate track. Any experience with doing that?

rraud wrote on 12/21/2022, 10:14 AM

For YouTube, I create a separate stereo mix from the 5:1 stems (or the timeline tracks if available). When 5:1 mixes are done by inexperienced folks, the down-mix can be unusable, I have witnessed this more than a few times at film festivals and such.

tim-neighbors wrote on 12/21/2022, 12:10 PM

For YouTube, I create a separate stereo mix from the 5:1 stems (or the timeline tracks if available). When 5:1 mixes are done by inexperienced folks, the down-mix can be unusable, I have witnessed this more than a few times at film festivals and such.

The client provided me with both 5.1 mixes and stereo mixes for this concert video. But you only recommend uploading stereo audio to YouTube? or what is the recommendation?

tim-neighbors wrote on 12/21/2022, 12:14 PM

The stereo downmix flags are hard-coded into the surround metadata. Nothing mortals can or should do to change them. I don't suggest uploading PCM to Youtube.

So as I'm the one outputting the surround audio, don't I control what goes into it's metadata? To clarify the situation, the client provided me with separate stems for each 5.1 channel as well as a stereo file. It's a concert that I shot. I'm editing my multi-cam video together with the client-provided audio from the show and the client would love to have YouTube play the sound in surround where a user has a surround system, and in stereo (or a good stereo downmix) where they do not.

Last changed by tim-neighbors on 12/21/2022, 12:15 PM, changed a total of 1 times.

Tim Neighbors
Owner, Invisible Harness Media Production

Boxx Apexx, Intel Core i9-9900 CPU @3.6GHz (overclocked to 5GHz), 8 Cores, 16 logical processors, 64Gb Ram, running Windows 10 Pro. NVidia Quadro P4000

rs170a wrote on 12/21/2022, 3:12 PM

I got curious so I went to the YouTube help page, typed in "5.1 surround", and here's some of what I got.

 

Watch YouTube on TV with 5.1 surround sound

You can watch YouTube videos on your TV with 5.1 surround sound. Enjoy YouTube’s library of shows and movies as well as other YouTube content with your supported surround sound system.

Turn 5.1 surround sound on:

Once you select a video to play, a player control bar will show. Go to 5.1 surround sound to turn it on or off.

Note: The setting will only appear for videos and devices that support 5.1 surround sound. 5.1 in YouTube is supported on all 2021 and later TVs, Chromecast, Apple TV, Roku and most Fire TV devices. In addition, many 2020 and earlier TVs may also support surround sound - check your device manufacturer to see if your device supports 5.1 for YouTube.


Here's the recommended audio codec for upload:

Audio codec: AAC-LC

Channels: Stereo or Stereo + 5.1

Sample rate 96khz or 48khz

 

HTH.

Mike

tim-neighbors wrote on 12/21/2022, 3:31 PM

I got curious so I went to the YouTube help page, typed in "5.1 surround", and here's some of what I got.

 

Watch YouTube on TV with 5.1 surround sound

You can watch YouTube videos on your TV with 5.1 surround sound. Enjoy YouTube’s library of shows and movies as well as other YouTube content with your supported surround sound system.

Turn 5.1 surround sound on:

Once you select a video to play, a player control bar will show. Go to 5.1 surround sound to turn it on or off.

Note: The setting will only appear for videos and devices that support 5.1 surround sound. 5.1 in YouTube is supported on all 2021 and later TVs, Chromecast, Apple TV, Roku and most Fire TV devices. In addition, many 2020 and earlier TVs may also support surround sound - check your device manufacturer to see if your device supports 5.1 for YouTube.


Here's the recommended audio codec for upload:

Audio codec: AAC-LC

Channels: Stereo or Stereo + 5.1

Sample rate 96khz or 48khz

 

HTH.

Mike

That's helpful ..but how does one create a video with Stereo + 5.1 surround audio out of Vegas? Do I need to use that app (ffmpeg) to mux them together? or is there an easy way within Vegas?

Former user wrote on 12/23/2022, 3:07 AM

@tim-neighbors I've done it before, and it worked. Probably just muxed together the video + stereo + 5.1 using a freeware muxer. You could also just upload the 5.1 audio and see how YT handles the downmix. It most likely creates normal stereo tracks, and probably of an acceptable quality. If you wanted to create your own Dolby ProLogic II stereo track to expand out to 5.1 surround then that would seem to be a purpose for creating your own stereo tracks + 5.1. Hardware devices will decode E-AC3/AC3, while computer users can decode the prologic II

There's a tiny chance YT actually downmix the 5.1 to pro logic 2 encodes because I've heard they downmix Dolby Atmos to DD+ 5.1 + metadata which allows Atmos to recreate the missing channels, although Prologic has nothing to do with meta data. I don't know how to test for Prologic, I suspect it's not used unless you upload Lt/Rt instead of Lo/Ro, and maybe it shouldn't be used for YT stereo bitrates

Musicvid wrote on 12/23/2022, 11:30 AM

Why not upload PCM audio to YouTube?

The potential for sync problems following Youtube processing is not worth the risk, or my time.

john_dennis wrote on 12/23/2022, 5:05 PM

@tim-neighbors

"...how does one create a video with Stereo + 5.1 surround audio out of Vegas? Do I need to use that app (ffmpeg) to mux them together? or is there an easy way within Vegas?"

Voukoder will create an AVC/AAC surround file from the Vegas Pro timeline.

See this thread.

https://www.vegascreativesoftware.info/us/forum/problem-playing-rendered-video-on-samsung-qled-tv--117334/?page=2#ca864400

You could probably render the stereo file separately and mux it with Shutter Encoder.

Howard-Vigorita wrote on 12/23/2022, 11:33 PM

Not really experienced with 5.1 but it looks like only a couple codecs I have in Vegas do it. Sony AVC/MVC worked up to HD. Voukoder also worked, but up to 4k. I set the Vegas project properties to 5.1 on the audio tab and Voukoder picked up on that without any other special setting in it's dialog except to choose the AAC (ffmpeg) audio codec. The Sony HD preset required selecting 5.1 on it's render template audio tab. The Magix and ProRes presets don't have a selection on their audio tabs and rendered stereo even when I set the project to 5.1. Also tried Voukoder opus but only got a single audio channel. Same with Oog vorbis. Only mention those because YouTube transcodes all my 4k uploads to vp9/opus but I've only ever sent them stereo.

Having as little experience as I do with 5.1 mixing, if someone gave me both stereo and 5.1 mixes, I'd be inclined to drop them into 2 different projects, as-is, and set the audio properties for each to match the audio tracks. If any level adjustment, compression, or limiting is called for, I'd try the Surround Sound version of Wave Hammer on the master bus. Then upload separately identified videos with cross-links in the description. But you might upload the 5.1 version 1st and let your client decide if YouTube's conversion to stereo is acceptable... if it is, their hit-count wouldn't be split.

Former user wrote on 12/24/2022, 3:56 AM

I tested stereo + 5.1 again, and still works as expected. I have music on the stereo track, and a surround sound helicopter on 5.1. If you listen via your computer you'll only hear the music (at least I think so), but if you're viewing through a hardware device with surround you'll hear a helicopter

Dexcon wrote on 12/24/2022, 4:08 AM

If you listen via your computer you'll only hear the music (at least I think so)

Yes, music only - using a digital connection to an amp with reasonably good monitor speakers. Great song BTW.

I didn't detect any helicopter audio, but if it were there, it certainly went over my head 😃😄😁🚁

Last changed by Dexcon on 12/24/2022, 4:16 AM, changed a total of 1 times.

Cameras: Sony FDR-AX100E; GoPro Hero 11 Black Creator Edition

Installed: Vegas Pro 15, 16, 17, 18, 19, 20, 21 & 22, HitFilm Pro 2021.3, DaVinci Resolve Studio 19.0.3, BCC 2025, Mocha Pro 2025.0, NBFX TotalFX 7, Neat NR, DVD Architect 6.0, MAGIX Travel Maps, Sound Forge Pro 16, SpectraLayers Pro 11, iZotope RX11 Advanced and many other iZ plugins, Vegasaur 4.0

Windows 11

Dell Alienware Aurora 11:

10th Gen Intel i9 10900KF - 10 cores (20 threads) - 3.7 to 5.3 GHz

NVIDIA GeForce RTX 2080 SUPER 8GB GDDR6 - liquid cooled

64GB RAM - Dual Channel HyperX FURY DDR4 XMP at 3200MHz

C drive: 2TB Samsung 990 PCIe 4.0 NVMe M.2 PCIe SSD

D: drive: 4TB Samsung 870 SATA SSD (used for media for editing current projects)

E: drive: 2TB Samsung 870 SATA SSD

F: drive: 6TB WD 7200 rpm Black HDD 3.5"

Dell Ultrasharp 32" 4K Color Calibrated Monitor

 

LAPTOP:

Dell Inspiron 5310 EVO 13.3"

i5-11320H CPU

C Drive: 1TB Corsair Gen4 NVMe M.2 2230 SSD (upgraded from the original 500 GB SSD)

Monitor is 2560 x 1600 @ 60 Hz

Howard-Vigorita wrote on 12/24/2022, 11:57 AM

Ha, ha, with a little Cavier, maybe someday we'll all be able to get those helicopters to take off... with Vegas.