Video files with multiple stereo tracks cause severe issues.

DNLP26 wrote on 1/1/2019, 10:36 PM

Many video game capture tools support multiple audio inputs, and splitting them to different channels for ease of use later. when importing these files to vegas, it often causes severe issues. audio files will be scrambled, the two tracks switching between each other sporadically the longer the file goes on. also zooming the audio waveform shows bits that were not there prior to zooming. and I don't mean it's expanding, I mean the waveform was flat and now it's not. this even affects normalizing audio, as if you normalize the segment zoomed out and calculate the amount to gain then zoom in, the new audio that appears (chunks of the other stereo track) are clipped far beyond the bounds.

I am currently using Vegas Pro 15, but this issue also plagued Movie Studio 13/14 platinum when I used them.

then we zoom in a tick...

this is extremely sporadic and behavior varies each time I do it, if i relaunch vegas or even ctrl-Z in the same session, sometimes different segments will be messed up than before.

System is Windows 10 Pro October 2018 update, i3-8350k (stock clock speeds) 2*8GB DDR4-2400, GTX 1070.

 

Also worth mentioning, sometimes software will just crash when importing these files, and typically, the longer i try to edit these files, the worse it gets, typically within five minutes, playback previewing will stop working. the preview screen doesn't go black or anything, if i hit space, and the play button under the preview icon turns blue, but it's frozen. going to a different application window (like file explorer or a brower) then tabbing back to vegas and stopping then starting preview again sometimes fixes it.

edit: updated with clearer image.

Comments

NickHope wrote on 1/1/2019, 10:40 PM

Please provide more information including your VP15 build and the details of your media: https://www.vegascreativesoftware.info/us/forum/important-information-required-to-help-you--110457/

DNLP26 wrote on 1/1/2019, 10:52 PM

Sorry!

Version 15.0 (Build 416)

General
Complete name                  : F:\nvShare\Gameplay\Tom Clancy's Rainbow Six  Siege\Tom Clancy's Rainbow Six  Siege 2018.06.03 - 22.08.52.10.DVR.mp4
Format                         : MPEG-4
Format profile                 : Base Media / Version 2
Codec ID                       : mp42 (isom/mp42)
File size                      : 264 MiB
Duration                       : 1 min 15 s
Overall bit rate               : 29.4 Mb/s
Recorded date                  : 2018
Encoded date                   : UTC 2018-06-04 02:08:52
Tagged date                    : UTC 2018-06-04 02:08:52

Video
ID                             : 1
Format                         : AVC
Format/Info                    : Advanced Video Codec
Format profile                 : High@L4.2
Format settings, CABAC         : Yes
Format settings, RefFrames     : 1 frame
Format settings, GOP           : M=1, N=30
Muxing mode                    : Container profile=High@1.3
Codec ID                       : avc1
Codec ID/Info                  : Advanced Video Coding
Duration                       : 1 min 15 s
Bit rate                       : 29.0 Mb/s
Width                          : 1 920 pixels
Height                         : 1 080 pixels
Display aspect ratio           : 16:9
Frame rate mode                : Variable
Frame rate                     : 57.031 FPS
Minimum frame rate             : 55.181 FPS
Maximum frame rate             : 62.674 FPS
Original frame rate            : 60.000 FPS
Standard                       : PAL
Color space                    : YUV
Chroma subsampling             : 4:2:0
Bit depth                      : 8 bits
Scan type                      : Progressive
Bits/(Pixel*Frame)             : 0.245
Stream size                    : 260 MiB (99%)
Title                          : VideoHandle
Encoded date                   : UTC 2018-06-04 02:08:52
Tagged date                    : UTC 2018-06-04 02:08:52
Color range                    : Limited
Color primaries                : BT.601 NTSC
Transfer characteristics       : BT.470 System M
Matrix coefficients            : BT.601
mdhd_Duration                  : 75345

Audio #1
ID                             : 2
Format                         : AAC
Format/Info                    : Advanced Audio Codec
Format profile                 : LC
Codec ID                       : 40
Duration                       : 1 min 15 s
Source duration                : 1 min 15 s
Bit rate mode                  : Constant
Bit rate                       : 192 kb/s
Nominal bit rate               : 96.0 kb/s
Channel(s)                     : 2 channels
Channel positions              : Front: L R
Sampling rate                  : 48.0 kHz
Frame rate                     : 46.875 FPS (1024 SPF)
Compression mode               : Lossy
Stream size                    : 1.71 MiB (1%)
Source stream size             : 1.71 MiB (1%)
Title                          : SoundHandle / System sounds
Encoded date                   : UTC 2018-06-04 02:08:52
Tagged date                    : UTC 2018-06-04 02:08:52
mdhd_Duration                  : 75136

Audio #2
ID                             : 3
Format                         : AAC
Format/Info                    : Advanced Audio Codec
Format profile                 : LC
Codec ID                       : 40
Duration                       : 1 min 15 s
Source duration                : 1 min 15 s
Bit rate mode                  : Constant
Bit rate                       : 192 kb/s
Nominal bit rate               : 96.0 kb/s
Channel(s)                     : 2 channels
Channel positions              : Front: L R
Sampling rate                  : 48.0 kHz
Frame rate                     : 46.875 FPS (1024 SPF)
Compression mode               : Lossy
Stream size                    : 1.75 MiB (1%)
Source stream size             : 1.75 MiB (1%)
Title                          : SoundHandle / Microphone
Encoded date                   : UTC 2018-06-04 02:08:52
Tagged date                    : UTC 2018-06-04 02:08:52
mdhd_Duration                  : 75136

 

also, here is vegas's info:

General
  Name: Tom Clancy's Rainbow Six  Siege 2018.06.03 - 22.08.52.10.DVR.mp4
  Folder: F:\nvShare\Gameplay\Tom Clancy's Rainbow Six  Siege
  Type: AVC
  Size: 270.07 MB (276,556,473 bytes)
  Created: Sunday, June 3, 2018, 9:08:52 PM
  Modified: Sunday, June 3, 2018, 9:08:54 PM
  Accessed: Thursday, June 14, 2018, 12:47:40 PM
  Attributes: Archive

Streams
  Video: 00:01:15.345, 57.031 fps progressive, 1920x1080x32, AVC
  Audio 1: 00:01:15.092, 48,000 Hz, Stereo, AAC
  Audio 2: 00:01:15.092, 48,000 Hz, Stereo, AAC

Summary
  [TCFM]: 1

ACID information
  ACID chunk: no
  Stretch chunk: no
  Stretch list: no
  Stretch info2: no
  Beat markers: no
  Detected beats: no

Other metadata
  Regions/markers: no
  Command markers: no

Media manager
  Media tags: no

Plug-In
  Name: so4compoundplug.dll
  Folder: D:\VEGAS\FileIO Plug-Ins\so4compoundplug
  Format: AVC
  Version: Version 1.0 (Build 8532)
  Company: MAGIX Computer Products Intl. Co.

 

and here is a sample of the audible corruption (captured with stereo mix)

windows 10 is build 17134 which means I'm actually april 2018 update.

NickHope wrote on 1/1/2019, 11:19 PM

What app did you record with?

DNLP26 wrote on 1/2/2019, 9:16 AM

What app did you record with?

Nvidia Share, foremorely known as shadowplay. files play back normally in mpc-hc with both audio tracks selectable and intact.

NickHope wrote on 1/2/2019, 10:56 AM

Unfortunately Shadowplay files with multiple audio streams tend to cause problems in Vegas Pro and there is no quick fix for it. You can force Vegas to use different decoders (compoundplug or mcmp4plug2 instead of the default so4compoundplug) but then that causes other issues. Here's a discussion about that: https://www.vegascreativesoftware.info/us/forum/issue-with-compoundplug-crashing-vp13-and-15-for-certain-mp4-files--109202/

 

 

Musicvid wrote on 1/2/2019, 11:29 AM

Your video is variable frame rate. As has been demonstrated several times in the preceding months, it will usually not work in Vegas without conversion. This is one major cause of audio problems, with or without so4.

This option from Nick using OBS works, apparently solid as a rock.

https://www.vegascreativesoftware.info/us/forum/faq-what-obs-studio-settings-work-well-with-vegas-pro--109925/

No, OBS does not have a 30 second buffer like Shadowplay.

DNLP26 wrote on 1/2/2019, 12:39 PM

Good to know, I will try re-encoding with constant 60 before taking into vegas. (and trying OBS for future recordings)

IIRC, OBS does actually have a configurable recording buffer for saving video/audio after the fact, just like nvidia's option. it just doesn't have NvFBC or NvIFR which are a huge chunk of what makes nvidia's option so lightweight. NvENC helps and OBS does support that for encode though.

edit: re-encoding to 60 in handbrake helps a ton, even then the secondary audio track still has issues (but the primary isn't scrambled, and the secondary only cuts out on the left channel after a minute without being scrambled so it's workable to use the footage now), which suggests the file is actually troublesome/dealing with the output nvidia provides, or just that variable frame rate combined with multiple audio tracks is a nightmare for editors/conversion in general. thanks again!

I wish I could tag you both as solution, because both of you were helpful.

Musicvid wrote on 1/2/2019, 1:31 PM

just that variable frame rate combined with multiple audio tracks is a nightmare for editors/conversion in general.

That is the correct interpretation.

Long GOP video exists as 1 or 2 frames of actual images for each 300-400 frames of predictive instructions (just math). Your player works without decoding all those instructions to raw bits in memory. Vfr is pretty much indecipherable to encoders, who must deconstruct each frame back to actual pixels, making the virtual file easily 100 times larger than the compressed version!

Thanks for marking a solution!

NickHope wrote on 1/3/2019, 12:01 AM

Note that if your file is something like the other Shadowplay file in that thread I linked to, then there are probably workarounds that don't involve re-encoding. For example, from that thread:

"...You're going to have to rewrap or transcode something to get this working. Simplest would be to decode with mcmp4plug2 and render your audio out to WAV files. Then decode with so4compoundplug, delete the audio tracks and bring in the WAV files. Be careful of sync..."

The details of how to switch those decoders are in parts 6 & 7 the 2nd thread I linked to.