NEED HELP !! in Multi-Camera Sync by Audio

iEmby wrote on 8/5/2024, 6:53 AM

I have two cameras

I sync them both with audio sync feature

but I have also an audio file WAVE which is from my client's mic, and which is i am supposed to keep in output file.

but that third audio is not syncing.

I don't know what i am doing wrong but once it did sync them all but even then, there was some offset not accurate.

please look at this clip.

PROCESSOR
     

Operating System: Windows 11 Pro 64-bit (Always Updated)
System Manufacturer: ASUS
12th Gen Intel(R) Core(TM) i7-12700 (20 CPUs), ~2.1GHz - 4.90GHz
Memory: 32GB RAM
Page File: 11134MB used, 7934MB Available
DirectX Version: DirectX 12

-----------------------------------------------

MOTHERBOARD

 

ASUS PRIME H610-CS D4
Intel® H610 (LGA 1700)
Ready for 12th Gen Intel® Processors
Micro-ATX Motherboard with DDR4
Realtek 1 Gb Ethernet
PCH Heatsink
PCIe 4.0 | M.2 slot (32Gbps) 
HDMI® | D-Sub | USB 3.2 Gen 1 ports
SATA 6 Gbps | COM header
LPT header | TPM header
Luminous Anti-Moisture Coating
5X Protection III
(Multiple Hardware Safeguards
For all-round protection)

-----------------------------------------------
EXTERNAL GRAPHIC CARD

-----------------------------------------------

INTERNAL GRAPHIC CARD (iGPU)

------------------------------------------------

LED - MONITOR

Monitor Name: Generic PnP Monitor
Monitor Model: HP 22es
Monitor Id: HWP331B
Native Mode: 1920 x 1080(p) (60.000Hz)
Output Type: HDMI

-----------------------------------------------

STORAGE DRIVE

Drive: C:
Free Space: 182.3 GB
Total Space: 253.9 GB
File System: NTFS
Model: WD Blue SN570 1TB (NVMe)

---------------O----------------

My System Info (PDF File).

https://drive.google.com/open?id=1-eoLmuXzshTRH_8RunAYAuNocKpiLoiV&usp=drive_fs

 

Also Check

VEGAS Scripts Collection By Me

GitHub Profile

My YouTube Channel Dedicated to Only VEGAS Pro Tutorials

EDITROOM : My YouTube Channel (For VEGAS Tutorials)

Comments

konstantinos-sokolas wrote on 8/5/2024, 7:21 AM

Don't worry you're not doing something wrong. The audio sync is just trash, it has a long way to go to be somewhat reliable. It cannot sync anything, even the simplest audio files. I hope they fix it in a future update, even though I don't think it'll ever be on par with top notch audio sync programs.

vegasdimitar wrote on 8/5/2024, 8:41 AM

@iEmby Hi and thanks for reaching out!

We have reworked the old multicamera feature, making it faster and providing you with 3 different modes - feel free to experiment with them and see if one them works better for you
Furthermore here is something that I notice in your workflow that might preventing you to get ideal results:
The first selected file is the reference file - the one that should stay still, while all other selected files are adapted to it. Make sure that there is enough room before it on the timeline, in case one of the other files should be moved forward - if there is not enough room the file will just be moved to the beginning of the timeline but not to the correct position (since we do NOT want to move the reference file back!)

I believe that by leaving enough room on the timeline for the sync to move the files correctly and by trying out the other modes you will get the results you want!

Please let us know whether it worked for you!

mark-y wrote on 8/5/2024, 9:04 AM

A few basics:

  • AudioSyncR from Happy Otter Scripts works, much better than Pluraleye$. There is a learning curve.
  • You can sync two files so they are aligned at one point, but unless the cameras were slaved by a connecting cable, the audio tracks will drift apart. This is called clock drift.
  • Analogy: if two rowboats are set adrift at the same time, they will never arrive at the opposite shore together. However, if you tie them together with a rope, they will arrive almost together.
  • Some people correct for clock drift by using various time stretch techniques or plugins. I don't do that, I am an audio engineer first and a videographer second.

I cut the shorter of the two files into 10 minute chunks, choosing a cut point in a quiet area, exactly at a zero waveform crossing. I then sync each chunk to the master (locked) track, either with Pluraleyes, or a prominent peak. It ends up looking like this.

There is no one-size-fits-all solution, and everyone will develop a technique that suits their own needs. Here is an example of a timeline all chopped up

iEmby wrote on 8/5/2024, 12:30 PM

@iEmby Hi and thanks for reaching out!

We have reworked the old multicamera feature, making it faster and providing you with 3 different modes - feel free to experiment with them and see if one them works better for you
Furthermore here is something that I notice in your workflow that might preventing you to get ideal results:
The first selected file is the reference file - the one that should stay still, while all other selected files are adapted to it. Make sure that there is enough room before it on the timeline, in case one of the other files should be moved forward - if there is not enough room the file will just be moved to the beginning of the timeline but not to the correct position (since we do NOT want to move the reference file back!)

I believe that by leaving enough room on the timeline for the sync to move the files correctly and by trying out the other modes you will get the results you want!

Please let us know whether it worked for you!

Thanks for response.

Sir audio syncing is working but 98% only on both camera videos.

but I have a master audio file which I need to keep as main output audio (not those camera's audios).

so that is not syncing even I am making that file as a reference file or other files as reference.

I feel it like may be syncing is not working with an audio file which is without a video stream.

multicamera syncing is working mostly well for only video + audio streams as per I am facing this issue.

 

Last changed by iEmby on 8/5/2024, 12:31 PM, changed a total of 1 times.

PROCESSOR
     

Operating System: Windows 11 Pro 64-bit (Always Updated)
System Manufacturer: ASUS
12th Gen Intel(R) Core(TM) i7-12700 (20 CPUs), ~2.1GHz - 4.90GHz
Memory: 32GB RAM
Page File: 11134MB used, 7934MB Available
DirectX Version: DirectX 12

-----------------------------------------------

MOTHERBOARD

 

ASUS PRIME H610-CS D4
Intel® H610 (LGA 1700)
Ready for 12th Gen Intel® Processors
Micro-ATX Motherboard with DDR4
Realtek 1 Gb Ethernet
PCH Heatsink
PCIe 4.0 | M.2 slot (32Gbps) 
HDMI® | D-Sub | USB 3.2 Gen 1 ports
SATA 6 Gbps | COM header
LPT header | TPM header
Luminous Anti-Moisture Coating
5X Protection III
(Multiple Hardware Safeguards
For all-round protection)

-----------------------------------------------
EXTERNAL GRAPHIC CARD

-----------------------------------------------

INTERNAL GRAPHIC CARD (iGPU)

------------------------------------------------

LED - MONITOR

Monitor Name: Generic PnP Monitor
Monitor Model: HP 22es
Monitor Id: HWP331B
Native Mode: 1920 x 1080(p) (60.000Hz)
Output Type: HDMI

-----------------------------------------------

STORAGE DRIVE

Drive: C:
Free Space: 182.3 GB
Total Space: 253.9 GB
File System: NTFS
Model: WD Blue SN570 1TB (NVMe)

---------------O----------------

My System Info (PDF File).

https://drive.google.com/open?id=1-eoLmuXzshTRH_8RunAYAuNocKpiLoiV&usp=drive_fs

 

Also Check

VEGAS Scripts Collection By Me

GitHub Profile

My YouTube Channel Dedicated to Only VEGAS Pro Tutorials

EDITROOM : My YouTube Channel (For VEGAS Tutorials)

mark-y wrote on 8/5/2024, 6:21 PM

If you forget to unlock the video from the audio track for each audio event you are trying to sync, the closest sync you can get is the length of one video frame.

Looks like that is part of what you are trying to point out to us, but I don't understand the mouse waving around.

If you want the kind of precise audio sync for professional broadcast, your cameras and recording deck will need at least Midi Freerun Timecode Sync with Genlock slaved with daisy-chained 4 pin XLR cables, or one of the newer wireless setups.

Roger Bansemer wrote on 9/5/2024, 2:07 PM

Don't worry you're not doing something wrong. The audio sync is just trash, it has a long way to go to be somewhat reliable. It cannot sync anything, even the simplest audio files. I hope they fix it in a future update, even though I don't think it'll ever be on par with top notch audio sync programs.

You're so right. The audio sync doesn't work well at all no matter how many times I try it. I'll go back to using PluralEyes. It seems like Vegas just doesn't get things right on certain features ever.

Dan-Doak wrote on 9/6/2024, 1:46 PM

I've tried syncing using Vegas 19.0, 21.0 and the trial version of 22.0. Unfortunately the Multicamera > Synchronize Audio to Align Events does NOT work. Tried all kinds of footage & cannot get Vegas to even get the sync close to lining it up. I still have Pluraleyes 3.5.1, but think it's too old to work with recent releases of Vegas. I've been disappointed with Vegas for many years. Seems like each release is getting worse and the app is unstable.

iEmby wrote on 9/6/2024, 1:59 PM

Seems like each release is getting worse and the app is unstable.

I am sorry, but I will disagree with you from the statement that the app is unstable.

VEGAS is very much stable till now. They worked alot and even i was who post most of errors and bugs. but now i face very rare crashes.

but yes. their multicamera sync update is so bad.

you can see my video it does, but not complete work.

that's why I am planning to buy Syncaila which is so perfect for these conditions.

you can sync footages even without audio or even with mismatched timecode.

Last changed by iEmby on 9/6/2024, 2:01 PM, changed a total of 1 times.

PROCESSOR
     

Operating System: Windows 11 Pro 64-bit (Always Updated)
System Manufacturer: ASUS
12th Gen Intel(R) Core(TM) i7-12700 (20 CPUs), ~2.1GHz - 4.90GHz
Memory: 32GB RAM
Page File: 11134MB used, 7934MB Available
DirectX Version: DirectX 12

-----------------------------------------------

MOTHERBOARD

 

ASUS PRIME H610-CS D4
Intel® H610 (LGA 1700)
Ready for 12th Gen Intel® Processors
Micro-ATX Motherboard with DDR4
Realtek 1 Gb Ethernet
PCH Heatsink
PCIe 4.0 | M.2 slot (32Gbps) 
HDMI® | D-Sub | USB 3.2 Gen 1 ports
SATA 6 Gbps | COM header
LPT header | TPM header
Luminous Anti-Moisture Coating
5X Protection III
(Multiple Hardware Safeguards
For all-round protection)

-----------------------------------------------
EXTERNAL GRAPHIC CARD

-----------------------------------------------

INTERNAL GRAPHIC CARD (iGPU)

------------------------------------------------

LED - MONITOR

Monitor Name: Generic PnP Monitor
Monitor Model: HP 22es
Monitor Id: HWP331B
Native Mode: 1920 x 1080(p) (60.000Hz)
Output Type: HDMI

-----------------------------------------------

STORAGE DRIVE

Drive: C:
Free Space: 182.3 GB
Total Space: 253.9 GB
File System: NTFS
Model: WD Blue SN570 1TB (NVMe)

---------------O----------------

My System Info (PDF File).

https://drive.google.com/open?id=1-eoLmuXzshTRH_8RunAYAuNocKpiLoiV&usp=drive_fs

 

Also Check

VEGAS Scripts Collection By Me

GitHub Profile

My YouTube Channel Dedicated to Only VEGAS Pro Tutorials

EDITROOM : My YouTube Channel (For VEGAS Tutorials)

johnny-s wrote on 9/6/2024, 7:18 PM

 

@Dan-Doak

"I still have Pluraleyes 3.5.1, but think it's too old to work with recent releases of Vegas"

I still use ver. 4 of Pluraleyes with latest VP version. The workaround is ..

Copy the file "PE4VegasLoader14.dll" which is in the folder .. C:\Program files\Red Giant\Pluraleyes 4\ to .. C:\ProgramData\Vegas Pro\Application Extensions\

Maybe try with your existing version and/or update to ver. 4.

 

@vegasdimitar

Just a suggestion, perhaps make a video demo of the reworked version? If it is improved then I understand that it must be disheartening with all that work and users still not finding it easy to use.

 

Last changed by johnny-s on 9/6/2024, 7:19 PM, changed a total of 1 times.

PC 1:

Intel i9-9900K

32 GB Ram

AMD Radeon XFX RX 7900 XT

Intel UHD 630

Win 10

PC 2:

AMD Ryzen 9 7950X3D 16 core CPU

64 GB Ram

Nvidia 4090 GPU

Intel A770 GPU

Win 11

 

Laptop:

Intel 11th. Gen 8 core CPU. i9-11900K

Nvidia RTX 380 GPU

Win 10

vegasdimitar wrote on 9/11/2024, 1:55 AM

Hi everyone.

The truth about the multicam sync rework is that with all our test projects the sync worked without any issues and improved the performance significantly. This was also fully confirmed by our beta test team, who get small updates frequently, and we aimed to fix any bugs that they reported.

However, obviously, there are still some ToDo-s - but we will fix them.
Or better said - we already have.

A power user contacted us and provided us with a large library of multicam projects, some of which worked but some of which did NOT. This helped us find issues in the code and resolve them. So yes - expect some changes in an upcoming update. And we are really sorry for any inconvenience caused so far.

If you want to help us further, it will be highly appreciated if you would provide us with samples of your problematic projects too - that way we can check whether all is fixed with our improvements so far or whether there is something more to do. Wetransfer is a nice option, for example. Usually, even some short sample demo is enough, just so that we can verify that the files formats, sampling rates, channel configurations, etc are all handled correctly and the sync algorithm does its job.

Thank you for your understanding

iEmby wrote on 9/11/2024, 9:17 AM

@vegasdimitar

please download three audios

two converted waves and one sound recording's original recording.

https://www.swisstransfer.com/d/595787ee-cd73-4b30-930a-9aebc3e41761

you will see it will sync those converted camera audio, but the sound recording will not sync with them.

please try.

if you can do it successfully then pls guide me how you guys did it.

thankyou

PROCESSOR
     

Operating System: Windows 11 Pro 64-bit (Always Updated)
System Manufacturer: ASUS
12th Gen Intel(R) Core(TM) i7-12700 (20 CPUs), ~2.1GHz - 4.90GHz
Memory: 32GB RAM
Page File: 11134MB used, 7934MB Available
DirectX Version: DirectX 12

-----------------------------------------------

MOTHERBOARD

 

ASUS PRIME H610-CS D4
Intel® H610 (LGA 1700)
Ready for 12th Gen Intel® Processors
Micro-ATX Motherboard with DDR4
Realtek 1 Gb Ethernet
PCH Heatsink
PCIe 4.0 | M.2 slot (32Gbps) 
HDMI® | D-Sub | USB 3.2 Gen 1 ports
SATA 6 Gbps | COM header
LPT header | TPM header
Luminous Anti-Moisture Coating
5X Protection III
(Multiple Hardware Safeguards
For all-round protection)

-----------------------------------------------
EXTERNAL GRAPHIC CARD

-----------------------------------------------

INTERNAL GRAPHIC CARD (iGPU)

------------------------------------------------

LED - MONITOR

Monitor Name: Generic PnP Monitor
Monitor Model: HP 22es
Monitor Id: HWP331B
Native Mode: 1920 x 1080(p) (60.000Hz)
Output Type: HDMI

-----------------------------------------------

STORAGE DRIVE

Drive: C:
Free Space: 182.3 GB
Total Space: 253.9 GB
File System: NTFS
Model: WD Blue SN570 1TB (NVMe)

---------------O----------------

My System Info (PDF File).

https://drive.google.com/open?id=1-eoLmuXzshTRH_8RunAYAuNocKpiLoiV&usp=drive_fs

 

Also Check

VEGAS Scripts Collection By Me

GitHub Profile

My YouTube Channel Dedicated to Only VEGAS Pro Tutorials

EDITROOM : My YouTube Channel (For VEGAS Tutorials)

Wolfgang S. wrote on 9/11/2024, 9:48 AM

VEGASDerek wrote on 9/11/2024, 12:46 PM

@VEGASDerek & team... I hope we will get a complete fix of the below problem in next big update of VP22.

https://www.vegascreativesoftware.info/us/forum/need-help-in-multi-camera-sync-by-audio--146789/

We have a significant enhancement of the audio sync feature that we hope to release with the next major update. It was a bit too big for us to effectively test and release in time for this latest patch (which we consider only a minor update).

Desktop: PC AMD 3960X, 24x3,8 Mhz * GTX 3080 Ti (12 GB)* Blackmagic Extreme 4K 12G * QNAP Max8 10 Gb Lan * Resolve Studio 18 * Edius X* Blackmagic Pocket 6K/6K Pro, EVA1, FS7

Laptop: ProArt Studiobook 16 OLED * internal HDR preview * i9 12900H with i-GPU Iris XE * 32 GB Ram) * Geforce RTX 3070 TI 8GB * internal HDR preview on the laptop monitor * Blackmagic Ultrastudio 4K mini

HDR monitor: ProArt Monitor PA32 UCG-K 1600 nits, Atomos Sumo

Others: Edius NX (Canopus NX)-card in an old XP-System. Edius 4.6 and other systems

Dan-Doak wrote on 9/14/2024, 10:03 PM

Here's a link to a small test project in Vegas Pro 21.0 (build 315).

https://drive.google.com/drive/folders/1E9PDLHGWo215HM3RRXDOmaEf6agC5ZZX?usp=drive_link

I've been working with a MAGIX representative on this issue for about a week & they have not been able to resolve my sync issue between two cameras (Sony ZV-E1 & DJI Pocket 3). I have also tried this project in the Vegas Pro 22.0 (build 122) trial version.