HappyOtter AudioSyncR - a new tool for syncing audio

wwaag wrote on 7/13/2021, 10:26 PM

AudioSyncR is a new tool from Happy Otter Software. Since it is not part of Happy Otter Scripts, its own thread seemed warranted. The new extension designed specifically for Vegas Pro has the following features:

  • Waveform matching of audio events and loop regions with reference audio track
  • User selection of which events and tracks are to be synced
  • Syncing support for nested projects
  • Syncing support for multi-stream audio
  • Optional pre-syncing using timestamp metadata
  • Options for adding synced audio to event as a take or to new track
  • Drift detection and correction by adjusting Vegas playback rate
  • Synced events are moved to align with reference track or can remain in same position with synced audio added as a take

 

Here's a screen grab of the UI.

And some demos.

 

To get a trial https://tools4vegas.com/trial/

For licensing and introductory pricing Information https://tools4vegas.com/get-a-license/

Last changed by wwaag

AKA the HappyOtter at https://tools4vegas.com/. System 1: Intel i7-8700k with HD 630 graphics plus an Nvidia RTX4070 graphics card. System 2: Intel i7-3770k with HD 4000 graphics plus an AMD RX550 graphics card. System 3: Laptop. Dell Inspiron Plus 16. Intel i7-11800H, Intel Graphics. Current cameras include Panasonic FZ2500, GoPro Hero11 and Hero8 Black plus a myriad of smartPhone, pocket cameras, video cameras and film cameras going back to the original Nikon S.

Comments

Musicvid wrote on 7/15/2021, 9:11 AM

+1. Get the trial.

wwaag wrote on 7/15/2021, 3:53 PM

I've just added another demo for syncing audio events in multi-stream media files, which like nested projects, cannot be done in PE.

https://tools4vegas.com/wp-content/uploads/MultiTrackDemo.mp4

AKA the HappyOtter at https://tools4vegas.com/. System 1: Intel i7-8700k with HD 630 graphics plus an Nvidia RTX4070 graphics card. System 2: Intel i7-3770k with HD 4000 graphics plus an AMD RX550 graphics card. System 3: Laptop. Dell Inspiron Plus 16. Intel i7-11800H, Intel Graphics. Current cameras include Panasonic FZ2500, GoPro Hero11 and Hero8 Black plus a myriad of smartPhone, pocket cameras, video cameras and film cameras going back to the original Nikon S.

Vegas_Pro_Brasil wrote on 7/15/2021, 6:24 PM

Now we can say that Vegas finally has a good sync tool. The price is affordable and the results are very good.

JN- wrote on 7/15/2021, 6:59 PM

Spoken like a true salesman.

---------------------------------------------

VFR2CFR, Variable frame rate to Constant frame rate link to zip here.

Copies Video Converts Audio to AAC, link to zip here.

Convert 2 Lossless, link to ZIP here.

Convert Odd 2 Even (frame size), link to ZIP here

Benchmarking Continued thread + link to zip here

Codec Render Quality tables zip

---------------------------------------------

PC ... Corsair case, own build ...

CPU .. i9 9900K, iGpu UHD 630

Memory .. 32GB DDR4

Graphics card .. MSI RTX 2080 ti

Graphics driver .. latest studio

PSU .. Corsair 850i

Mboard .. Asus Z390 Code

 

Laptop… XMG

i9-11900k, iGpu n/a

Memory 64GB DDR4

Graphics card … Laptop RTX 3080

studio-4 wrote on 7/20/2021, 8:41 PM

Wow!

asus laptop system specifications:
Asus 17.3" Republic of Gamers Strix G17 model: 77H0ROG1.
Ryzen 9 5900HX 3.3GHz (4.6GHz boost), eight-core CPU.
Nvidia GeForce RTX 3060 (6GB GDDR6).
32GB Crucial 3200MHz DDR4 (x2 16GB 120-pin SO-DIMMs).
512GB M.2 NMVe PCIe SSD (available second M.2 slot).

OS: installed on 7/1/2021:
Windows 10 Home 64-bit; OS version 20H2; build 19042.1052.
Windows Feature Experience Pack 120.2212.2020.0.

asus laptop installed applications:
Vegas Movie Studio 17 Platinum; version 17.0 (build 221); purchased via download 29 May 2021.
Microsoft Edge (default browser; no plug-ins).

asus laptop OpenFX add-ons:
BorisFX Continuum 2021.5 (subscription).
NewBlue Elements 3 Overlay.

HP desktop system specifications:
HP Z440 Intel Xeon E5-1650 v3 3.5GHz (4GHz-boost), quad-core CPU.
32GB DDR4 ECC RAM.
1TB SATA SSD.
AMD Radeon RX470 4GB
AMD Radeon R7200.

OS:
Windows 10 Pro 64-bit; OS version 20H2; build 19042.985.
Windows Feature Experience Pack 120.2212.2020.0.

HP desktop installed applications:
Vegas Movie Studio 17 Platinum; version 17.0 (build 221); purchased via download 29 May 2021.
Blackmagic Design Media Express 2.3 for Windows 10.
WinDV 1.2.3.
Microsoft Edge (default browser; no plug-ins).

HP desktop OpenFX add-ons:
FXhome Ignite Advanced VFX pack.
BorisFX' Stylize Unit 2020.5.
NewBlue Elements 3 Overlay.

cameras/VTRs:



Sony NEX-FS100 Super35 1080p24/50/60 digital-cine camera.
Sony NEX-FS700 Super35 1080p24/50/60/240/960 high-speed digital-cine camera.
Sony NEX-5R APS-C 1080p60 cameras (x3).
Sony DSR450WSL 2/3" 480p24 16:9 DVCAM camera.
Sony VX1000 1/3" 480i60 4:3 miniDV camera.
Sony DSR11 DVCAM VTR.

personal websites:

YouTube channel: modularfilms

photography/iighting website: http://lightbasics.com/

Musicvid wrote on 7/20/2021, 9:37 PM

Wish we had this back in '07, Back then, PE2 couldn't touch some tracks, and we ended up chopping them into 10 minute chunks and eyeballing the waveforms. Took 3 weeks just for the audio!

wwaag wrote on 8/14/2021, 5:05 PM

Last 2 days. Introductory pricing for AudioSyncR--50% off. Expires Aug 15. For more info. https://tools4vegas.com/get-a-license/

Last changed by wwaag on 8/14/2021, 5:05 PM, changed a total of 1 times.

AKA the HappyOtter at https://tools4vegas.com/. System 1: Intel i7-8700k with HD 630 graphics plus an Nvidia RTX4070 graphics card. System 2: Intel i7-3770k with HD 4000 graphics plus an AMD RX550 graphics card. System 3: Laptop. Dell Inspiron Plus 16. Intel i7-11800H, Intel Graphics. Current cameras include Panasonic FZ2500, GoPro Hero11 and Hero8 Black plus a myriad of smartPhone, pocket cameras, video cameras and film cameras going back to the original Nikon S.

fr0sty wrote on 8/14/2021, 6:04 PM

I will get this, as soon as I can... COVID has the wallet thin these days. Thanks for developing this!

Last changed by fr0sty on 8/14/2021, 6:04 PM, changed a total of 1 times.

Systems:

Desktop

AMD Ryzen 7 1800x 8 core 16 thread at stock speed

64GB 3000mhz DDR4

Geforce RTX 3090

Windows 10

Laptop:

ASUS Zenbook Pro Duo 32GB (9980HK CPU, RTX 2060 GPU, dual 4K touch screens, main one OLED HDR)

Musicvid wrote on 8/14/2021, 7:26 PM

Last 2 days. Introductory pricing for AudioSyncR--50% off. Expires Aug 15. For more info. https://tools4vegas.com/get-a-license/

I highly recommend it -- It's only a fraction of the cost of Pluraleyes -- and it works better on my old show tapes.

marcinzm wrote on 9/1/2021, 10:16 AM

I have a long video files from different video camera angles. I was recording them on wedding. While clicking "Start" button in AudioSyncR, I get the error regarding exceeded maximum file size for wav format. I suppose it is because of wave file prerendered files set. I should set wave64. Where can I set wave64 for prerendered audio files to let the "Start" button reaches the end and sync sucessfuly.
Can you help me?

If you are bored, drink water, you will want to pee. -> Albert Einstein - my idol!

I am 42. I have been creating videos since 2009 (the date when my first daughter was born in). My first video software was Pinnacle, next one was Sony Vegas 8 (I am not sure if remember it correctly). I am also a developer and wedding movie operator and editor. For example: I have created an Android app which let me control Vegas Pro rendering progress level on Android smartphone. I created it for fun, because I also love programming. I also created my own plugin for Audio To Text feature specified usage from Vegas Pro 19. I created proxy creation plugin which uses multiple GPU threads (maximum 3) to create proxy files for Vegas Pro. I also written many others plugin/softwares which enhance my video editing, also wedding editing.

Camera/video camera: Sony FX3, Sony A7 III, Sony FDR AX 100, Canon 5D Mark III, GoPro Hero Black 7,8,9,10

Lenses for Sony: Tamron 28-75mm F/2.8 Di III , Sony 24mm gm 1.4 FE, Sony 20 mm G FE 1.8

Lenses for Canon: Canon EF 24-70 mm F/2.8 L USM, Canon 70-200 f/2.8 L

Drone: DJI Mavic 3 & DJI Phantom 4 Pro v2.0

 

Editing: Vegas Pro 20 (365) with a lot of third party plugins, also my own plugins written in C#

 

PC:

CPU: Intel(R) Core(TM) i9-7900X CPU @ 3.30GHz   3.31 GHz

RAM: 128 GB

GPU: Nvidia RTX 2080 TI

storage: 4 SSD drives (including two M.2 flash drives) and two HDD drives

Windows system: 10 Home edition

Musicvid wrote on 9/1/2021, 10:46 AM

It's not necessary to sync the whole file at once -- for this I use the loop region feature to sync the outboard cameras.

Where Pluraleyes used to labor (and often fail) to get the whole program in sync at once, ASR is at its best with more selective regions, I am finding. That way you aren't building such massive WAV files. Here's the basic idea:

https://tools4vegas.com/wp-content/uploads/LongProgramSyncing.mp4

Mindmatter wrote on 9/4/2021, 3:07 PM

So...my first trial was not very successful.
I had two 30 min clips from 2 separate cams, I had even made a classic handclap for later manual synching.
HO took a couple of minutes but put the 2 audios at completely wrong places on the timeline. I wonder what it saw ( or heard) to miss such an obvious clue in the waves, or what it finally thought it had matched?

AMD Ryzen 9 5900X, 12x 3.7 GHz
32 GB DDR4-3200 MHz (2x16GB), Dual-Channel
NVIDIA GeForce RTX 3070, 8GB GDDR6, HDMI, DP, studio drivers
ASUS PRIME B550M-K, AMD B550, AM4, mATX
7.1 (8-chanel) Surround-Sound, Digital Audio, onboard
Samsung 970 EVO Plus 250GB, NVMe M.2 PCIe x4 SSD
be quiet! System Power 9 700W CM, 80+ Bronze, modular
2x WD red 6TB
2x Samsung 2TB SSD

Musicvid wrote on 9/4/2021, 3:18 PM

Again, for syncing a 30 minute program, I use the Loop Region function for syncing a specific portion of the program, maybe 1-5 minutes. You will be done in no time.

It is not necessary to sync the whole thirty minutes, nor is is usually desirable, because the tool does not work like Pluraleyes; it usually works better. This is brand new stuff, so follow the tutorial and read the Help.

https://tools4vegas.com/wp-content/uploads/LongProgramSyncing.mp4

 

 

RedRob-CandlelightProdctns wrote on 8/27/2023, 10:44 PM

@Musicvid  Two questions...

  1. So the jist is you get your ISO cameras on the timeline and rough-arrange them so we're pretty sure they're close to aligned already (within 5 minutes or so), then select a small (e.g. 5-minute) loop region and run this? Probably not a big deal since we start our cams around the same time, but some cams like stage-mounted cameras we usually start before house opens, 30-45 minutes early. Totally doable, but the pre-alignment sounds like a minor nuisance... you didn't find so?
     
  2. Also wondering -- if aligning with AudioSyncR using the loop region option to optimize performance and results -- does the "slip correction" still work? And what if the slip occurs in the reference track?

    In my experience -- our audio field records are the ones which experience the slip, and the camera audio is super tight. (FWIW, my Tascam has much less slippage than my Zooms)

Vegas 21.300

My PC (for finishing):

Cyperpower PC Intel Core i7-7700K CPU @ 4.2GHz, 64GB mem @ 2133MHz RAM, AMD Radeon RX470 (4GB dedicated) with driver recommended by Vegas Updater (reports as 30.0.15021.11005 dated 4/28/22), and Intel HD Graphics 630 driver version 31.0.101.2112 dated 7/21/22 w/16GB shared memory. Windows 10 Pro 64bit version 10.0.19045 Build 19045.

My main editing laptop:

Dell G15 Special Edition 5521, Bios 1.12 9/13/22, Windows 11 22H2 (10.0.22621)

12th Gen Intel Core i7-12700H (14 cores, 20 logical processors), 32 GB DDR5 4800MHz RAM, Intel Iris Xe Graphics, NVIDIA GeForce RTX 3070 Ti Laptop GPU w/8GB GDDR6 RAM, Realtek Audio

 

 

Grazie wrote on 8/28/2023, 12:34 AM

@RedRob-CandlelightProdctns - Yeah," @Musicvid ", I've not seen on the forums for six months. Pity, one of the greatest responders and has an immense CV.

frmax wrote on 8/28/2023, 3:49 AM

Musicvid..... yes, last appearance on Feb 2023 on the forum, I hope he is well, but the long silence would actually be out of character for him....

I9900K, RTX 2080, 32GB RAM, 512Mb M2, 1TB SSD, VEGAS Pro 14-20 (Post), Magix ProX, HitfilmPro
AMD 5900, RTX 3090 TI, 64GB RAM, 1 TB M2 SSD, 4 TB HD, VP 21 Post

Monitor LG 32UN880; Camera Sony FDR-AX53; Photo Canon EOS, Samsung S22 Ultra

vkmast wrote on 8/28/2023, 4:17 AM

He's well, in fact even better than ever.

Grazie wrote on 8/28/2023, 4:50 AM

@vkmast - Thank you! Say howdy from one of his Fans!

rraud wrote on 8/28/2023, 9:37 AM

Say howdy from one of his Fans!

Same here, MV has been known to take an occasional sabbatical from the forum, so I hope that is the case and he is back soon.