Suggestion: Vegas native Beat Reactor (Audio-driven FX)

lan-mLMC wrote on 11/1/2022, 5:34 AM

Note: This is a post from elsewhere and I duplicate it here because I want to see how many of the average users would have the same opinion on this.
——————————————————————————————————————————

.

The rise of mobile video apps like Tiktok and Capcut has lowered the bar for many VFX productions, making it easy for everyone to create great effects. Beat FX / Audio Visualization / Audio-driven FX is one of them. 
I've seen quite a few users asking this question on the forums recently.  https://www.vegascreativesoftware.info/us/forum/beatleap-style-effects--137576/ https://www.vegascreativesoftware.info/us/forum/sound-visualization-plugin--137563/


To make Beat FX / Audio Visualization / Audio-driven FX in Vegas, BCC plugin is needed at present. 
It has a beat reactor section below almost every BCC OFX, which can detect every subtle beat of music, 
and then link beats to the parameter of FX, to make parameter changing with music.    


It can also generate the beautiful spectrum of the music to make a nice audio visualization video. 

 

It would be great if Vegas has its own beat reactor, which could transfer every subtle beat to any parameter of any OFX; And can generate music spectrum to create beautiful audio visualization effect with the coordination of other FXs.

 

Its specific implementation can refer to the Motion Tracking Panel. After obtaining tracking data, Motion Tracking can transfer the data to the Position parameter of any FX such as PIP; Similarly, the Vegas Beat Reactor, after obtaining the subtle beats of Music, can transfer the beats to any parameter of any FX.

Comments

Reyfox wrote on 11/1/2022, 6:22 AM

In what I do, I have no need for a beat reactor. But I am sure that there are others out there who do.

As for the Vegas programming team spending time on creating this, I'd rather have them focus on timeline previewing first, along with utilizing the current hardware that is available on modern computers.

But that's just "me" and my preferences.

Newbie😁

Vegas Pro 22 (VP18-21 also installed)

Win 11 Pro always updated

AMD Ryzen 9 5950X 16 cores / 32 threads

32GB DDR4 3200

Sapphire RX6700XT 12GB Driver: 25.3.1

Gigabyte X570 Elite Motherboard

Panasonic G9, G7, FZ300

Dexcon wrote on 11/1/2022, 6:33 AM

A very good suggestion. But not just for OFX but also for marking the beat points for a video event change. I've recently had to manually code markers at the beat points - using highlighting of the waveform beat as a guide on the audio track - in order to identify the in/out points for video events. Every bass/drum beat (maybe 2 seconds apart) is a cue to cut from one video event to another. The only issue has been to make sure that the unquantized audio event is positioned to match to the video quantization at the point of the first cut and that the following beat points are equal to or very close to video quantization frame edges - which fortunately they were.

Cameras: Sony FDR-AX100E; GoPro Hero 11 Black Creator Edition

Installed: Vegas Pro 15, 16, 17, 18, 19, 20, 21 & 22, HitFilm Pro 2021.3, DaVinci Resolve Studio 19.0.3, BCC 2025, Mocha Pro 2025.0, NBFX TotalFX 7, Neat NR, DVD Architect 6.0, MAGIX Travel Maps, Sound Forge Pro 16, SpectraLayers Pro 11, iZotope RX11 Advanced and many other iZ plugins, Vegasaur 4.0

Windows 11

Dell Alienware Aurora 11:

10th Gen Intel i9 10900KF - 10 cores (20 threads) - 3.7 to 5.3 GHz

NVIDIA GeForce RTX 2080 SUPER 8GB GDDR6 - liquid cooled

64GB RAM - Dual Channel HyperX FURY DDR4 XMP at 3200MHz

C drive: 2TB Samsung 990 PCIe 4.0 NVMe M.2 PCIe SSD

D: drive: 4TB Samsung 870 SATA SSD (used for media for editing current projects)

E: drive: 2TB Samsung 870 SATA SSD

F: drive: 6TB WD 7200 rpm Black HDD 3.5"

Dell Ultrasharp 32" 4K Color Calibrated Monitor

 

LAPTOP:

Dell Inspiron 5310 EVO 13.3"

i5-11320H CPU

C Drive: 1TB Corsair Gen4 NVMe M.2 2230 SSD (upgraded from the original 500 GB SSD)

Monitor is 2560 x 1600 @ 60 Hz

walter-i. wrote on 11/1/2022, 7:05 AM

For what I do, just marking beat points would be helpful to me and an interesting addition as Dexcon has pointed out.  
Otherwise, I would be with Reyfox that the developers should work on smooth timeline previews and must-haves first.

3POINT wrote on 11/1/2022, 7:37 AM

@Dexcon With a free tool like "BPM Analyzer" you can easily detect the BeatsPerMinute (or Beatpoints) of your music event and set in Vegas projectsettings bpm and measure (ruler menu) accordingly, in options menu you can enable "snap to grid" and set Grid spacing to "measures". With this you can easily edit your video events to the beat of the music.

Alternatively, you can use also Vegasaur's Beat Detector to generate markers at the beat.

Reyfox wrote on 11/1/2022, 8:09 AM

Alternatively, you can use also Vegasaur's Beat Detector to generate markers at the beat.

And that is what I use!

Newbie😁

Vegas Pro 22 (VP18-21 also installed)

Win 11 Pro always updated

AMD Ryzen 9 5950X 16 cores / 32 threads

32GB DDR4 3200

Sapphire RX6700XT 12GB Driver: 25.3.1

Gigabyte X570 Elite Motherboard

Panasonic G9, G7, FZ300

joelsonforte.br wrote on 11/1/2022, 8:19 AM

@Dexcon @walter-i. @Reyfox

As @3POINT mentioned, Vegasaur has a tool called Beat Detector that creates markers on the beats of the music. In conjunction with other Vegasaur tools it is possible to greatly speed up editing. I, for example, use it a lot when I need to be alternating between several cameras in the rhythm of the beat. But there are countless other possibilities for using this feature. I made a small video showing one of the possibilities of use.

@lan-mLMC I'll check with the Vegasaur developer if it's possible to adapt this feature at the video FX level. I can't promise anything, because in the last time I talked to the Vegasaur developer, he informed me that he is on a new job and consequently has no time to work on Vegasaur, but if he ever return to work on Vegasaur, your suggestion is a good feature addition.

frmax wrote on 11/1/2022, 10:21 AM

@joelsonforte.br

You are the leading Vegasaur expert! Thank you for sharing your insights on how to use Vegasaur.
There have already been several good instructional videos from you on these aspects in our forum, I would like to see more of them, although this is only a hope and not a request.

I9900K, RTX 2080, 32GB RAM, 512Mb M2, 1TB SSD, VEGAS Pro 14-20 (Post), Magix ProX, HitfilmPro
AMD 5900, RTX 3090 TI, 64GB RAM, 1 TB M2 SSD, 4 TB HD, VP 21 Post, VP22

Monitor LG 32UN880; Camera Sony FDR-AX53; Photo Canon EOS, Samsung S22 Ultra

Dexcon wrote on 11/2/2022, 3:16 AM

@3POINT @joelsonforte.br  ... Thank you for the advice about Vegasaur - I just wasn't aware that the beat detector was there. Yes, that does what I was looking for though I had to delete 3 intervening beat markers between all of the principal drum beats which are about 2.5 seconds apart - but that didn't take long at all.

Cameras: Sony FDR-AX100E; GoPro Hero 11 Black Creator Edition

Installed: Vegas Pro 15, 16, 17, 18, 19, 20, 21 & 22, HitFilm Pro 2021.3, DaVinci Resolve Studio 19.0.3, BCC 2025, Mocha Pro 2025.0, NBFX TotalFX 7, Neat NR, DVD Architect 6.0, MAGIX Travel Maps, Sound Forge Pro 16, SpectraLayers Pro 11, iZotope RX11 Advanced and many other iZ plugins, Vegasaur 4.0

Windows 11

Dell Alienware Aurora 11:

10th Gen Intel i9 10900KF - 10 cores (20 threads) - 3.7 to 5.3 GHz

NVIDIA GeForce RTX 2080 SUPER 8GB GDDR6 - liquid cooled

64GB RAM - Dual Channel HyperX FURY DDR4 XMP at 3200MHz

C drive: 2TB Samsung 990 PCIe 4.0 NVMe M.2 PCIe SSD

D: drive: 4TB Samsung 870 SATA SSD (used for media for editing current projects)

E: drive: 2TB Samsung 870 SATA SSD

F: drive: 6TB WD 7200 rpm Black HDD 3.5"

Dell Ultrasharp 32" 4K Color Calibrated Monitor

 

LAPTOP:

Dell Inspiron 5310 EVO 13.3"

i5-11320H CPU

C Drive: 1TB Corsair Gen4 NVMe M.2 2230 SSD (upgraded from the original 500 GB SSD)

Monitor is 2560 x 1600 @ 60 Hz

walter-i. wrote on 11/2/2022, 3:32 AM

@3POINT @joelsonforte.br  ... Thank you for the advice about Vegasaur - I just wasn't aware that the beat detector was there. Yes, that does what I was looking for though I had to delete 3 intervening beat markers between all of the principal drum beats which are about 2.5 seconds apart - but that didn't take long at all.

I had tried the beat detector in Vegasaur some time ago, and spent a lot of time deleting the excess markers - so I didn't use it again. It may also have been an unfortunate choice of music with not enough distinct rhythms.

I will try it again after the great tutorial by @joelsonforte.br - thanks for that!

3POINT wrote on 11/2/2022, 5:48 AM

I had tried the beat detector in Vegasaur some time ago, and spent a lot of time deleting the excess markers - so I didn't use it again. It may also have been an unfortunate choice of music with not enough distinct rhythms.

You can easily change the number of markers generated from every beat to, for example, every 8 beats.

Musicvid wrote on 11/2/2022, 9:54 AM

There are third-party OFX made to mimic virtually every special effect available on iPhones and TikTok. New ones are being introduced all the time. I call it the "Bling Factor."

The problem with cluttering up the software with native special fX is that it diverts coding talent, must be constantly under development to keep up with the latest social media fads, and temporary sales appeal goes away the minute some new gimmick is introduced.

Some hopeless types actually still need the "Pro" in Vegas: I could still use V14 for 90% of my production work, which has dwindled. I like to play with V20; it has some neat stuff. Depends on whether I'm wearing my Producer or my Hobbyist hat.

 

Reyfox wrote on 11/2/2022, 2:44 PM

I remember an edit software I was using and they brought out 3D. Everyone remembers that, yes?!?

I only know of one person that actually shot in 3D and edited the videos for 3D playback. But it was the "new" thing and you had to have it on the software box.

And yes, there were other, more pressing issues that should have been addressed instead of 3D.

Newbie😁

Vegas Pro 22 (VP18-21 also installed)

Win 11 Pro always updated

AMD Ryzen 9 5950X 16 cores / 32 threads

32GB DDR4 3200

Sapphire RX6700XT 12GB Driver: 25.3.1

Gigabyte X570 Elite Motherboard

Panasonic G9, G7, FZ300

RogerS wrote on 11/2/2022, 3:22 PM

I don't care about flashy Fx or transitions, but editing to a beat is quite common (music videos, wedding videos, promotional-type videos) so automating beat detection and letting any Vegas Fx access it (including any 3rd party ones the editor desires) makes a lot of sense to me.