Please add AI to help clip videos

Joseph-Pace wrote on 8/7/2024, 4:59 PM

 

Editing gameplay videos are no joke, it's very time consuming as see in picture above, that's just half month's work acquiring all clips of trickshots/sniperkills.

Can we implement an AI that can help.. clip the videos based off the audio track sample we give it..? For example, if I got a gameplay video clips that contains a lot of sniper kills, I want to give the audio track sample of a sniper shot sound for AI to help put all split/clip at all sniper shot sound it sees. It may not be perfect clipping all sniper actual kills, but it's a start though if it starts learning how to clip/split videos that you want...

 

I have hour long videos and it's very time consuming to go to each sniper kills looking by the sound track looking for the sniper shot, splitting, moving on to next until I review them all later to be more edited.. Can we implement this type of AI that helps clipping please??

 

It\s the simplest, okay maybe not lol.. but giving sound track piece to AI that helps to find and clip/split whole video that contains sniper shot sound is a start please!! I do have a lot of umm.. videos of me literally editing, if sharing those editing videos help then please let me know and I'll upload, give to you if it helps training AI clipping clips!

Comments

fr0sty wrote on 8/8/2024, 12:01 AM

Try the AI beat detection in VEGAS 22... while it won't isolate just the sniper rifle, it is programmed to look for sudden changes in the sound, and put a marker there, which a gunshot most definitely is, so it'll at least help you identify where all the gunshots are that stand out from the rest. "AI Sample Detection", where you specify an audio sample and have it look for that sample across the waveform, would indeed be a cool feature, though. I'll add it to the list of feature requests.

Joseph-Pace wrote on 8/8/2024, 10:21 PM

Try the AI beat detection in VEGAS 22... while it won't isolate just the sniper rifle, it is programmed to look for sudden changes in the sound, and put a marker there, which a gunshot most definitely is, so it'll at least help you identify where all the gunshots are that stand out from the rest. "AI Sample Detection", where you specify an audio sample and have it look for that sample across the waveform, would indeed be a cool feature, though. I'll add it to the list of feature requests.

AI beat detection..? I haven't seen or searched that just yet.

 

Also even video sample is worth a try if giving a piece of video sample for example marking/clipping where you fire the sniper rifle would help too! Again, if want me upload, share hours of editing from scratch, let me know.

 

I figured ANYTHING that shows how.. could be trained right off it, maybe even add suggestion requesting permission to record, see how people edit their videos by having a checkbox some sort, even adding description what editing style, something before starting their project if allow to share recordings or not, I don't see why people wouldn't want better progression and helping improving AI much more by sharing!

I'm already excited on where this is heading, done such a great job implementing those AI tools!😍

 

Howard-Vigorita wrote on 8/9/2024, 10:54 AM

@Joseph-Pace If the gunshots you are looking for are the only impulse responses in the soundtrack, they're pretty easy to identify and isolate without AI. Especially if you bump the volume up enough to turn them into overloads. You could probably write a Vegas script that looked for overloads or rapid transients and dropped markers on them all. But if you get Sound Forge, it has a native tool called Clip Detection that does exactly that. Just tried it myself on a copy of a soundtrack that I intentionally boosted by 3db to force some overloads. SF inserted a marker labeled "Clip Detected" on each and every overload. When saved and pulled back into Vegas, they came in as embedded media markers. I then ran a Vegas-supplied script, Promote Media Markers, that turned them all into timeline markers that can be used for navigation. And easily delete ones I don't want.