Video editing to the beat of the music is time consuming. I developed a tool (Music Video Sync V2) and workflow to edit video to the beat of the music with less effort and time.
Your tool looks of interest although I must admit I haven't investigated alternatives as yet.
A couple of questions:
The music you have used in your demo has a strong backbeat and you have chosen to cut on the backbeat. If I wanted to cut on the downbeat instead, would it just be a matter of altering the offset parameter?
How would your tool handle more fluid tempos such as a piece of classical music which is constantly speeding up or slowing down?
The music you have used in your demo has a strong backbeat and you have chosen to cut on the backbeat. If I wanted to cut on the downbeat instead, would it just be a matter of altering the offset parameter?
The audio analyser detects (almost) every beat. With the parameters "Beat Interval" and "Beat Offset" you can choose which beats 'll result in Markers (in video cuts). With a Beat Interval of 4 and a Beat Offset of 0, the Markers 'll be placed for beat 1, 5, 9, 13 ..... With a Beat Interval of 4 and a Beat Offset of 3 the Markers 'll be placed for beat 4, 8, 12, 16....... Beat Offset "shifts" the sequence, so yes, you can use every (detected) beat. With the parameters "Slide around beats" and "Random Slide" you can shift the Markers "of the beat" on purpose a couple of (video) frames. This can be handy for special effects or a "non robotic perfect" cutting.
2. How would your tool handle more fluid tempos such as a piece of classical music which is constantly speeding up or slowing down?
The music (audio) analysing and beat detection is done (in the background) by a sophisticated (complex) algorithm of Queen Mary, University of London. My tool uses in the background the command line tool "Sonic Annotator" with the "beatroot-vamp" plugin / algorithm. I expect tempo changes not to be an issue (it is real beatracking and not beat guessing). If there is no real beat in your music I expect that the algorithm 'll not detect all the beats at places you wish; but maybe this means that the music isn't "dictating" where to cut your video. Till now I have not found a better algorithm that "out of the box" produces better beat detecting, with the default values of the (4) parameter settings (which can be changed).
If you want to research and test what is possible with your kind of music, I advice to install Sonic Visualiser with the beatroot-vamp (and other) plugins.
Music VideoSync (MVS) can analyse music files (songs) and generates Marker files with “beat positions” of the music files. The Marker files can be imported in Vegas Movie Studio or Vegas Pro. This makes it easy to edit your videos on the beat.
With version 2.1 you can select multiple input music files and process these in one sequence. MVS ‘ll analyse each music file and ‘ll write one or more Marker files with the beat positions. Great to quickly experiment with multiple songs to discover what works with your video. You can select a range for the beat interval value and for the beat offset value and generate multiple Marker files at once.
Actually I started this (personal) project as an (unfinished) extension / script till I realized that:
for the features I wanted an application in combination with 2 standard Vasst apps can do the job;
the Vasst apps are available for Vegas Pro and MovieStudio; my own extension would never work with Movie Studio without the coöperation of Magix;
the Vasst apps were / are not expensive (at least at the time of the first release of Music Video Sync);
no worries for me with extentions not fully compatible with the newest versions of Vegas Pro (that I don't own and can not use to test with);
developping extensions and scripts for different Vegas version / languages and operating system can be time consuming and is often more complicated as I wish;
how many people would actually donate (= saying "thank you") for a more time consuming extension development without the need of the Vasst apps?