What I wouldn't give right now for a plugin or script that could locate gaps when a speaker pauses, cut them out and overlap the resulting events by 5 or 6 frames.
I've got a speaker that has a tick that results in pauses of 1-2 seconds after every few words and manually editing the video down to the required length and for pacing is gonna take a while.