I spent a few days editing lots of clips with a lot of those parts speeded up 400%.
I then added a second video track at about the 10 minute mark and enabled multicam editing.
Now all of the previous speeded up parts have audio that is out of sync or some parts are playing at normal speed when they should be speeded up.