A tip you might find useful when using velocity envelopes: set the in and outs of your video event, then create a subclip. Apply the velocity envelope and set the speed. Shorten or lengthen the subclip as needed. Often, I find it much easier to end up with what I want.