In the beginning, I noticed that my my video had a habbit of having some random blackouts during both scrubbing & rendering. I even had some "Low Memory" notices pop out during the process.
To save time, I turned off the GPU, disabled "Hardware Decoding Support" then rendered my clips via QSV so that I don't waste my client's time as I try to troubleshoot this.
After that was done, I came back and re-enabled everything and had a hunch.
It seems that the GPU has a particular limit of sustained decoding time before it begins to bottle neck, somehow. I have NVIDIA's latest Creator Driver enabled by the way. It's a 1080ti. I also have 32 GB RAM and an i7 6770k
Attaching a video here. The video is playing side by side with the Performance Tab on the side. I've allowed it to loop twice.
Please note that the footage is 4K, 50 FPS & from my GH5.
The following is my DXDIAG