Error 0x80660008

s-t wrote on 12/11/2025, 5:15 AM

I have Vegas Pro 20.0. NVENC worked fine but suddenly it stopped working and is giving me error with the numbers in the post title. Tried everything. Removed cache, disabled GPU rendering, reinstalled vegas, installed Nvidia studio, reinstalled/rolled back gpu drivers NVENC has not even appeared in logs since this started happening I am not sure what caused this and how to fix it. CPU rendering works fine though.

Comments

Dexcon wrote on 12/11/2025, 5:43 AM

Do you have an NVIDIA GPU and has its driver been updated to 591.44? If yes, please read this other post about problems with that driver - https://www.vegascreativesoftware.info/us/forum/geforce-driver-591-44-a-huge-difference--150381/

Workarounds include rolling back to an earlier NVIDIA driver or not to use NVENC when rendering. Interestingly, the NEVC problem does not occur in Vegas Pro 23 - not in my case anyway.,

Cameras: Sony FDR-AX100E; GoPro Hero 11 Black Creator Edition; Samsung S23 Ultra smart phone

Installed: Vegas Pro 13, 15, 16, 17, 18, 19, 20, 21, 22 & 23, HitFilm Pro 2021.3, DaVinci Resolve Studio 20.2, BCC 2025.5, Mocha Pro 2025.5, NBFX TotalFX 7, Neat NR 6, DVD Architect 6.0, MAGIX Travel Maps, Sound Forge Pro 16, SpectraLayers Pro 12, iZotope RX11 Advanced and many other iZ plugins, Vegasaur 4.0

Windows 11

Dell Alienware Aurora 11:

10th Gen Intel i9 10900KF - 10 cores (20 threads) - 3.7 to 5.3 GHz

NVIDIA GeForce RTX 2080 SUPER 8GB GDDR6 - liquid cooled

64GB RAM - Dual Channel HyperX FURY DDR4 XMP at 3200MHz

C drive: 2TB Samsung 990 PCIe 4.0 NVMe M.2 PCIe SSD

D: drive: 4TB Samsung 870 SATA SSD (used for media for editing current projects)

E: drive: 2TB Samsung 870 SATA SSD

F: drive: 6TB WD 7200 rpm Black HDD 3.5"

Dell Ultrasharp 32" 4K Color Calibrated Monitor

 

LAPTOP:

Dell Inspiron 5310 EVO 13.3"

i5-11320H CPU

C Drive: 1TB Corsair Gen4 NVMe M.2 2230 SSD (upgraded from the original 500 GB SSD)

Monitor is 2560 x 1600 @ 60 Hz

s-t wrote on 12/11/2025, 6:02 AM

I have RTX 3070 and I rolled back up to version 581.57 and it fixed it for Vegas Pro 20.0 and now I can render videos again with NVENC.