Problems with NVENC on Vegas Pro 22

Dominique-Cailleau wrote on 1/10/2026, 4:56 PM

Hello everyone, I am asking for help because I make YouTube videos which I record with OBS and I edit with Vegas Pro 22 and for some time now without changing anything in my Vegas Pro 22 Profile I am unable to do "Render as" without getting the error message when creating the media (see image 1) Error 0x80660008. Before continuing with my most important Windows 11 setup: (my entire system is up to date)

Processor: AMD Ryzen 7 5700X 4.6 GHz
Motherboard: MSI MPG X570 Gaming Pro Carbon
Graphics Card: Gigabyte Aorus GeForce RTX 4070 Master 12G
RAM: Corsair Vengeance RGB RS 64 GB (2 x 32 GB) DDR4 3200 MHz CL16

I should mention that I have OBS and Vegas Pro 22 up to date, and I've been getting this error message for the last four Vegas Pro 22 updates. After quite a bit of research, I noticed that my encoding profile:

Encoding in Magix HEVC/AAC MP4 (see image 2) doesn't work, and I get this error message!

Creating a new profile in Magix AVC/AAC MP4 with the "NV Encoder" doesn't work!

With the same profile in Magix AVC/AAC MP4 (see image 3) and the "MainConcept AVC" encoder selected, it works perfectly!

So, if you have any ideas, because I don't understand why everything worked perfectly under my Magix HEVC/AAC MP4 profile with the NV encoder, and now I have to use the "MainConcept AVC" encoder in my new Magix AVC/AAC MP4 profile with it hidden... Thank you in advance for your help.

Comments

Gid wrote on 1/10/2026, 5:27 PM

@Dominique-Cailleau Hi, you say '(my entire system is up to date)', Some people have had problems with the recent Nvidia drivers, I'm not sure what the number is but I think it's ​​591.74... . I'm still on 581.29

Vegas Pro 18 - 22
Vegas Pro/Post 19
Boris Continuum & Sapphire, 
Silhouette Standalone + Plugin, 
Mocha Pro Standalone + Plugin, 
Boris Optics,
NewBlue TotalFX
Desktop PC Microsoft Windows 10 Pro - 64-Bit
ASUS PRO WS WRX80E-SAGE SE WIFI AMD Motherboard
AMD Ryzen Threadripper PRO 3975WX 3.5GHz 32 Core
Corsair iCUE H150i RGB PRO XT 360mm All-in-One Liquid CPU Cooler
RAM 256GB ( 8x Micron 32GB (1x 32GB) 2666MHz DDR4 RAM )
2x Western Digital Black SN850 2TB M.2-2280 SSD, 7000MB/s Read, 5100MB/s Write
(programs on one, project files on the other)
Graphics MSI GeForce RTX 3090 SUPRIM X 24GB OC GPU
ASUS ROG Thor 1200W Semi-Modular 80+ Platinum PSU 
Fractal Design Define 7 XL Dark TG Case with 3 Fans
Dell SE3223Q 31.5 Inch 4K UHD (3840x2160) Monitor, 60Hz, & an Acer 24" monitor.

At the moment my filming is done with a Samsung Galaxy S23 Ultra 5G & a GoPro Hero11 Black

I've been a Joiner/Carpenter for 40yrs, apprentice trained time served, I don't have an apprentice of my own so to share my knowledge I put videos on YouTube.

YouTube videos - https://www.youtube.com/c/Gidjoiner

 

Dominique-Cailleau wrote on 1/10/2026, 5:30 PM

Thank you, I've read about this on various websites and I know that Nvidia version 581.80 works, but I find it unfortunate that Team Vegas isn't doing anything to fix this problem!

Dexcon wrote on 1/10/2026, 5:36 PM

Please see this forum post about NVENC compatibility having been removed by NVIDIA with the release of the 591.44 driver: https://www.vegascreativesoftware.info/us/forum/nvenc-nv-encoder-problem-with-new-nvidia-drivers-vp22--150573/. There are other posts about the same issue as well.

As noted in that post, the current options are to roll-back the NVIDIA driver to a version prior to 591.44 or to upgrade to Vegas Pro 23 which doesn't have the NVENC problem - or of course in Vegas Pro 22 (or earlier) use another render format that doesn't involve NVENC.

Last changed by Dexcon on 1/10/2026, 5:38 PM, changed a total of 1 times.

Cameras: Sony FDR-AX100E; GoPro Hero 11 Black Creator Edition; Samsung S23 Ultra smart phone

Installed: Vegas Pro 13, 15, 16, 17, 18, 19, 20, 21, 22 & 23, HitFilm Pro 2021.3, DaVinci Resolve Studio 20.3, BCC 2026, Mocha Pro 2026, NBFX TotalFX 7, Neat NR 6, DVD Architect 6.0, MAGIX Travel Maps, Sound Forge Pro 16, SpectraLayers Pro 12, iZotope RX11 Advanced and many other iZ plugins, Vegasaur 4.0

Windows 11 25H2

Dell Alienware Aurora 11:

10th Gen Intel i9 10900KF - 10 cores (20 threads) - 3.7 to 5.3 GHz

NVIDIA GeForce RTX 2080 SUPER 8GB GDDR6 - liquid cooled

64GB RAM - Dual Channel HyperX FURY DDR4 XMP at 3200MHz

C drive: 2TB Samsung 990 PCIe 4.0 NVMe M.2 PCIe SSD

D: drive: 4TB Samsung 870 SATA SSD (used for media for editing current projects)

E: drive: 2TB Samsung 870 SATA SSD

F: drive: 6TB WD 7200 rpm Black HDD 3.5"

Dell Ultrasharp 32" 4K Color Calibrated Monitor

 

LAPTOP:

Dell Inspiron 5310 EVO 13.3"

i5-11320H CPU

C Drive: 1TB Corsair Gen4 NVMe M.2 2230 SSD (upgraded from the original 500 GB SSD)

Monitor is 2560 x 1600 @ 60 Hz

Gid wrote on 1/10/2026, 5:36 PM

@Dominique-Cailleau As you say you've read it on various websites, what have you read?

. I've read about problems with the recent Nvidia drivers on gaming sites, Reddit & the other Magix forum, therefore it's a Nvidia problem not a Vegas problem.

Vegas Pro 18 - 22
Vegas Pro/Post 19
Boris Continuum & Sapphire, 
Silhouette Standalone + Plugin, 
Mocha Pro Standalone + Plugin, 
Boris Optics,
NewBlue TotalFX
Desktop PC Microsoft Windows 10 Pro - 64-Bit
ASUS PRO WS WRX80E-SAGE SE WIFI AMD Motherboard
AMD Ryzen Threadripper PRO 3975WX 3.5GHz 32 Core
Corsair iCUE H150i RGB PRO XT 360mm All-in-One Liquid CPU Cooler
RAM 256GB ( 8x Micron 32GB (1x 32GB) 2666MHz DDR4 RAM )
2x Western Digital Black SN850 2TB M.2-2280 SSD, 7000MB/s Read, 5100MB/s Write
(programs on one, project files on the other)
Graphics MSI GeForce RTX 3090 SUPRIM X 24GB OC GPU
ASUS ROG Thor 1200W Semi-Modular 80+ Platinum PSU 
Fractal Design Define 7 XL Dark TG Case with 3 Fans
Dell SE3223Q 31.5 Inch 4K UHD (3840x2160) Monitor, 60Hz, & an Acer 24" monitor.

At the moment my filming is done with a Samsung Galaxy S23 Ultra 5G & a GoPro Hero11 Black

I've been a Joiner/Carpenter for 40yrs, apprentice trained time served, I don't have an apprentice of my own so to share my knowledge I put videos on YouTube.

YouTube videos - https://www.youtube.com/c/Gidjoiner