I tried a startup reset and ran into a new problem. Couldn't add a prores file to a new project. I could open an existing one that used prores files just fine.

Anyway, the GPU error was still happening after the startup reset.

I then tried running CPU only and it works fine. Performance isn't terrible

I had similar GPU memory issue in one of my old project and for my case, it was caused by large size still image. After changed the image to smaller one, finally works. Alternate way is changing to CPU only.

Seems something not right with the GPU memory processing in this build 187.

I tried to replicate this. I have a 7700HQ CPU and NVIDIA 1050 mobile GPU with studio driver 546.01. Preferences/ video is using the NVIDIA GPU and file io decodes with Intel.

I made a simple project with two tracks and added PiP to the top one as in the first post:

I then thought maybe it's an issue with vertical cell phone video so tried an AVC clip from my phone with an X-AVC S file as the PiP. Still no error.

Any other clues as to how to trigger the error?

I noticed your file name says PXL, so Google Pixel? I'm using a 3a. It ends in .ts, what kind of file is that? Mine are AVC mp4 or jpeg.

While I have top shot too it just exports as AVC mp4 without the .ts. You must have a Pixel 6 or newer.

I can't replicate a problem with ProRes (4K 4444 here):

I also did a second PiP with Pixel MP4 media and no GPU error.

I'm happy to try your project and media if you can make it available as we have basically the same hardware.

@RogerS The original media was:
 

General
Complete name                            : D:\Davinci Resolve\Charlie\PXL_20231117_004526447.TS.mp4
Format                                   : MPEG-4
Format profile                           : Base Media
Codec ID                                 : isom (isom/iso2/mp41)
File size                                : 67.3 MiB
Duration                                 : 25 s 170 ms
Overall bit rate                         : 22.4 Mb/s
Frame rate                               : 30.000 FPS
Encoded date                             : 2023-11-17 00:45:52 UTC
Tagged date                              : 2023-11-17 00:45:52 UTC
xyz                                      : +36.0126-82.0741/

Video
ID                                       : 3
Format                                   : AVC
Format/Info                              : Advanced Video Codec
Format profile                           : High@L4.1
Format settings                          : CABAC / 1 Ref Frames
Format settings, CABAC                   : Yes
Format settings, Reference frames        : 1 frame
Format settings, GOP                     : M=1, N=30
Codec ID                                 : avc1
Codec ID/Info                            : Advanced Video Coding
Duration                                 : 25 s 170 ms
Bit rate                                 : 22.2 Mb/s
Width                                    : 1 920 pixels
Height                                   : 1 080 pixels
Display aspect ratio                     : 16:9
Frame rate mode                          : Variable
Frame rate                               : 30.000 FPS
Minimum frame rate                       : 23.949 FPS
Maximum frame rate                       : 40.000 FPS
Real frame rate                          : 30.000 FPS
Color space                              : YUV
Chroma subsampling                       : 4:2:0
Bit depth                                : 8 bits
Scan type                                : Progressive
Bits/(Pixel*Frame)                       : 0.357
Stream size                              : 66.6 MiB (99%)
Title                                    : VideoHandle
Language                                 : English
Encoded date                             : 2023-11-17 00:45:52 UTC
Tagged date                              : 2023-11-17 00:45:52 UTC
Color range                              : Full
Color primaries                          : BT.709
Transfer characteristics                 : BT.709
Matrix coefficients                      : BT.709
Codec configuration box                  : avcC

Audio
ID                                       : 2
Format                                   : AAC LC
Format/Info                              : Advanced Audio Codec Low Complexity
Codec ID                                 : mp4a-40-2
Duration                                 : 25 s 153 ms
Bit rate mode                            : Constant
Bit rate                                 : 192 kb/s
Channel(s)                               : 2 channels
Channel layout                           : L R
Sampling rate                            : 48.0 kHz
Frame rate                               : 46.875 FPS (1024 SPF)
Compression mode                         : Lossy
Stream size                              : 589 KiB (1%)
Title                                    : SoundHandle
Language                                 : English
Encoded date                             : 2023-11-17 00:45:52 UTC
Tagged date                              : 2023-11-17 00:45:52 UTC

Other #1
ID                                       : 1
Type                                     : meta
Format                                   : mett
Codec ID                                 : mett
Duration                                 : 25 s 170 ms
Bit rate mode                            : Variable
Title                                    : MetaHandle
Language                                 : English
Encoded date                             : 2023-11-17 00:45:52 UTC
Tagged date                              : 2023-11-17 00:45:52 UTC

Other #2
ID                                       : 4
Type                                     : meta
Format                                   : mett
Codec ID                                 : mett
Bit rate mode                            : Constant
Title                                    : MetaHandle
Language                                 : English
Encoded date                             : 2023-11-17 00:45:52 UTC
Tagged date                              : 2023-11-17 00:45:52 UTC

and

General
Complete name                            : D:\Davinci Resolve\Charlie\20231116_194505.mp4
Format                                   : MPEG-4
Format profile                           : Base Media / Version 2
Codec ID                                 : mp42 (isom/mp42)
File size                                : 397 MiB
Duration                                 : 46 s 108 ms
Overall bit rate                         : 72.2 Mb/s
Frame rate                               : 59.629 FPS
Performer                                : Samsung SM-G986U1
Encoded date                             : 2023-11-17 00:45:51 UTC
Tagged date                              : 2023-11-17 00:45:51 UTC
xyz                                      : +36.0126-082.0740/
com.android.version                      : 13

Video
ID                                       : 1
Format                                   : AVC
Format/Info                              : Advanced Video Codec
Format profile                           : High@L5.2
Format settings                          : CABAC / 1 Ref Frames
Format settings, CABAC                   : Yes
Format settings, Reference frames        : 1 frame
Format settings, GOP                     : M=1, N=60
Codec ID                                 : avc1
Codec ID/Info                            : Advanced Video Coding
Duration                                 : 46 s 108 ms
Source duration                          : 46 s 51 ms
Bit rate                                 : 72.1 Mb/s
Width                                    : 3 840 pixels
Height                                   : 2 160 pixels
Display aspect ratio                     : 16:9
Frame rate mode                          : Variable
Frame rate                               : 59.629 FPS
Minimum frame rate                       : 29.723 FPS
Maximum frame rate                       : 64.240 FPS
Real frame rate                          : 60.000 FPS
Standard                                 : PAL
Color space                              : YUV
Chroma subsampling                       : 4:2:0
Bit depth                                : 8 bits
Scan type                                : Progressive
Bits/(Pixel*Frame)                       : 0.146
Stream size                              : 396 MiB (100%)
Source stream size                       : 396 MiB (100%)
Title                                    : VideoHandle
Language                                 : English
Encoded date                             : 2023-11-17 00:45:51 UTC
Tagged date                              : 2023-11-17 00:45:51 UTC
Color range                              : Limited
Color primaries                          : BT.709
Transfer characteristics                 : BT.709
Matrix coefficients                      : BT.709
mdhd_Duration                            : 46108
Codec configuration box                  : avcC

Audio
ID                                       : 2
Format                                   : AAC LC
Format/Info                              : Advanced Audio Codec Low Complexity
Codec ID                                 : mp4a-40-2
Duration                                 : 46 s 79 ms
Bit rate mode                            : Constant
Bit rate                                 : 256 kb/s
Channel(s)                               : 2 channels
Channel layout                           : L R
Sampling rate                            : 48.0 kHz
Frame rate                               : 46.875 FPS (1024 SPF)
Compression mode                         : Lossy
Stream size                              : 1.41 MiB (0%)
Title                                    : SoundHandle
Language                                 : English
Encoded date                             : 2023-11-17 00:45:51 UTC
Tagged date                              : 2023-11-17 00:45:51 UTC

But they were both converted to prores before I brought them into VP

I've uploaded the project here, thanks for taking a look!

https://drive.google.com/file/d/1RpdnmCDklJq5HFIesod3bFkgsolak3A9/view?usp=sharing

@Former user @john_dennis I've removed the file and will put up a corrected one shortly. Could you remove your comments with the file error please?

Looks like I had some cruft on my system.

In order to fix my beta faux-pas I did a full uninstall of 21 followed by a reinstall of 187

On opening my problem project I was greeted with this error

and the project still crashes the gpu

I've uploaded a correct set of files here.

https://drive.google.com/file/d/1T5zQ8c47M-sGBxuGW5YjE_nSlsfKG1wv/view?usp=sharing

@michael-harrison 

Is the project supposed to be 1080 x 1920 Portrait?

You've rotated it in Pan/Crop - Angle -90 ?

That's what it also shows in your orig comment 1080 x 1920.

No crash, I decided to load up the vram with external AI models, working on the idea it could be due to your limited Vram, it's either 2GB or 4GB isn't it?

For some reason whenever I loaded up Vegas Vram use would go down so I was never able to max out the Vram and test that.

@Former user I rotated it partway through because I turned my phone while recording.

The version I uploaded was greatly truncated so it wouldn't take 2hrs to upload

@michael-harrison Just to confirm, did you try your truncated version, and got the memory error

@Former user affirmative

I used some different software to load it's LLM's so that I only have 4GB Vram left, at 1080P everything still worked fine. I changed project to 4K, and Vram started swapping out to shared gpu memory (system ram), it ran appallingly but no memory errors.

I decided to try some different driver versions and...

537.58 - same gpu error and red screen

536.99 - no gpu error or red screen but PIP track doesn't render

Your project worked on the machine in my signature with these settings.

I did my own version.

I've got the same hardware but newer GPU driver and have no problem here:

It's using very little GPU memory.

I then rendered it out to a 9:16 1080x1920 using MagixAVC with NVENC and played back the file- no problem.

Similar to @john_dennis but tracked a bit better 😋😁

I got the same GPU error message yesterday, never seen it before. I added a jpg still then a PIP FX to the still in an already quite full but working well project. At some point while trying to adjust the sizing I got this GPU error,
I could not proceed wihout closing the VP21 process then starting again on a previous saved version. The drivers are up to date.
I changed my mind and didnt persue the effect but having seen this post today I tried to reproduce what I did. It worked with no problem. I looked in Advanced Save to see if there was a save of the project with the error in it but no such luck.

@john_dennis your result is kind of expected. When choosing Intel on my system it also works fine. It's just when I choose Nvidia that things go sideways.

@Former user I suspect part of the problem is I'm using an older GPU and recent updates to VP and the drivers are leaving older cards behind.

@RogerS There is no newer studio driver available. Are you using a game ready driver?

I decided to go down the rabbit hole and stepwise uninstalled all my VP plugins (boris continuum, sapphire, vegasaur, new blue, happy otter) and test. Unfortunately none of them are the cause of this issue. Just for the heck of it I'm going to try the latest game ready driver.

[edit, latest game ready driver shows the same problem]

@michael-harrison Hi, It's not easy for me to fully join in with some of these posts, I don't have Intel & I don't have an integrated GPU, also my PC is a bit more powerful then some, however if there's a problem with Vegas, software/plugins or certain media it still shows on my PC but unfortunately there's nothing I can reveal about your Media. Hope you get it worked out.