[RESOLVED] Minor Pixelation in Rendered Videos

Russell-Hoover wrote on 7/14/2020, 7:58 AM

Hello!

This is my first forum post here and I am hoping to reach out to the community for a solution. Every once and a while, I will record video game footage with OBS to share with friends. For the most part, Vegas 14 has given me no troubles except as of recent. A little bit ago all of my rendered videos started coming out with major pixelation and after doing lots of research and following step by step tutorials I have managed to bring the pixelation down to a minimum but never truly fixed it. I'm not entirely sure how to describe it, but its in the video that I am going to link. It's almost like varying pixelation. It constantly changes, even when the environment is still. With high motion footage it is not noticeable but when the scenery is still is when it happens the most. Can anyone provide some insight on what is causing this issue and how to fix it? Is it a hardware issue or software issue?

Edit: I am very new to video editing and rendering. I don't know much other than what was taught in the howto videos I posted below.
Edit 2: The YouTube test video below that I am using as an example is not affected by YouTube, it looks exactly like that as a MP4 file on my computer.
Edit 3: Removed YouTube sample for quality purposes. Posted Dropbox and google drive links. Added more information.
Edit 4: Updated Source and Rendered Samples. Added OBS recording settings. Updated Mediainfo pulls to reflect new source and render samples.

(This now applies to the old links) When facing the wall, the pixelation is barely noticeable. Its there, but you can hardly see it. Toward the second half of the video, it is noticeable the most when looking toward the center of the video at the root-like structures directly above my character's head.

Source Sample Video:
https://drive.google.com/file/d/1P4j5Q1nOWIJHCpYLpWqUI2ev5N1nbiUz/view?usp=sharing


Rendered Sample Video
https://drive.google.com/file/d/1RhcbLt3Z_9wAVIiRbpWSvPn-KiIet4Vn/view?usp=sharing

(OLD) Google Drive link:
https://drive.google.com/file/d/1v8UB78T83wrvyklnUNU0gwcPUEtZI7C2/view

(OLD) Dropbox link:
https://www.dropbox.com/s/aqsoxicemhb6wkj/Untitled.mp4?dl=0


Useful information:

Hardware:
GPU: nvidia GTX 1080 (Base clock) Driver ver. 26.21.14.4587
CPU: Intel Core i7 9700k @ base clock (3.6 Ghz)
Monitor Info: 1920x1080p@144hz 1ms response time

Software:
OBS
Vegas Pro 14 64 Bit Build 270

GPU acceleration of video processing: OFF


The following videos I have triple checked to ensure i have the right settings and nothing changed.
The videos I used for video settings:



Thank you to anyone who looks at this! I'm at my wits end here.
Project settings and render settings:

OBS Recording Settings:

 

Mediainfo pulls below:
SOURCE

General
Complete name                            : D:\OBS Videos\TESTING SAMPLE.mp4
Format                                   : MPEG-4
Format profile                           : Base Media
Codec ID                                 : isom (isom/iso2/avc1/mp41)
File size                                : 49.1 MiB
Duration                                 : 10 s 717 ms
Overall bit rate mode                    : Variable
Overall bit rate                         : 38.5 Mb/s
Writing application                      : Lavf58.29.100

Video
ID                                       : 1
Format                                   : AVC
Format/Info                              : Advanced Video Codec
Format profile                           : High@L4.2
Format settings                          : CABAC / 2 Ref Frames
Format settings, CABAC                   : Yes
Format settings, Reference frames        : 2 frames
Format settings, GOP                     : M=3, N=120
Codec ID                                 : avc1
Codec ID/Info                            : Advanced Video Coding
Duration                                 : 10 s 717 ms
Bit rate mode                            : Variable
Bit rate                                 : 38.4 Mb/s
Maximum bit rate                         : 60.0 Mb/s
Width                                    : 1 920 pixels
Height                                   : 1 080 pixels
Display aspect ratio                     : 16:9
Frame rate mode                          : Constant
Frame rate                               : 60.000 FPS
Color space                              : YUV
Chroma subsampling                       : 4:2:0
Bit depth                                : 8 bits
Scan type                                : Progressive
Bits/(Pixel*Frame)                       : 0.309
Stream size                              : 49.1 MiB (100%)
Color range                              : Full
Color primaries                          : BT.709
Transfer characteristics                 : BT.709
Matrix coefficients                      : BT.709
Codec configuration box                  : avcC

Audio
ID                                       : 2
Format                                   : AAC LC
Format/Info                              : Advanced Audio Codec Low Complexity
Codec ID                                 : mp4a-40-2
Duration                                 : 10 s 682 ms
Bit rate mode                            : Variable
Bit rate                                 : 2 084 b/s
Maximum bit rate                         : 160 kb/s
Channel(s)                               : 2 channels
Channel layout                           : L R
Sampling rate                            : 44.1 kHz
Frame rate                               : 43.066 FPS (1024 SPF)
Compression mode                         : Lossy
Stream size                              : 2.72 KiB (0%)
Title                                    : Track1
Default                                  : Yes
Alternate group                          : 1

RENDERED

General
Complete name                            : C:\Users\Russell\Documents\RenderedSample.mp4
Format                                   : MPEG-4
Format profile                           : Base Media / Version 2
Codec ID                                 : mp42 (mp42/isom)
File size                                : 18.7 MiB
Duration                                 : 10 s 733 ms
Overall bit rate mode                    : Constant
Overall bit rate                         : 14.6 Mb/s
Encoded date                             : UTC 2020-07-14 16:01:22
Tagged date                              : UTC 2020-07-14 16:01:22

Video
ID                                       : 2
Format                                   : AVC
Format/Info                              : Advanced Video Codec
Format profile                           : High@L4.2
Format settings                          : CABAC / 3 Ref Frames
Format settings, CABAC                   : Yes
Format settings, Reference frames        : 3 frames
Format settings, GOP                     : M=4, N=15
Codec ID                                 : avc1
Codec ID/Info                            : Advanced Video Coding
Duration                                 : 10 s 733 ms
Bit rate mode                            : Constant
Bit rate                                 : 14.0 Mb/s
Width                                    : 1 920 pixels
Height                                   : 1 080 pixels
Display aspect ratio                     : 16:9
Frame rate mode                          : Constant
Frame rate                               : 60.000 FPS
Standard                                 : NTSC
Color space                              : YUV
Chroma subsampling                       : 4:2:0
Bit depth                                : 8 bits
Scan type                                : Progressive
Bits/(Pixel*Frame)                       : 0.113
Stream size                              : 18.0 MiB (96%)
Language                                 : English
Encoded date                             : UTC 2020-07-14 16:01:22
Tagged date                              : UTC 2020-07-14 16:01:22
Color range                              : Limited
Color primaries                          : BT.709
Transfer characteristics                 : BT.709
Matrix coefficients                      : BT.709
Codec configuration box                  : avcC

Audio
ID                                       : 1
Format                                   : AAC LC
Format/Info                              : Advanced Audio Codec Low Complexity
Codec ID                                 : mp4a-40-2
Duration                                 : 10 s 731 ms
Bit rate mode                            : Constant
Bit rate                                 : 558 kb/s
Nominal bit rate                         : 384 kb/s
Channel(s)                               : 2 channels
Channel layout                           : L R
Sampling rate                            : 48.0 kHz
Frame rate                               : 46.875 FPS (1024 SPF)
Compression mode                         : Lossy
Stream size                              : 732 KiB (4%)
Language                                 : English
Encoded date                             : UTC 2020-07-14 16:01:22
Tagged date                              : UTC 2020-07-14 16:01:22

Comments

Former user wrote on 7/14/2020, 8:10 AM

If you uploaded a 1080p60 video that wasn't pixilated but youtube created a pixilated video when it re-encoded I don't see how that's your fault. Other's might disagree

Russell-Hoover wrote on 7/14/2020, 8:14 AM

If you uploaded a 1080p60 video that wasn't pixilated but youtube created a pixilated video when it re-encoded I don't see how that's your fault. Other's might disagree

Hey, thank you for mentioning that as I forgot to mention that detail. The video you see on YouTube is exactly how it looks as an MP4 file on my computer. I don't think it is youtube this time.

Musicvid wrote on 7/14/2020, 9:14 AM

[EDIT] Thanks for posting the relevantto information! We should be able to help you.

Yes, YouTube degrades all video uploads.

That's why when uploading samples, we need the real deal on Drive or Dropbox, not on social media places that re-encode.

Start here, paying particular attention to Section C, so your source and encoding settings will not be a mystery.

https://www.vegascreativesoftware.info/us/forum/important-information-required-to-help-you--110457/

Dexcon wrote on 7/14/2020, 9:25 AM

Just adding to @Musicvid 's comment, I have never seen a YT video that is anywhere near the same quality of almost any DVD or BD at the same rez.

Cameras: Sony FDR-AX100E; GoPro Hero 11 Black Creator Edition

Installed: Vegas Pro 15, 16, 17, 18, 19, 20, 21 & 22, HitFilm Pro 2021.3, DaVinci Resolve Studio 19.0.3, BCC 2025, Mocha Pro 2025.0, NBFX TotalFX 7, Neat NR, DVD Architect 6.0, MAGIX Travel Maps, Sound Forge Pro 16, SpectraLayers Pro 11, iZotope RX11 Advanced and many other iZ plugins, Vegasaur 4.0

Windows 11

Dell Alienware Aurora 11:

10th Gen Intel i9 10900KF - 10 cores (20 threads) - 3.7 to 5.3 GHz

NVIDIA GeForce RTX 2080 SUPER 8GB GDDR6 - liquid cooled

64GB RAM - Dual Channel HyperX FURY DDR4 XMP at 3200MHz

C drive: 2TB Samsung 990 PCIe 4.0 NVMe M.2 PCIe SSD

D: drive: 4TB Samsung 870 SATA SSD (used for media for editing current projects)

E: drive: 2TB Samsung 870 SATA SSD

F: drive: 6TB WD 7200 rpm Black HDD 3.5"

Dell Ultrasharp 32" 4K Color Calibrated Monitor

 

LAPTOP:

Dell Inspiron 5310 EVO 13.3"

i5-11320H CPU

C Drive: 1TB Corsair Gen4 NVMe M.2 2230 SSD (upgraded from the original 500 GB SSD)

Monitor is 2560 x 1600 @ 60 Hz

Musicvid wrote on 7/14/2020, 9:50 AM

,And to add to @Dexcon

Avoid all video tutorials that tell you the "Best Settings," because they don't exist!

An honest tutorial will give you a "starting point" for a specific type of video for a particular use. I see that both of those authors have no clue about rendering compliant REC 709 levels for upload. Schoolyard BS.

Russell-Hoover wrote on 7/14/2020, 10:03 AM

Yes, YouTube degrades all video uploads.

That's why when uploading samples, we need the real deal on Drive or Dropbox, not on social media places that re-encode.

Start here, paying particular attention to Section C, so your source and encoding settings will not be a mystery.

https://www.vegascreativesoftware.info/us/forum/important-information-required-to-help-you--110457/

I have edited the post to include all of this information now.

Musicvid wrote on 7/14/2020, 10:30 AM

Yes, now I think you will be pleased. Your video shows both compression artifacting and shadow noise. This is due to four things:

  1. Your OBS capture settings
  2. Your Vegas render settings
  3. Your badly clipped luminance and chroma levels
  4. Youtube's processing deficiencies

You can do nothing about #4, even by rendering 1440. Youtube's motion handling is horrid at all resolutions. Vimeo is better about this.

So, let's take them one at a time. Here is a suggested starting point (not "best settings") for your OBS capture. You are currently using a lossy hardware encoder with suboptimal bitrate for digital intermediate use at 60p. I guarantee that it can be improved on. Start here, and post back with your impression of the captured AVI video and upload the sample. It must be short, like 10 seconds. Is it safe to assume your native monitor resolution is 1920x1080?

[Edit]] Fixed audio setting

Russell-Hoover wrote on 7/14/2020, 11:22 AM

Yes, now I think you will be pleased. Your video shows both compression artifacting and shadow noise. This is due to four things:

  1. Your OBS capture settings
  2. Your Vegas render settings
  3. Your badly clipped luminance and chroma levels
  4. Youtube's processing deficiencies

You can do nothing about #4, even by rendering 1440. Youtube's motion handling is horrid at all resolutions.

So, let's take them one at a time. Here is a suggested starting point (not "best settings") for your OBS capture. You are currently using a lossy encoder with suboptimal bitrate for digital intermediate use. I guarantee you it can be improved on. Start here, and post back with your impression of the captured video. Is it safe to assume your native monitor resolution is 1920x1080?

 

Please don't get ahead of me with downstream questions. It's not our first rodeo.

BLUF: Updated OBS settings and posted pictures and uploaded new source and render videos. Very minor change, but not to where I want it to be in terms of the pixelation.

I am not well educated on encoders, however I dont expect you can give me a full lesson on a forum thread. However I did ensure I now am using NVIDIA NVENC H .264 (new) for the encoder. I changed my Rate Control to VBR and set to as shown in the new pictures depicting my OBS settings. After taking an even closer look at the source video, I've now noticed some pixelation, (where the glow from the lava touches the root structure, in the same general area as the original video) but not much. Rendered video still has the same pixelation.

Edit: Yes, I am running a 1920x1080 monitor. Hardware information now reflects that.
Edit 2: Do I need to record the video in a AVI format? It is currently recording as a mp4 file.
EDIT 3: I didn't notice the "Hold on, its coming". Ill change my settings and update everything accordingly and get back with you when done.

Musicvid wrote on 7/14/2020, 11:47 AM

If you are using the NVENC encoder in OBS, that is exactly what I am attempting to steer you away from. It is horrid, and moreso at low bitrates such as you are doing. If you "must" insist on using an mp4 capture codec, please do use a software codec (x264 at 18 CRF) not a hardware encoder, please. x264 is about 95% as good as the AVI UT encoder I have "suggested," and far more accurate than hardware encoders. I have run the quantitative tests.

I would, however, like you to try the UT software AVI encoder in the advanced ffmpeg recording setting. It is 100% lossless for your purposes. When we are done, you will have a beautiful mp4 video for Youtube to mangle with its ugly processing.

See the new graphic, which gives the correct audio capture setting.

Also, please do not keep editing your original post. That complicates the process by denying a sequential chain of steps in the troubleshooting process. Thanks.

When you have a capture that looks much better than you are doing know, post the settings and upload the sample. Then, when you are satisfied, we will move on to step #2. This is as much about learning as it is about giving you the "best settings." Thanks for understanding, and I am promising you an improvement.

Russell-Hoover wrote on 7/14/2020, 12:16 PM

After applying your recommended settings, I think I am very happy with how it sits now. It is lossless on my end. I believe I am ready to move on to the next step.

https://drive.google.com/file/d/1Kp9-IW68dn8Kl7OxxqlAMC_rGucXmouM/view?usp=sharing

Video looks a tad bit pixelated from google drive but I don't know if it is just because it may still be processing. When viewing the avi file on my PC its quality is perfect. Looks just like in game.

OBS settings now.

Musicvid wrote on 7/14/2020, 1:40 PM

Great!

Now, open the AVI in Vegas, and go to the Effects button at the top of the Preview. Add the "Levels" effect, then choose the "Computer to Studio RGB" preset. When this is done, your preview will look flatter than before. But is the correct way to level for your MP4 file, which will look correct again when we render it in step 3.

Confirm the change?

Russell-Hoover wrote on 7/14/2020, 1:47 PM

When trying to open the .avi in Vegas 14, I get this error. What is the fix?

 

Musicvid wrote on 7/14/2020, 2:22 PM

Oh, sorry, download and install UT Video codec to your system.

https://www.videohelp.com/software/Ut-Video-Codec-Suite

Your AVI capture looks great, btw!

Russell-Hoover wrote on 7/14/2020, 2:37 PM

Alright, I've applied the effect and preset. What is next?

Chief24 wrote on 7/14/2020, 2:37 PM

@Musicvid Beat me to the download! Was on another page writing about someone and their "CODEC" issue, of which you are contributing to as well. I'm sure I may have missed something there telling the person, so your wisdom/guidance will probably be needed over there to put my answer to the "correct sense"! :)

Self Build: #1 MSI TRX40 Pro Wi-Fi w/3960X (be Quiet! Dark Rock Pro TR4) @ stock; 128GB Team Group 3200 MHz; OS/Apps - WDSN850X PCI-e 4.0x4 4TB, Documents/Extras - WDSN850X PCI-e 4.0x4 4TB; XFX AMD Radeon 7900XTX (24.12.1); Samsung 32 Inch UHD 3840x2160; Windows 11 Pro 64-Bit (24H2 26100.2894); (2) Inland Performance 2TB/(2) PNY 3040 4TB PCI-e on Asus Quad M.2x16; (2) WD RED 4TB; ProGrade USB CFExpress/SD card Reader; LG 16X Blu-Ray Burner; 32 inch Samsung UHD 3840x2160.

VEGAS Pro 20 Edit (411); VEGAS Pro 21 Suite (315); VEGAS Pro 22 Suite (239) & HOS (Happy Otter Scripts); DVD Architect 7.0 (100);

Sound Forge Audio Studio 15; ACID Music Studio 11; SonicFire Pro 6.6.9 (with Vegas Pro/Movie Studio Plug-in); DaVinci Resolve (Free) 19.1.3

#2: Gigabyte TRX50 Aero D w/7960x (Noctua NH-U14S TR5-SP6) @ stock; 128GB Kingston Fury Beast RDIMM @4800 MHz; OS/Apps - Seagate Firecuda 540 2TB PCI-e 5.0x4; Documents/Extras/Source/Transcodes - 4TB WDSN850X PCI-e 4.0x4; 4TB Inland Performance PCI-e 3.0x4; 2TB Inland Performance PCI-e 4.0x4; BlackMagic PCI-e Decklink 4K Mini-Recorder; ProGrade USB SD & Micro SD card readers; LG 32 Inch UHD 3840.x2160: PowerColor Hellhound RX Radeon 7900XT (24.12.1); Windows 11 Pro 64-Bit (24H2 26100.2894)

VEGAS Pro 20 Edit (411); VEGAS Pro 21 Suite (315); VEGAS Pro 22 Suite (239) & HOS; DVD Architect 7.0 (100); Sound Forge Audo Studio 15; Acid Music Studio 11

Canon EOS R6 MkII, Canon EOS R6, Canon EOS R7 (All three set for 4K 24/30/60 Cinema Gamut/CLog3); GoPro Hero 5+ & 6 Black & (2) 7 Black & 9 Black & 10 Black & 11 Black & 12 Black (All set at highest settings - 4K, 5K, & 5.3K mostly at 29.970); Sony FDR AX-53 HandyCam (4K 100Mbps XAVC-S 23.976/29.970)

Musicvid wrote on 7/14/2020, 2:55 PM

OK, open the Sony AVC encoder, 1080 p30 preset, and make the following changes:

I have upped the bitrate because you will be encoding 60p. A little overkill, maybe, but better than the stock 30p setting.

Explanation: The Mainconcept encoder, which you were using, is notorious for shadow noise and blocking (what you call pixelization.) You would really have to jack up Minimum Bitrate in order to overcome the shadow deficiency.

Again, upload your new mp4 so I can check the levels.

Musicvid wrote on 7/14/2020, 2:58 PM

Last step:

Upload your new mp4 to both Youtube and Vimeo. Compare the results, knowing that there is no way to influence what Youtube is about to do, sorry.

Ok, school is out. Feel free to try some things along these guidelines, make lots of good mistakes, and post back with informed questions. We aim to please.

Russell-Hoover wrote on 7/14/2020, 3:27 PM

I've looked at both and despite YouTube's quality this has 100% solved my problem! Video looks great, just how I want it. Thank you for taking the time to help me, I really appreciate it!

Vimeo
https://vimeo.com/438329620

Youtube

Musicvid wrote on 7/14/2020, 3:51 PM

And now you know more than the two guys who put up those "best settings" tutorials.

But it's not me. There are at least a dozen contrbutors here who could have given you nearly the same advice, with equally good results.

Here is a link to more tutorials shared by our contributors, that are considered very reliable for the most part.

https://www.vegascreativesoftware.info/us/forum/got-questions-consult-the-tutorials-first-please--120282/