Hardware decoding files from Fuji X-T3 flog, 8-10bit, HEVC H.265/H.264

LukasDr wrote on 6/21/2021, 10:40 AM

Hi

Is there any way to activate hardware decoding 1080p-4k HEVC H.265/H.264 flog (8-10bit, 100-400Mbit) files from my camera Fuji X-T3. My gfx card is RTX2060.  Windows 10 player decodes it smooth on GPU decoder, Vegas Pro 18 does it on CPU which is painful. I don't want to use proxy, because I need to do color grading so full dynamic is needed. 

Any tips will be much appreciated.  

Sample files you can download from here. https://drive.google.com/drive/folders/19TxJOJXYvbp1ZX0glU_H9T1z89uj8VyP

Lukas

Comments

j-v wrote on 6/21/2021, 12:07 PM

Np problem on my laptop.
Plays smooth in VPro 18 with Preview Full at 25 fps
Hardware decoding at 40 % on GPU from the Intel processor with driverversion igfx_win10_100.9466

Last changed by j-v on 6/21/2021, 12:12 PM, changed a total of 1 times.

met vriendelijke groet
Marten

Camera : Pan X900, GoPro Hero7 Hero Black, DJI Osmo Pocket, Samsung Galaxy A8
Desktop :MB Gigabyte Z390M, W11 home version 24H2, i7 9700 4.7Ghz,16 DDR4 GB RAM, Gef. GTX 1660 Ti with driver
566.14 Studiodriver and Intel HD graphics 630 with driver 31.0.101.2130
Laptop  :Asus ROG Str G712L, W11 home version 23H2, CPU i7-10875H, 16 GB RAM, NVIDIA GeForce RTX 2070 with Studiodriver 576.02 and Intel UHD Graphics 630 with driver 31.0.101.2130
Vegas software: VP 10 to 22 and VMS(pl) 10,12 to 17.
TV      :LG 4K 55EG960V

My slogan is: BE OR BECOME A STEM CELL DONOR!!! (because it saved my life in 2016)

 

JN- wrote on 6/21/2021, 12:19 PM

@LukasDr FWIW I tested playback on both clips. The higher data rate 25fps clip played at full fps.

The other log clip, 50 fps, playback struggled, varied between 5 and full. The GPU video decode varied between 25 and 50%. Set to 8 bit in project properties for both clips.

No proxies used.

The log file struggles alright. Tested using a laptop Nvidia RTX 3080.

Last changed by JN- on 6/21/2021, 12:24 PM, changed a total of 1 times.

---------------------------------------------

VFR2CFR, Variable frame rate to Constant frame rate link to zip here.

Copies Video Converts Audio to AAC, link to zip here.

Convert 2 Lossless, link to ZIP here.

Convert Odd 2 Even (frame size), link to ZIP here

Benchmarking Continued thread + link to zip here

Codec Render Quality tables zip

---------------------------------------------

PC ... Corsair case, own build ...

CPU .. i9 9900K, iGpu UHD 630

Memory .. 32GB DDR4

Graphics card .. MSI RTX 2080 ti

Graphics driver .. latest studio

PSU .. Corsair 850i

Mboard .. Asus Z390 Code

 

Laptop… XMG

i9-11900k, iGpu n/a

Memory 64GB DDR4

Graphics card … Laptop RTX 3080

john_dennis wrote on 6/21/2021, 12:20 PM

Playback is not the best with my RX480, but it works.

JN- wrote on 6/21/2021, 3:21 PM

@LukasDr Ok, I was going out the door, so just tested on laptop. Now tested on PC, similar results, with the non-log file it just plays solid and easy at 25FPS, using either Intel or Nvidia HW Acc.

The Log file struggles also on PC, never a constant 50 FPS whether using Intel or Nvidia HW Acc. PC specs in signature. The GPU usage was similar. I think there is some aspect of log files that the SO4 ... .dll is not handling as well as it should be. Also just left at 8 bit in Project properties.

---------------------------------------------

VFR2CFR, Variable frame rate to Constant frame rate link to zip here.

Copies Video Converts Audio to AAC, link to zip here.

Convert 2 Lossless, link to ZIP here.

Convert Odd 2 Even (frame size), link to ZIP here

Benchmarking Continued thread + link to zip here

Codec Render Quality tables zip

---------------------------------------------

PC ... Corsair case, own build ...

CPU .. i9 9900K, iGpu UHD 630

Memory .. 32GB DDR4

Graphics card .. MSI RTX 2080 ti

Graphics driver .. latest studio

PSU .. Corsair 850i

Mboard .. Asus Z390 Code

 

Laptop… XMG

i9-11900k, iGpu n/a

Memory 64GB DDR4

Graphics card … Laptop RTX 3080

JN- wrote on 6/21/2021, 3:32 PM

OK, something I overlooked. It was fairly obvious given the high data rate of the 25fps file. It's ALL-I and so will always be easier to edit and play back. The 50 fps log file is of IPB type, actually "IPPPPPPPPPPPPPPPPPPPPPPPPI". Both are hevc. But that explains somewhat the easier by far playback of the 25fps file vs the 50fps file.

Just to show the affect that hevc has. On my PC, using a 25fps R5 hevc clog test file 422 10 bit, so no HW decoding possible. I get less than 1 fps on playback. When I convert the file to avc x264 10 bit 422 it plays at normal 25fps. So for the CPU, it appears its the hevc + 10 bit 422 that brings it to its knees, not so the avc 10 bit 422.

Last changed by JN- on 6/21/2021, 3:59 PM, changed a total of 3 times.

---------------------------------------------

VFR2CFR, Variable frame rate to Constant frame rate link to zip here.

Copies Video Converts Audio to AAC, link to zip here.

Convert 2 Lossless, link to ZIP here.

Convert Odd 2 Even (frame size), link to ZIP here

Benchmarking Continued thread + link to zip here

Codec Render Quality tables zip

---------------------------------------------

PC ... Corsair case, own build ...

CPU .. i9 9900K, iGpu UHD 630

Memory .. 32GB DDR4

Graphics card .. MSI RTX 2080 ti

Graphics driver .. latest studio

PSU .. Corsair 850i

Mboard .. Asus Z390 Code

 

Laptop… XMG

i9-11900k, iGpu n/a

Memory 64GB DDR4

Graphics card … Laptop RTX 3080

LukasDr wrote on 6/21/2021, 4:25 PM

Playback is not the best with my RX480, but it works.

Hi. Thanks for that tip. Turning off legacy HEVC decoding solved that issue. Now it works on GPU, smooth and fast.

Thank you all

Lukas

john_dennis wrote on 6/21/2021, 7:27 PM

@LukasDr

You are welcome.

LukasDr wrote on 6/23/2021, 5:44 AM

Hi guys again.

I found some issue in Vegas during testing several codecs. Issue concerns 4k / 59.940 fps imported to project with framerate different than 59.940 and 29.970 fps (these settings work as expected). All other project fps are stuttering during playback and GPU decoder seems to behave not properly.

Please, download that test video https://drive.google.com/file/d/1KNP5-rljAI5-dHuPoaoSupjaiLKf0aJy/view?usp=sharing(4k, 59.940fps, 100Mbit flog, 8bit) and open it in your Vegas with for example 24 fps project.

Here is what you should get:

Could you confirm that? Perhaps it's a bug that need to be reported to developers.

Thanks a lot.

Lukas

RogerS wrote on 6/23/2021, 6:34 AM

Wouldn't an even multiple be required to playback smoothly? A 59fs video on a 24fps timeline is ~2.5x. Anyway I tried it and it works reasonably well here- I assume you have resample disabled in project properties?

Here's the MediaInfo for it:

General
Complete name                  :
Format                         : MPEG-4
Format profile                 : QuickTime
Codec ID                       : qt   0000.00 (qt  )
File size                      : 165 MiB
Duration                       : 13 s 13 ms
Overall bit rate               : 106 Mb/s
Movie_More                     : FUJIFILM DIGITAL CAMERA X-T3
Encoded date                   : UTC 2021-06-23 12:20:27
Tagged date                    : UTC 2021-06-23 12:20:27
Origin                         : Digital Camera
MVTG                           :

Video
ID                             : 1
Format                         : AVC
Format/Info                    : Advanced Video Codec
Format profile                 : High@L5.2
Format settings                : CABAC / 1 Ref Frames
Format settings, CABAC         : Yes
Format settings, Reference fra : 1 frame
Format settings, GOP           : M=1, N=15
Codec ID                       : avc1
Codec ID/Info                  : Advanced Video Coding
Duration                       : 13 s 13 ms
Bit rate                       : 101 Mb/s
Width                          : 3 840 pixels
Height                         : 2 160 pixels
Display aspect ratio           : 16:9
Frame rate mode                : Constant
Frame rate                     : 59.940 (60000/1001) FPS
Color space                    : YUV
Chroma subsampling             : 4:2:0
Bit depth                      : 8 bits
Scan type                      : Progressive
Bits/(Pixel*Frame)             : 0.202
Stream size                    : 156 MiB (95%)
Language                       : English
Encoded date                   : UTC 2021-06-23 12:20:27
Tagged date                    : UTC 2021-06-23 12:20:27
Color range                    : Full
Color primaries                : BT.709
Transfer characteristics       : BT.601
Matrix coefficients            : BT.601
Codec configuration box        : avcC

Audio
ID                             : 2
Format                         : PCM
Format settings                : Little / Signed
Codec ID                       : lpcm
Duration                       : 13 s 13 ms
Bit rate mode                  : Constant
Bit rate                       : 2 304 kb/s
Channel(s)                     : 2 channels
Channel layout                 : L R
Sampling rate                  : 48.0 kHz
Bit depth                      : 24 bits
Stream size                    : 3.57 MiB (2%)
Language                       : English
Encoded date                   : UTC 2021-06-23 12:20:27
Tagged date                    : UTC 2021-06-23 12:20:27

Other
ID                             : 3
Type                           : Time code
Format                         : QuickTime TC
Duration                       : 13 s 13 ms
Bit rate mode                  : Constant
Frame rate                     : 59.940 (60000/1001) FPS
Time code of first frame       : 06:45:26;04
Time code, striped             : Yes
Language                       : English
Encoded date                   : UTC 2021-06-23 12:20:27
Tagged date                    : UTC 2021-06-23 12:20:27

 

JN- wrote on 6/23/2021, 6:38 AM

@LukasDr If I understood your question, the playback stutters if the project FPS properties don’t match the clips FPS.?

If that is the issue then I see no need to download the clip to test as that’s what I would expect to happen, depends on how good a machine you have to some extent. The two frame rates ideally should be the same.

It just gets complicated when there are clips within the same project with multiple different frame rates. In that case it’s usually best to pick a frame rate for projects that matches the most used clips frame rate.

Last changed by JN- on 6/23/2021, 6:40 AM, changed a total of 1 times.

---------------------------------------------

VFR2CFR, Variable frame rate to Constant frame rate link to zip here.

Copies Video Converts Audio to AAC, link to zip here.

Convert 2 Lossless, link to ZIP here.

Convert Odd 2 Even (frame size), link to ZIP here

Benchmarking Continued thread + link to zip here

Codec Render Quality tables zip

---------------------------------------------

PC ... Corsair case, own build ...

CPU .. i9 9900K, iGpu UHD 630

Memory .. 32GB DDR4

Graphics card .. MSI RTX 2080 ti

Graphics driver .. latest studio

PSU .. Corsair 850i

Mboard .. Asus Z390 Code

 

Laptop… XMG

i9-11900k, iGpu n/a

Memory 64GB DDR4

Graphics card … Laptop RTX 3080

LukasDr wrote on 6/23/2021, 7:08 AM

@JN- Ok let me say more detail.  I use 24 fps project settings because I want to do slow motion from files recorded in 120fps and 60 fps. Final render will be 24 fps. I want to work with framrate in the project as is in final render.

Problem is  only with 4k 59fps played in project with different fps than 29.970 and 59.940 (equal or half). So it works badly with 23.976, 24, 25 fps etc. The stuttering is serious. See how big is GPU decoder usage whem playback with stutter (my uploaded YT video). Hmm.

 Half framerate settings like 29 fps works fine.  

All other resolutions like 1080p 24-59fps, 4k 50fps, imported to any type of project works prefect with all variants - no matter what project fps settings I choose.  I can mix clips with different resolutions, framerates in project with no stutter. That's why I think it's some kind of issue / bug.  I think that would be good if you could download the file and check it.  Perhaps it's reproducible issue.

My CPU is Ryzen 5900X 12 core + RTX2050, so hardware performance is OK. 

@rogerss No matter if resample is enabled or disabled, issue still exists.

Same happen if I change framerate on clip in 4K 59fps project to reduce clip framrate from 59 to 24:

JN- wrote on 6/23/2021, 7:34 AM

Am away from PC now, will do later.

---------------------------------------------

VFR2CFR, Variable frame rate to Constant frame rate link to zip here.

Copies Video Converts Audio to AAC, link to zip here.

Convert 2 Lossless, link to ZIP here.

Convert Odd 2 Even (frame size), link to ZIP here

Benchmarking Continued thread + link to zip here

Codec Render Quality tables zip

---------------------------------------------

PC ... Corsair case, own build ...

CPU .. i9 9900K, iGpu UHD 630

Memory .. 32GB DDR4

Graphics card .. MSI RTX 2080 ti

Graphics driver .. latest studio

PSU .. Corsair 850i

Mboard .. Asus Z390 Code

 

Laptop… XMG

i9-11900k, iGpu n/a

Memory 64GB DDR4

Graphics card … Laptop RTX 3080

JN- wrote on 6/23/2021, 9:30 AM

@LukasDr Ok, Tested on laptop. When I set project properties to 59.940, same as media, the last 2/3 of playback is at full fps.

When I set project properties to 23.976 or 24 fps, playback never reaches full 24 fps, stuttering playback.

Will test shortly on PC, I expect similar.

 

Last changed by JN- on 6/23/2021, 9:31 AM, changed a total of 1 times.

---------------------------------------------

VFR2CFR, Variable frame rate to Constant frame rate link to zip here.

Copies Video Converts Audio to AAC, link to zip here.

Convert 2 Lossless, link to ZIP here.

Convert Odd 2 Even (frame size), link to ZIP here

Benchmarking Continued thread + link to zip here

Codec Render Quality tables zip

---------------------------------------------

PC ... Corsair case, own build ...

CPU .. i9 9900K, iGpu UHD 630

Memory .. 32GB DDR4

Graphics card .. MSI RTX 2080 ti

Graphics driver .. latest studio

PSU .. Corsair 850i

Mboard .. Asus Z390 Code

 

Laptop… XMG

i9-11900k, iGpu n/a

Memory 64GB DDR4

Graphics card … Laptop RTX 3080

JN- wrote on 6/23/2021, 9:44 AM

@LukasDr Ok, on PC with PP set to same as video clip, I never get full 59.940, but do get close. 50+ fps.

I get similar to laptop when PP set to 24 fps, stuttery ~ 8fps, but varies. Disabling resample ~ doubles the playback rate ~ 16 fps.

Ok, I think an important update. On PC, in file I/O tab, I changed to Intel decoding, I then get full 23.976/24 fps, happy days. This is only with disable resample. With say smart resample enabled, playback drops to about a third.

The Nvidia GPU usage in TM is much higher ~ 80% than the Intel GPU usage < 40% when either is used for decoding, yet the Intel performs better. Nothing new here, it appears that VP is better optimised towards Intel.

Last changed by JN- on 6/23/2021, 10:10 AM, changed a total of 3 times.

---------------------------------------------

VFR2CFR, Variable frame rate to Constant frame rate link to zip here.

Copies Video Converts Audio to AAC, link to zip here.

Convert 2 Lossless, link to ZIP here.

Convert Odd 2 Even (frame size), link to ZIP here

Benchmarking Continued thread + link to zip here

Codec Render Quality tables zip

---------------------------------------------

PC ... Corsair case, own build ...

CPU .. i9 9900K, iGpu UHD 630

Memory .. 32GB DDR4

Graphics card .. MSI RTX 2080 ti

Graphics driver .. latest studio

PSU .. Corsair 850i

Mboard .. Asus Z390 Code

 

Laptop… XMG

i9-11900k, iGpu n/a

Memory 64GB DDR4

Graphics card … Laptop RTX 3080

JN- wrote on 6/23/2021, 10:00 AM

I know you have Nvidia GPU, which CPU do you have, if Intel can you use iGPU?

---------------------------------------------

VFR2CFR, Variable frame rate to Constant frame rate link to zip here.

Copies Video Converts Audio to AAC, link to zip here.

Convert 2 Lossless, link to ZIP here.

Convert Odd 2 Even (frame size), link to ZIP here

Benchmarking Continued thread + link to zip here

Codec Render Quality tables zip

---------------------------------------------

PC ... Corsair case, own build ...

CPU .. i9 9900K, iGpu UHD 630

Memory .. 32GB DDR4

Graphics card .. MSI RTX 2080 ti

Graphics driver .. latest studio

PSU .. Corsair 850i

Mboard .. Asus Z390 Code

 

Laptop… XMG

i9-11900k, iGpu n/a

Memory 64GB DDR4

Graphics card … Laptop RTX 3080

LukasDr wrote on 6/23/2021, 3:14 PM

@JN- hi. Thanks for tests. It means somethis is wrong with this.

I have Ryzen 5900X, but on laptop I have Intel CPU 8 gen. I will test it.

When it comes to Nvidia vs Intel. I think GPU decoders should easyly handle all that files in every config both Intel and Nvidia. As my test shows - RTX decoder handles 4K 59 fps 400mbit HEVC easyly. Problem is not related to perfomance. Its seems to be software issue, and first suspect is Vegas. Perhaps developers should look at this. How we can get their attention?

JN- wrote on 6/23/2021, 3:39 PM

@LukasDr Hi Lukas. It appears that if intel is available then using it in file I/O for decoding is best. Not sure where Amd is in all of this.

As to why a more powerful dedicated Nvidia gpu (with up to date drivers) is not as good for playback as an iGpu, only the developers know.

You could always file a report. I doubt it will lead anywhere, speaking from personal experience, but you might get lucky.

I hope you get positive results from laptop, I assume it has iGpu.

 

---------------------------------------------

VFR2CFR, Variable frame rate to Constant frame rate link to zip here.

Copies Video Converts Audio to AAC, link to zip here.

Convert 2 Lossless, link to ZIP here.

Convert Odd 2 Even (frame size), link to ZIP here

Benchmarking Continued thread + link to zip here

Codec Render Quality tables zip

---------------------------------------------

PC ... Corsair case, own build ...

CPU .. i9 9900K, iGpu UHD 630

Memory .. 32GB DDR4

Graphics card .. MSI RTX 2080 ti

Graphics driver .. latest studio

PSU .. Corsair 850i

Mboard .. Asus Z390 Code

 

Laptop… XMG

i9-11900k, iGpu n/a

Memory 64GB DDR4

Graphics card … Laptop RTX 3080

RogerS wrote on 6/23/2021, 6:42 PM

Fwiw, I tested with an Intel iGPU and disable resample. I've found the NVIDIA decoder buggy

LukasDr wrote on 6/24/2021, 3:53 AM

Hi guys. Thanks for reply.

So, I tested on my Intel laptop i5 with iGPU. No problem at all in any viariants. So, issue concerns only Nvidia decoder. I will try to reach developers and push this bug to fix. Thanks for help.

 

JN- wrote on 6/24/2021, 5:32 AM

@LukasDr “I will try to reach developers and push this bug to fix.

If you get any feedback maybe let us know here, thanks.

 

 

---------------------------------------------

VFR2CFR, Variable frame rate to Constant frame rate link to zip here.

Copies Video Converts Audio to AAC, link to zip here.

Convert 2 Lossless, link to ZIP here.

Convert Odd 2 Even (frame size), link to ZIP here

Benchmarking Continued thread + link to zip here

Codec Render Quality tables zip

---------------------------------------------

PC ... Corsair case, own build ...

CPU .. i9 9900K, iGpu UHD 630

Memory .. 32GB DDR4

Graphics card .. MSI RTX 2080 ti

Graphics driver .. latest studio

PSU .. Corsair 850i

Mboard .. Asus Z390 Code

 

Laptop… XMG

i9-11900k, iGpu n/a

Memory 64GB DDR4

Graphics card … Laptop RTX 3080

RogerS wrote on 6/24/2021, 6:24 AM

They may be checking here. They've also said they work with NVIDIA (and AMD) to fix issues with the drivers, so there's hope for improvement.

LukasDr wrote on 6/25/2021, 5:37 AM

Hi Again

I found more issues. Two tests.

1. INTEL iGPU - this time with Intel iGPU and 10bit 4K 59.940 fps files. Could you check if you have the same stutter during playback with this 10 bit file?

2. NVIDIA GPU - When I import 10 bit file playback goes mostly fine. But when I activate Color Grading it start stuttering.

10BIT flog 200Mbit HEVC https://drive.google.com/file/d/1KXCcEPdTKNqwE7jxAo_xAVjwFKszgRdx/view?usp=sharing

Thanks.

Lukas

studio-4 wrote on 6/25/2021, 5:58 AM

I didn't quite follow every detail above, but does this mean I would want an Intel CPU over a Ryzen CPU if I'm mostly shooting 23.976? I'm only acquiring 1080p24, but I'm also shooting at up to 240fps in-camera with my Sony FS700 (and playing back at 23.976).

asus laptop system specifications:
Asus 17.3" Republic of Gamers Strix G17 model: 77H0ROG1.
Ryzen 9 5900HX 3.3GHz (4.6GHz boost), eight-core CPU.
Nvidia GeForce RTX 3060 (6GB GDDR6).
32GB Crucial 3200MHz DDR4 (x2 16GB 120-pin SO-DIMMs).
512GB M.2 NMVe PCIe SSD (available second M.2 slot).

OS: installed on 7/1/2021:
Windows 10 Home 64-bit; OS version 20H2; build 19042.1052.
Windows Feature Experience Pack 120.2212.2020.0.

asus laptop installed applications:
Vegas Movie Studio 17 Platinum; version 17.0 (build 221); purchased via download 29 May 2021.
Microsoft Edge (default browser; no plug-ins).

asus laptop OpenFX add-ons:
BorisFX Continuum 2021.5 (subscription).
NewBlue Elements 3 Overlay.

HP desktop system specifications:
HP Z440 Intel Xeon E5-1650 v3 3.5GHz (4GHz-boost), quad-core CPU.
32GB DDR4 ECC RAM.
1TB SATA SSD.
AMD Radeon RX470 4GB
AMD Radeon R7200.

OS:
Windows 10 Pro 64-bit; OS version 20H2; build 19042.985.
Windows Feature Experience Pack 120.2212.2020.0.

HP desktop installed applications:
Vegas Movie Studio 17 Platinum; version 17.0 (build 221); purchased via download 29 May 2021.
Blackmagic Design Media Express 2.3 for Windows 10.
WinDV 1.2.3.
Microsoft Edge (default browser; no plug-ins).

HP desktop OpenFX add-ons:
FXhome Ignite Advanced VFX pack.
BorisFX' Stylize Unit 2020.5.
NewBlue Elements 3 Overlay.

cameras/VTRs:



Sony NEX-FS100 Super35 1080p24/50/60 digital-cine camera.
Sony NEX-FS700 Super35 1080p24/50/60/240/960 high-speed digital-cine camera.
Sony NEX-5R APS-C 1080p60 cameras (x3).
Sony DSR450WSL 2/3" 480p24 16:9 DVCAM camera.
Sony VX1000 1/3" 480i60 4:3 miniDV camera.
Sony DSR11 DVCAM VTR.

personal websites:

YouTube channel: modularfilms

photography/iighting website: http://lightbasics.com/

LukasDr wrote on 6/25/2021, 6:53 AM

@studio-4 The issues concerns 4k/59fps files as my tests showed. All 1080p work fine, both Intel iGPU and Nvidia decoder. CPU has nothing to do in this case.