FFMetrics -- Yet another program for quality metrics calculation

fifonik schrieb am 10.07.2020 um 15:58 Uhr

Yet another program for video quality metrics visualization -- FFMetrics. It is a FFMpeg GUI, so all calculations are done by FFMpeg.

The program allow you to select analysed files without dealing with command line and calculate metrics in one go. Well, and build shiny graphs of course.

 

Features:

  • PSNR, SSIM, VMAF visual quality metrics
  • Easy to use UI: drag & drop files from Explorer onto Reference field and Files list or use file choosers
  • Processing up to 12 files in one go
  • Brief media info for reference and distorted files
  • Thumbnail for reference file
  • No limitations on frame size for PSNR/SSIM, Full HD/4K for VMAF
  • “Bad” frames can be extracted and saved as PNG images for further analisys
  • Only parts of video files can be analyzed
  • Frames graphs can be zoomed in/out with mouse wheel (try it over graph or graph's axes), panned with right mouse button and saved as PNG
  • Frames metrics can be saved as tab-delimited csv files and then opened in Excel
  • FFMpeg commands can be saved to log (FFMetrics.log)
  • Average metrics, frames statistics, frame size, bitrate, date/time and file name can be saved to tab-delimited csv file (appended) and then opened in Excel
  • VMAF model selected automatically based on reference media info, but can be changed using UI
  • Supported VMAF models type (pkl or json) detected automatically

 

Requirements:

  • .NET Framework 4.7.2 Runtime. Program should notify if you need to install it. The framework is already included since Windows 10 1803, but if you use Windows 7 or earlier versions of Windows 10, you may be asked to download and install it;
  • FFMpeg.exe. You have to download it from official web site;
  • VMAF metric  require special FFMpeg's build. It is supported since FFMpeg version 4.3 (stable). VMAF model files must be in sub-folder "vmaf-models". The most common models are included in archive.

 

How to use:

  • Unpack into a folder;
  • Put FFMpeg.exe into the program folder or make it available in system %PATH% (The easiest way is to download static build and put ffmpeg.exe directly into the program folder. The best way would be to download shared 64-bit build, unpack it into C:\Program Files\FFMpeg and adjust system %PATH%);
  • Run the program;
  • Use UI to add reference file and at least one distorted file (you can drag & drop them from Explorer or use file choosers);
  • Select metrics you'd like to calculate;
  • Click "Start" button.

 

Project page on github

 

Zuletzt geändert von fifonik

Camcorder: Panasonic X1500 + Panasonic X920 + GoPro Hero 11 Black

Desktop: MB: MSI B450M MORTAR TITANIUM, CPU: AMD Ryzen 5700X, RAM: G'Skill 16 GB DDR4@3200, Graphics card: MSI RX6600 8GB, SSD: Samsung 970 Evo+ 1TB (NVMe, OS), Samsung 870 Evo, HDD WD 4TB, HDD Toshiba 4TB, OS: Windows 10 Pro 22H2

NLE: Vegas Pro [Edit] 11, 12, 13, 15, 17, 18, 19

Kommentare

JN- schrieb am 13.07.2020 um 11:08 Uhr

@fifonik "ffmpeg can calculate PSNR & SSIM in two different ways and values that you can get using different methods are not the same"

OK. That explains the two sets of SSIM and PSNR values in wags app.

I'm looking forward to checking this out fifonik, congrats, thanks.

---------------------------------------------

VFR2CFR, Variable frame rate to Constant frame rate link to zip here.

Copies Video Converts Audio to AAC, link to zip here.

Convert 2 Lossless, link to ZIP here.

Convert Odd 2 Even (frame size), link to ZIP here

Benchmarking Continued thread + link to zip here

Codec Render Quality tables zip

---------------------------------------------

PC ... Corsair case, own build ...

CPU .. i9 9900K, iGpu UHD 630

Memory .. 32GB DDR4

Graphics card .. MSI RTX 2080 ti

Graphics driver .. latest studio

PSU .. Corsair 850i

Mboard .. Asus Z390 Code

 

Laptop… XMG

i9-11900k, iGpu n/a

Memory 64GB DDR4

Graphics card … Laptop RTX 3080

JN- schrieb am 13.07.2020 um 12:57 Uhr

@fifonik Ok, so far the Calculate button is greyed out. Ok fixed, forgot to add the source file, I'm definitely getting too old for this :D.

.

Small other detail, although you mention .NET Framework requirements in your post here, its not in the "readme.txt" requirements, needs to be added there.

Checking the .NET framework v4 can be made easier using this batch file. Just copy and paste the following into a batch file eg call it GetNETv4.bat ...

@echo off
cls
reg query "HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\NET Framework Setup\NDP\v4\full" /v version
pause

Zuletzt geändert von JN- am 13.07.2020, 13:01, insgesamt 1-mal geändert.

---------------------------------------------

VFR2CFR, Variable frame rate to Constant frame rate link to zip here.

Copies Video Converts Audio to AAC, link to zip here.

Convert 2 Lossless, link to ZIP here.

Convert Odd 2 Even (frame size), link to ZIP here

Benchmarking Continued thread + link to zip here

Codec Render Quality tables zip

---------------------------------------------

PC ... Corsair case, own build ...

CPU .. i9 9900K, iGpu UHD 630

Memory .. 32GB DDR4

Graphics card .. MSI RTX 2080 ti

Graphics driver .. latest studio

PSU .. Corsair 850i

Mboard .. Asus Z390 Code

 

Laptop… XMG

i9-11900k, iGpu n/a

Memory 64GB DDR4

Graphics card … Laptop RTX 3080

fifonik schrieb am 13.07.2020 um 13:08 Uhr

> Calculate button is greyed out.

You need to add reference file as well (notice the red input line).

 

> Checking the .NET framework v4 can be made easier

Program checks installed .NET version and add warning in program log. It should suggest to install it if needed. However, I do not have Win 7 to check if this works so I've added this text as pre-cautions. I've added information about .NET requirements in the readme.txt as well. Will be in next "release". Thanks.

Zuletzt geändert von fifonik am 13.07.2020, 13:13, insgesamt 2-mal geändert.

Camcorder: Panasonic X1500 + Panasonic X920 + GoPro Hero 11 Black

Desktop: MB: MSI B450M MORTAR TITANIUM, CPU: AMD Ryzen 5700X, RAM: G'Skill 16 GB DDR4@3200, Graphics card: MSI RX6600 8GB, SSD: Samsung 970 Evo+ 1TB (NVMe, OS), Samsung 870 Evo, HDD WD 4TB, HDD Toshiba 4TB, OS: Windows 10 Pro 22H2

NLE: Vegas Pro [Edit] 11, 12, 13, 15, 17, 18, 19

JN- schrieb am 13.07.2020 um 13:13 Uhr

@fifonik

So far, very nice. The screenshot below is your saved log file with the same file I tested in my batch file

I use a colon delimiter so as to easily import into a spreadsheet. I normally do SSIM, PSNR, VMAF so I rearranged the line to match yours. You can see that the SSIM and PSNR values are identical but the VMAF values are different.

Zuletzt geändert von JN- am 13.07.2020, 13:15, insgesamt 1-mal geändert.

---------------------------------------------

VFR2CFR, Variable frame rate to Constant frame rate link to zip here.

Copies Video Converts Audio to AAC, link to zip here.

Convert 2 Lossless, link to ZIP here.

Convert Odd 2 Even (frame size), link to ZIP here

Benchmarking Continued thread + link to zip here

Codec Render Quality tables zip

---------------------------------------------

PC ... Corsair case, own build ...

CPU .. i9 9900K, iGpu UHD 630

Memory .. 32GB DDR4

Graphics card .. MSI RTX 2080 ti

Graphics driver .. latest studio

PSU .. Corsair 850i

Mboard .. Asus Z390 Code

 

Laptop… XMG

i9-11900k, iGpu n/a

Memory 64GB DDR4

Graphics card … Laptop RTX 3080

fifonik schrieb am 13.07.2020 um 13:24 Uhr

I cannot comment about different values of VMAF. You should have ffmpeg commands in log. Feel free to run them manually and/or compary with your commands you use.

 

As per colon-separator. There are a number of different flavours of csv files. I'm using that is known as "tab delimited". It is also can be imported in Excel if you choose this type in dropdown. If I remember correctly, it even automatically suggest it (cannot check as I do not have Excel at my home PC). I prefer this one as it is also much easier to read.

Zuletzt geändert von fifonik am 13.07.2020, 13:35, insgesamt 2-mal geändert.

Camcorder: Panasonic X1500 + Panasonic X920 + GoPro Hero 11 Black

Desktop: MB: MSI B450M MORTAR TITANIUM, CPU: AMD Ryzen 5700X, RAM: G'Skill 16 GB DDR4@3200, Graphics card: MSI RX6600 8GB, SSD: Samsung 970 Evo+ 1TB (NVMe, OS), Samsung 870 Evo, HDD WD 4TB, HDD Toshiba 4TB, OS: Windows 10 Pro 22H2

NLE: Vegas Pro [Edit] 11, 12, 13, 15, 17, 18, 19

JN- schrieb am 13.07.2020 um 13:30 Uhr

@fifonik I checked my test files, items, 19, 20 and 21 against using your ffmetrics, again, maybe worth to mention that the VMAF are different, all three of my results are a little smaller.

I really like the progress feedback, frames processed per SSIM etc, cool!

 

This is my output from Batch file, formatted for SS import. Colon delimited.

 

Zuletzt geändert von JN- am 13.07.2020, 13:34, insgesamt 3-mal geändert.

---------------------------------------------

VFR2CFR, Variable frame rate to Constant frame rate link to zip here.

Copies Video Converts Audio to AAC, link to zip here.

Convert 2 Lossless, link to ZIP here.

Convert Odd 2 Even (frame size), link to ZIP here

Benchmarking Continued thread + link to zip here

Codec Render Quality tables zip

---------------------------------------------

PC ... Corsair case, own build ...

CPU .. i9 9900K, iGpu UHD 630

Memory .. 32GB DDR4

Graphics card .. MSI RTX 2080 ti

Graphics driver .. latest studio

PSU .. Corsair 850i

Mboard .. Asus Z390 Code

 

Laptop… XMG

i9-11900k, iGpu n/a

Memory 64GB DDR4

Graphics card … Laptop RTX 3080

JN- schrieb am 13.07.2020 um 13:37 Uhr

@fifonik Program checks installed .NET version and add warning in program log. It should suggest to install it if needed.

Excellent, perhaps add that also to your readme, save users like me doing it the hard way.

Indeed, the TAB delimited is easier to read.

Zuletzt geändert von JN- am 13.07.2020, 13:38, insgesamt 1-mal geändert.

---------------------------------------------

VFR2CFR, Variable frame rate to Constant frame rate link to zip here.

Copies Video Converts Audio to AAC, link to zip here.

Convert 2 Lossless, link to ZIP here.

Convert Odd 2 Even (frame size), link to ZIP here

Benchmarking Continued thread + link to zip here

Codec Render Quality tables zip

---------------------------------------------

PC ... Corsair case, own build ...

CPU .. i9 9900K, iGpu UHD 630

Memory .. 32GB DDR4

Graphics card .. MSI RTX 2080 ti

Graphics driver .. latest studio

PSU .. Corsair 850i

Mboard .. Asus Z390 Code

 

Laptop… XMG

i9-11900k, iGpu n/a

Memory 64GB DDR4

Graphics card … Laptop RTX 3080

JN- schrieb am 13.07.2020 um 13:46 Uhr

@fifonik I assume that its only available for FHD, not 4K VMAF?

---------------------------------------------

VFR2CFR, Variable frame rate to Constant frame rate link to zip here.

Copies Video Converts Audio to AAC, link to zip here.

Convert 2 Lossless, link to ZIP here.

Convert Odd 2 Even (frame size), link to ZIP here

Benchmarking Continued thread + link to zip here

Codec Render Quality tables zip

---------------------------------------------

PC ... Corsair case, own build ...

CPU .. i9 9900K, iGpu UHD 630

Memory .. 32GB DDR4

Graphics card .. MSI RTX 2080 ti

Graphics driver .. latest studio

PSU .. Corsair 850i

Mboard .. Asus Z390 Code

 

Laptop… XMG

i9-11900k, iGpu n/a

Memory 64GB DDR4

Graphics card … Laptop RTX 3080

fifonik schrieb am 13.07.2020 um 13:56 Uhr

> I assume that its only available for FHD, not 4K VMAF?

 

Oh, you are right. The included model is for FHD. I will think about 4K.

Camcorder: Panasonic X1500 + Panasonic X920 + GoPro Hero 11 Black

Desktop: MB: MSI B450M MORTAR TITANIUM, CPU: AMD Ryzen 5700X, RAM: G'Skill 16 GB DDR4@3200, Graphics card: MSI RX6600 8GB, SSD: Samsung 970 Evo+ 1TB (NVMe, OS), Samsung 870 Evo, HDD WD 4TB, HDD Toshiba 4TB, OS: Windows 10 Pro 22H2

NLE: Vegas Pro [Edit] 11, 12, 13, 15, 17, 18, 19

JN- schrieb am 13.07.2020 um 14:13 Uhr

@fifonik "I cannot comment about different values of VMAF. You should have ffmpeg commands in log. Feel free to run them manually and/or compary with your commands you use."

Having the commands in the log is excellent. There must be some difference between your version and the one I'm using, yours really, thanks.

I am trying to figure it out, maybe you could take a look at these two lines below. They are obviously giving two slightly different results for VMAF.

The first one is yours, Source and test file, %1 changed already to match mine. I'm outputting to a different file.

ffmpeg -i %1 -i Source.mp4 -lavfi "[0:v]setpts=PTS-STARTPTS[main];[1:v]setpts=PTS-STARTPTS[ref];[main][ref]libvmaf='log_fmt=json:eof_action=endall:model_path=D\:/RQM/00 ffmetrics/vmaf_v0.6.1.pkl:log_path=C\:/Users/John/AppData/Local/Temp/FFMetrics/%1_75641112-c517-4da5-83e0-5c023cf7b7d6.log'" -f null -

 

ffmpeg  -i %1 -i Source.mp4 -lavfi "[0:v]setpts=PTS-STARTPTS[main];[1:v]setpts=PTS-STARTPTS[ref];[main][ref]libvmaf=model_path=vmaf_v0.6.1.pkl:pool=harmonic_mean:eof_action=endall"  2>"ffmpeg VMAF.txt" -f null -

 

Basically, what do I need to change in the second syntax to give similar results to yours?

Zuletzt geändert von JN- am 13.07.2020, 14:22, insgesamt 3-mal geändert.

---------------------------------------------

VFR2CFR, Variable frame rate to Constant frame rate link to zip here.

Copies Video Converts Audio to AAC, link to zip here.

Convert 2 Lossless, link to ZIP here.

Convert Odd 2 Even (frame size), link to ZIP here

Benchmarking Continued thread + link to zip here

Codec Render Quality tables zip

---------------------------------------------

PC ... Corsair case, own build ...

CPU .. i9 9900K, iGpu UHD 630

Memory .. 32GB DDR4

Graphics card .. MSI RTX 2080 ti

Graphics driver .. latest studio

PSU .. Corsair 850i

Mboard .. Asus Z390 Code

 

Laptop… XMG

i9-11900k, iGpu n/a

Memory 64GB DDR4

Graphics card … Laptop RTX 3080

JN- schrieb am 13.07.2020 um 14:23 Uhr

@fifonik Maybe its the "Harmonic Mean"?, I'll check that by leaving it out, hold that thought, I''ll be back.

---------------------------------------------

VFR2CFR, Variable frame rate to Constant frame rate link to zip here.

Copies Video Converts Audio to AAC, link to zip here.

Convert 2 Lossless, link to ZIP here.

Convert Odd 2 Even (frame size), link to ZIP here

Benchmarking Continued thread + link to zip here

Codec Render Quality tables zip

---------------------------------------------

PC ... Corsair case, own build ...

CPU .. i9 9900K, iGpu UHD 630

Memory .. 32GB DDR4

Graphics card .. MSI RTX 2080 ti

Graphics driver .. latest studio

PSU .. Corsair 850i

Mboard .. Asus Z390 Code

 

Laptop… XMG

i9-11900k, iGpu n/a

Memory 64GB DDR4

Graphics card … Laptop RTX 3080

fifonik schrieb am 13.07.2020 um 14:23 Uhr

The difference is: pool=harmonic_mean. You should also double check if the model files are the same.

P.S. The command will be configurable in the FFMetrics soon.

Zuletzt geändert von fifonik am 13.07.2020, 14:24, insgesamt 1-mal geändert.

Camcorder: Panasonic X1500 + Panasonic X920 + GoPro Hero 11 Black

Desktop: MB: MSI B450M MORTAR TITANIUM, CPU: AMD Ryzen 5700X, RAM: G'Skill 16 GB DDR4@3200, Graphics card: MSI RX6600 8GB, SSD: Samsung 970 Evo+ 1TB (NVMe, OS), Samsung 870 Evo, HDD WD 4TB, HDD Toshiba 4TB, OS: Windows 10 Pro 22H2

NLE: Vegas Pro [Edit] 11, 12, 13, 15, 17, 18, 19

JN- schrieb am 13.07.2020 um 14:38 Uhr

@fifonik Just tested, its that, got same result by not using Harmonic Mean, excellent.

Your program loads with the last files used, which is very useful.

If I want to cancel I can of course "X" close the program, but a user might simply want to stop instead because they forgot to add another item. So can a "Cancel" option be added?

---------------------------------------------

VFR2CFR, Variable frame rate to Constant frame rate link to zip here.

Copies Video Converts Audio to AAC, link to zip here.

Convert 2 Lossless, link to ZIP here.

Convert Odd 2 Even (frame size), link to ZIP here

Benchmarking Continued thread + link to zip here

Codec Render Quality tables zip

---------------------------------------------

PC ... Corsair case, own build ...

CPU .. i9 9900K, iGpu UHD 630

Memory .. 32GB DDR4

Graphics card .. MSI RTX 2080 ti

Graphics driver .. latest studio

PSU .. Corsair 850i

Mboard .. Asus Z390 Code

 

Laptop… XMG

i9-11900k, iGpu n/a

Memory 64GB DDR4

Graphics card … Laptop RTX 3080

fifonik schrieb am 13.07.2020 um 22:25 Uhr

can a "Cancel" option be added?

Sure, it is on my todo list.

Camcorder: Panasonic X1500 + Panasonic X920 + GoPro Hero 11 Black

Desktop: MB: MSI B450M MORTAR TITANIUM, CPU: AMD Ryzen 5700X, RAM: G'Skill 16 GB DDR4@3200, Graphics card: MSI RX6600 8GB, SSD: Samsung 970 Evo+ 1TB (NVMe, OS), Samsung 870 Evo, HDD WD 4TB, HDD Toshiba 4TB, OS: Windows 10 Pro 22H2

NLE: Vegas Pro [Edit] 11, 12, 13, 15, 17, 18, 19

JN- schrieb am 14.07.2020 um 11:25 Uhr

@fifonik Everyone seems to have one of those lately. Your app is limited to 10 at a time, maybe this is to do with graphics and colour options?

The functionality of being able to process a lot more files may be something to consider even if it meant disabling some of the format, i.e. an either or capability.

---------------------------------------------

VFR2CFR, Variable frame rate to Constant frame rate link to zip here.

Copies Video Converts Audio to AAC, link to zip here.

Convert 2 Lossless, link to ZIP here.

Convert Odd 2 Even (frame size), link to ZIP here

Benchmarking Continued thread + link to zip here

Codec Render Quality tables zip

---------------------------------------------

PC ... Corsair case, own build ...

CPU .. i9 9900K, iGpu UHD 630

Memory .. 32GB DDR4

Graphics card .. MSI RTX 2080 ti

Graphics driver .. latest studio

PSU .. Corsair 850i

Mboard .. Asus Z390 Code

 

Laptop… XMG

i9-11900k, iGpu n/a

Memory 64GB DDR4

Graphics card … Laptop RTX 3080

fifonik schrieb am 14.07.2020 um 13:41 Uhr

Yes, the number of processed files are limited by graphs. Unfortunately, the plot library I use is very flexible and easy to use, but not very fast.

Camcorder: Panasonic X1500 + Panasonic X920 + GoPro Hero 11 Black

Desktop: MB: MSI B450M MORTAR TITANIUM, CPU: AMD Ryzen 5700X, RAM: G'Skill 16 GB DDR4@3200, Graphics card: MSI RX6600 8GB, SSD: Samsung 970 Evo+ 1TB (NVMe, OS), Samsung 870 Evo, HDD WD 4TB, HDD Toshiba 4TB, OS: Windows 10 Pro 22H2

NLE: Vegas Pro [Edit] 11, 12, 13, 15, 17, 18, 19

JN- schrieb am 14.07.2020 um 16:28 Uhr

@fifonik Anyway, its all very well done, a great addition to wwaggs. No reason any more to be in the dark re: codec quality.

---------------------------------------------

VFR2CFR, Variable frame rate to Constant frame rate link to zip here.

Copies Video Converts Audio to AAC, link to zip here.

Convert 2 Lossless, link to ZIP here.

Convert Odd 2 Even (frame size), link to ZIP here

Benchmarking Continued thread + link to zip here

Codec Render Quality tables zip

---------------------------------------------

PC ... Corsair case, own build ...

CPU .. i9 9900K, iGpu UHD 630

Memory .. 32GB DDR4

Graphics card .. MSI RTX 2080 ti

Graphics driver .. latest studio

PSU .. Corsair 850i

Mboard .. Asus Z390 Code

 

Laptop… XMG

i9-11900k, iGpu n/a

Memory 64GB DDR4

Graphics card … Laptop RTX 3080

fifonik schrieb am 15.07.2020 um 12:50 Uhr

@JN- Thanks

Camcorder: Panasonic X1500 + Panasonic X920 + GoPro Hero 11 Black

Desktop: MB: MSI B450M MORTAR TITANIUM, CPU: AMD Ryzen 5700X, RAM: G'Skill 16 GB DDR4@3200, Graphics card: MSI RX6600 8GB, SSD: Samsung 970 Evo+ 1TB (NVMe, OS), Samsung 870 Evo, HDD WD 4TB, HDD Toshiba 4TB, OS: Windows 10 Pro 22H2

NLE: Vegas Pro [Edit] 11, 12, 13, 15, 17, 18, 19

fifonik schrieb am 17.07.2020 um 05:33 Uhr

Updated.

Changes in version 0.7.0b:

    New:    Calculation can be cancelled
    New:    UI: VMAF model can be selected
    New:    UI: Only small part of video can be processed (pre-defined set on options: 5, 10, 30, 60 seconds, whole file)
    New:    New command line option "-log-level-debug" added (can be useful for investigating issues)
    New:    Error (if any) is shown in tooltip
    Change: UI: slightly re-designed
    Change: UNC paths should be supported now
    Change: VMAF model files now should be in "vmaf-model" sub-folder
    Change: Files limit increased from 10 to 12
    Change: Target changed back to .NET 4.7.2 (included in Windows 10 1803+, older versions of Windows will require .NET 4.7.2 installation)
    Change: Internal changes and optimizations
    Bugfix: Race conditions while working with external process in background thread should be fixed

Camcorder: Panasonic X1500 + Panasonic X920 + GoPro Hero 11 Black

Desktop: MB: MSI B450M MORTAR TITANIUM, CPU: AMD Ryzen 5700X, RAM: G'Skill 16 GB DDR4@3200, Graphics card: MSI RX6600 8GB, SSD: Samsung 970 Evo+ 1TB (NVMe, OS), Samsung 870 Evo, HDD WD 4TB, HDD Toshiba 4TB, OS: Windows 10 Pro 22H2

NLE: Vegas Pro [Edit] 11, 12, 13, 15, 17, 18, 19

JN- schrieb am 18.07.2020 um 02:27 Uhr

@fifonik Excellent. I left my drag and drop batch file at the same download link as the tables, in profile, must do some more testing tomorrow. I think its finished.

---------------------------------------------

VFR2CFR, Variable frame rate to Constant frame rate link to zip here.

Copies Video Converts Audio to AAC, link to zip here.

Convert 2 Lossless, link to ZIP here.

Convert Odd 2 Even (frame size), link to ZIP here

Benchmarking Continued thread + link to zip here

Codec Render Quality tables zip

---------------------------------------------

PC ... Corsair case, own build ...

CPU .. i9 9900K, iGpu UHD 630

Memory .. 32GB DDR4

Graphics card .. MSI RTX 2080 ti

Graphics driver .. latest studio

PSU .. Corsair 850i

Mboard .. Asus Z390 Code

 

Laptop… XMG

i9-11900k, iGpu n/a

Memory 64GB DDR4

Graphics card … Laptop RTX 3080

JN- schrieb am 19.07.2020 um 16:47 Uhr

@fifonik Been busy, only got to download and test now. Great having 4k addition.

Question: RE: VMAF ... should the user be allowed to use the two different sets of PKL files on say FHD and 4k, interchangebly, or should the 4K PKL drop-down be restricted to only 4K files? Also should the non-4K PKL drop-down be restricted to only non-4K files? The return values ARE different.

I assumed that the two sets of PKL files were to be used only for their respective file resolutions?

The option to limit testing to as low as 5s is great for testing.

Zuletzt geändert von JN- am 19.07.2020, 16:49, insgesamt 2-mal geändert.

---------------------------------------------

VFR2CFR, Variable frame rate to Constant frame rate link to zip here.

Copies Video Converts Audio to AAC, link to zip here.

Convert 2 Lossless, link to ZIP here.

Convert Odd 2 Even (frame size), link to ZIP here

Benchmarking Continued thread + link to zip here

Codec Render Quality tables zip

---------------------------------------------

PC ... Corsair case, own build ...

CPU .. i9 9900K, iGpu UHD 630

Memory .. 32GB DDR4

Graphics card .. MSI RTX 2080 ti

Graphics driver .. latest studio

PSU .. Corsair 850i

Mboard .. Asus Z390 Code

 

Laptop… XMG

i9-11900k, iGpu n/a

Memory 64GB DDR4

Graphics card … Laptop RTX 3080

fifonik schrieb am 19.07.2020 um 23:11 Uhr

A valid point about VMAF models. I also thought about this.

However, having in mind that this is only FFMpeg GUI designed for one specific task, it is up to end user to specify what model to use.

If I decide to change this one day, I will need to do the following:

- Create UI/config for model <=> file properties mapping. There are already quite a few VMAF models available and I know nothing about them. At this stage I do not even know if this only depend on resolution or not.

- Add FFProbe as another dependence as I cannot get video file's properties with FFMpeg only.

As a result, I'm not even considering to add this on my ToDo list at this moment. Sorry.

Zuletzt geändert von fifonik am 19.07.2020, 23:12, insgesamt 1-mal geändert.

Camcorder: Panasonic X1500 + Panasonic X920 + GoPro Hero 11 Black

Desktop: MB: MSI B450M MORTAR TITANIUM, CPU: AMD Ryzen 5700X, RAM: G'Skill 16 GB DDR4@3200, Graphics card: MSI RX6600 8GB, SSD: Samsung 970 Evo+ 1TB (NVMe, OS), Samsung 870 Evo, HDD WD 4TB, HDD Toshiba 4TB, OS: Windows 10 Pro 22H2

NLE: Vegas Pro [Edit] 11, 12, 13, 15, 17, 18, 19

JN- schrieb am 20.07.2020 um 02:21 Uhr

@fifonik In case I wasn't clear ... "At this stage I do not even know if this only depend on resolution or not."

I assume that the different models are specific to the resolution, i.e. that the 4K model should only be used with 4K reference and test files. This assumption of course may be wrong. If it's right then what I was suggesting (maybe not clearly enough) was to restrict/lock the drop down selection to match the resolution type in use.

Example don't allow the user to select a 4K model with reference/test files that are not 4K resolution and visa versa.

On a more serious topic, I really have to go shopping for a quality TO DO list, everyone appears to have one nowadays. Nick Hope, WWAAG and now you.

If you know of a good quality product do let me know. :D

Anyway, we're swimming in RQ metrics, great stuff indeed.

Zuletzt geändert von JN- am 20.07.2020, 02:28, insgesamt 2-mal geändert.

---------------------------------------------

VFR2CFR, Variable frame rate to Constant frame rate link to zip here.

Copies Video Converts Audio to AAC, link to zip here.

Convert 2 Lossless, link to ZIP here.

Convert Odd 2 Even (frame size), link to ZIP here

Benchmarking Continued thread + link to zip here

Codec Render Quality tables zip

---------------------------------------------

PC ... Corsair case, own build ...

CPU .. i9 9900K, iGpu UHD 630

Memory .. 32GB DDR4

Graphics card .. MSI RTX 2080 ti

Graphics driver .. latest studio

PSU .. Corsair 850i

Mboard .. Asus Z390 Code

 

Laptop… XMG

i9-11900k, iGpu n/a

Memory 64GB DDR4

Graphics card … Laptop RTX 3080

fifonik schrieb am 20.07.2020 um 03:35 Uhr

This is how I understand you.

Unfortunately, my points are still valid. Using ffmpeg only it is not possible to get video stream properties (including resolution) and it should be some kind of mapping -- what model is for what property. Having "4k" in file name is not enough.

 

Sorry, my todo lists are just a text files (as for the program) or a separate pages in OneNote (depend on usage). Cannot recommend anything fancy.

Camcorder: Panasonic X1500 + Panasonic X920 + GoPro Hero 11 Black

Desktop: MB: MSI B450M MORTAR TITANIUM, CPU: AMD Ryzen 5700X, RAM: G'Skill 16 GB DDR4@3200, Graphics card: MSI RX6600 8GB, SSD: Samsung 970 Evo+ 1TB (NVMe, OS), Samsung 870 Evo, HDD WD 4TB, HDD Toshiba 4TB, OS: Windows 10 Pro 22H2

NLE: Vegas Pro [Edit] 11, 12, 13, 15, 17, 18, 19