Iphone 12 Pro Max HEVC Dolby Vision

SDavis wrote on 12/13/2020, 11:52 PM

HI

Clips taken with the iPhone 12 Pro Max using Filmic Pro's HEVC + Dolby Vision settings will not display in Vegas Pro 17. I'm wondering if they will display in Vegas Pro 18 (a reason to upgrade). And if not, if there's any reason to believe they will be supported anytime soon. I'm guessing the answer is "no" but thought I would check. Thanks.

Scott

Comments

wwaag wrote on 12/13/2020, 11:57 PM

I'd suggest you upload a short sample that could be downloaded for test by V18 users.

AKA the HappyOtter at https://tools4vegas.com/. System 1: Intel i7-8700k with HD 630 graphics plus an Nvidia RTX4070 graphics card. System 2: Intel i7-3770k with HD 4000 graphics plus an AMD RX550 graphics card. System 3: Laptop. Dell Inspiron Plus 16. Intel i7-11800H, Intel Graphics. Current cameras include Panasonic FZ2500, GoPro Hero11 and Hero8 Black plus a myriad of smartPhone, pocket cameras, video cameras and film cameras going back to the original Nikon S.

fr0sty wrote on 12/14/2020, 1:31 AM

You can also download the V18 demo.

Systems:

Desktop

AMD Ryzen 7 1800x 8 core 16 thread at stock speed

64GB 3000mhz DDR4

Geforce RTX 3090

Windows 10

Laptop:

ASUS Zenbook Pro Duo 32GB (9980HK CPU, RTX 2060 GPU, dual 4K touch screens, main one OLED HDR)

fr0sty wrote on 12/14/2020, 1:31 AM

That said, it's highly unlikely the iphone 12 camera is capturing anywhere near enough dynamic range to really take advantage of dolby vision.

Last changed by fr0sty on 12/14/2020, 1:32 AM, changed a total of 1 times.

Systems:

Desktop

AMD Ryzen 7 1800x 8 core 16 thread at stock speed

64GB 3000mhz DDR4

Geforce RTX 3090

Windows 10

Laptop:

ASUS Zenbook Pro Duo 32GB (9980HK CPU, RTX 2060 GPU, dual 4K touch screens, main one OLED HDR)

walter-i. wrote on 12/14/2020, 2:07 AM

You can also download the V18 demo.

+1
Testing it yourself makes you smart - especially when it's that easy and informative.

Steve_Rhoden wrote on 12/15/2020, 12:35 PM

Upload a short sample that we can test!

SDavis wrote on 12/17/2020, 9:51 PM

Thought I would provide an update. I went ahead and upgraded to Vegas 18.0. When I loaded the clip I got a message that said that the HEVC codec was successiful installed. However when I went to play it back it won't display. Same as before. I'm guessing the reason for this is that Magix would need the cooperation from Apple in order to get this to work which may not be forthcoming which I think is unfortunate. The image quality is really nice and I would like to be able to use it natively.

From where I sit, the future of cinematography is phones which rely increasingly on computational photography. It seems like Magix is already vested in AI with their deep learning module and that maybe they would be well positioned to support codecs that rely on computation for image quality. Obviously this isn't going to work without the cooperation of the phone manufacturers. The relentless promotion of Vegas upgrades, including the popup that loaded to buy Vegas 18 from a fresh Vegas 18 install, makes me worry about their financial health.

Happy holidays.

RogerS wrote on 12/17/2020, 11:13 PM

Can you share Media Info for this file? Vegas does work in general with HEVC taken on phones. If this is a brand new format, don't expect it to be supported already.

Is legacy HEVC decoding checked on File I/O if so, uncheck it.

Does this format require the NLE to take part in the computation? Otherwise if the processing happens in phone, it's just another file.

This seems to have some info about the format, and that support in Apple's own FinalCut was forthcoming.
https://www.newsshooter.com/2020/10/14/apple-iphone-12-pro-4k-10-bit-hdr/

SDavis wrote on 12/18/2020, 12:06 AM

Thanks for the info.

Format: HEVC, Attributes: 3840 x 2160 x32, Color Space Rec 2020 HLG (1000 Nites), Color Range: Limited

I was thinking the reason it wasn't working is that I need a new codec for Apple's version of 10 bit color. One other data point that seems worth mentioning: the audio works fine.

HEVC legacy coding is unchecked.

I don't know whether the NLE is required to take part in the computation. I was assuming that it wasn't.

I was kind of expecting it wasn't going to work because it's so new. It would be helpful to know whether there are any plans to support it.

Best

 

RogerS wrote on 12/18/2020, 1:18 AM

Can you make a couple second sample available (link to Dropbox, Google Drive, etc., etc.?)

Dolby Vision appears to be its own HDR format, with dynamic metadata, and I don't think it's one that Vegas supports. Support looks like a mess, even within the Apple ecosystem. Magix says they have a backlog of formats to support including popular raw ones.

Last changed by RogerS on 12/18/2020, 1:44 AM, changed a total of 1 times.

Custom PC (2022) Intel i5-13600K with UHD 770 iGPU with latest driver, MSI z690 Tomahawk motherboard, 64GB Corsair DDR5 5200 ram, NVIDIA 2080 Super (8GB) with latest studio driver, 2TB Hynix P41 SSD and 2TB Samsung 980 Pro cache drive, Windows 11 Pro 64 bit https://pcpartpicker.com/b/rZ9NnQ

ASUS Zenbook Pro 14 Intel i9-13900H with Intel graphics iGPU with latest ASUS driver, NVIDIA 4060 (8GB) with latest studio driver, 48GB system ram, Windows 11 Home, 1TB Samsung SSD.

VEGAS Pro 21.208
VEGAS Pro 22.239

Try the
VEGAS 4K "sample project" benchmark (works with VP 16+): https://forms.gle/ypyrrbUghEiaf2aC7
VEGAS Pro 20 "Ad" benchmark (works with VP 20+): https://forms.gle/eErJTR87K2bbJc4Q7

lenard wrote on 12/18/2020, 3:24 AM

 

I was kind of expecting it wasn't going to work because it's so new. It would be helpful to know whether there are any plans to support it.

Best

 

It should still play even if it can't decode the HDR. The videos playback fine on the usual quality editors like Premiere and Resolve. It even plays back sluggishly on Windows movie maker, and effortlessly using Filmora9, which I haven't updated for a year as I don't use it.

I downloaded this sample video a month ago and no longer have link, but I have direct link from my download manager which might work for others if original poster can't supply a video sample https://eidsaw.am.files.1drv.com/y4mMlBp4DZNShCQ2PCR4EJZTNCRK1b7AGhjouXqyxXlyrFBwcoFnHttkorpXz11yZPWB6cQBv8fg1nJgNF8Kfnxl2fqcvdYgB4pJu9aYyijSpsbsJwToqeIQI-hH9zanDTuTmySI_YxObon4tiT6vdUsMDlstMHke5FabztFAlhZG3S0maXKF5b5qDAVHlGzeJXJl9pNYVTrl6wT9frwbhJfQ

SDavis wrote on 12/18/2020, 2:20 PM

I want to confirm that the clip you posted was shot in Filmic Pro 4k with HEVC/Dolby Vision selected. I can't get Windows Media Player to play my clip.

Here's a link to a test file. It's only a two second clip, but it should work for test purposes.

https://drive.google.com/file/d/13foM9OADo0Xd_xxLIN5LPeaRzWHZreSQ/view?usp=sharing

Best,

Scott

 

lenard wrote on 12/18/2020, 6:53 PM

Nothing I tried could make the files work in Vegas Pro. Although it does playback (without gpu decode) in Windows Video Editor and pauses every few seconds on my slower computer it's video doesn't look right, maybe the way HDR output would appear if played on a non HDR monitor (don't have HDR monitor)

This is another situation where everything will playback a video codec including my 1year old $70 budget NLE, but not Vegas.

SDavis wrote on 12/18/2020, 7:10 PM

I think I'm going to give up on this. Thanks for your time.

I wonder what the future holds for Magix. They are kind of at the whim of the companies making cameras, some of whom have no incentive to make life easy for competitors. It may be that in a couple years the only companies left are the ones that can afford vertical integration of cameras and video editing software. (Maybe even including workstations.) Which kind of sucks. I have better things to do than to learn another video editor.

RogerS wrote on 12/18/2020, 9:18 PM

If you stick with non-proprietary HDR formats (HLG, HDR10) Vegas works fine. Usually for proprietary formats the maker gives a way to convert it for general use. In the article above it said even Apple FinalCut didn't support this format in October. I wouldn't really worry about Vegas or third-party NLEs. They aren't going anywhere.

This file plays back in Resolve but doesn't seem to be HDR (though I don't really know how to do HDR in Resolve). If it doesn't actually support the features of DolbyHDR, just playing back doesn't mean much.

Here's MediaInfo for this file:

General
Complete name                  : D:\Downloads\ATHX1092.MOV
Format                         : MPEG-4
Format profile                 : QuickTime
Codec ID                       : qt   0000.00 (qt  )
File size                      : 27.3 MiB
Duration                       : 1 s 840 ms
Overall bit rate               : 124 Mb/s
Encoded date                   : UTC 2020-12-18 19:16:36
Tagged date                    : UTC 2020-12-18 19:16:38
Writing library                : Apple QuickTime
com.apple.quicktime.location.I : +48.1163-122.7523/
com.apple.quicktime.publisher  : ISO: 34.0
com.apple.quicktime.software   : Created with FiLMiC Pro 6.12.8 build 15878

Video
ID                             : 1
Format                         : HEVC
Format/Info                    : High Efficiency Video Coding
Format profile                 : Main 10@L6.2@Main
HDR format                     : Dolby Vision, Version 1.0, dvhe.08.0D, BL+RPU
Codec ID                       : hvc1
Codec ID/Info                  : High Efficiency Video Coding
Duration                       : 1 s 840 ms
Bit rate                       : 124 Mb/s
Width                          : 3 840 pixels
Height                         : 2 160 pixels
Display aspect ratio           : 16:9
Frame rate mode                : Constant
Frame rate                     : 25.000 FPS
Color space                    : YUV
Chroma subsampling             : 4:2:0
Bit depth                      : 10 bits
Bits/(Pixel*Frame)             : 0.597
Stream size                    : 27.1 MiB (99%)
Title                          : Core Media Video
Encoded date                   : UTC 2020-12-18 19:16:36
Tagged date                    : UTC 2020-12-18 19:16:38
Color range                    : Limited
Color primaries                : BT.2020
Transfer characteristics       : HLG
Matrix coefficients            : BT.2020 non-constant
Codec configuration box        : hvcC+dvvC

Audio
ID                             : 2
Format                         : PCM
Format settings                : Little / Signed
Codec ID                       : lpcm
Duration                       : 1 s 807 ms
Source duration                : 1 s 792 ms
Bit rate mode                  : Constant
Bit rate                       : 768 kb/s
Channel(s)                     : 1 channel
Sampling rate                  : 48.0 kHz
Bit depth                      : 16 bits
Stream size                    : 169 KiB (1%)
Source stream size             : 168 KiB (1%)
Title                          : Core Media Audio
Encoded date                   : UTC 2020-12-18 19:16:36
Tagged date                    : UTC 2020-12-18 19:16:38

SDavis wrote on 12/18/2020, 9:28 PM

Yea, good points. Thanks.

lenard wrote on 12/18/2020, 10:21 PM

 


This file plays back in Resolve but doesn't seem to be HDR (though I don't really know how to do HDR in Resolve). If it doesn't actually support the features of DolbyHDR, just playing back doesn't mean much.

 

You have to turn on dolbyvision, but when you say if it didn't support dolbyhdr that doesn't mean much, the other editors that don't support dolbyvision will still playback the video but not in HDR which is better then what vegas is doing currently which is playing back a black screen.

It doesn't appear that Resolve can export in DolbyVision without a licence, and to get a licence you need to prove to Dolby that you have all the right equipment to do it properly + give them money. This it the HDR export output

 

Writing application                      : Blackmagic Design DaVinci Resolve Studio

Video
ID                                       : 1
Format                                   : HEVC
Format/Info                              : High Efficiency Video Coding
Format profile                           : Main 10@L4.1@Main
HDR format                               : SMPTE ST 2086, HDR10 compatible
Codec ID                                 : hvc1
Codec ID/Info                            : High Efficiency Video Coding
Duration                                 : 32 s 150 ms
Bit rate                                 : 12.8 Mb/s
Width                                    : 1 920 pixels
Height                                   : 1 080 pixels
Display aspect ratio                     : 16:9
Frame rate mode                          : Constant
Frame rate                               : 60.000 FPS
Color space                              : YUV
Chroma subsampling                       : 4:2:0
Bit depth                                : 10 bits
Scan type                                : Progressive
Bits/(Pixel*Frame)                       : 0.103
Stream size                              : 49.2 MiB (89%)
Language                                 : English
Color range                              : Limited
Color primaries                          : BT.2020
Transfer characteristics                 : PQ
Matrix coefficients                      : BT.2020 non-constant
Mastering display color primaries        : BT.2020
Mastering display luminance              : min: 0.0001 cd/m2, max: 4000 cd/m2
Maximum Content Light Level              : 1000 cd/m2
MaxCLL_Original                          : 65535 cd/m2
Maximum Frame-Average Light Level        : 400 cd/m2
MaxFALL_Original                         : 65535 cd/m2
SEI_rbsp_stop_one_bit                    : Missing
Codec configuration box                  : hvcC

RogerS wrote on 12/18/2020, 10:29 PM

Looking at the file format metadata my guess is Vegas will support basic playback. Still, what's the point if it doesn't have the full Dolby functionality? Just shoot a normal format.

SDavis wrote on 12/18/2020, 10:56 PM

I wanted to experiment with 10 bit color depth. I'm not aware of an alternative from an iPhone.

lenard wrote on 12/18/2020, 11:23 PM

Looking at the file format metadata my guess is Vegas will support basic playback. Still, what's the point if it doesn't have the full Dolby functionality? Just shoot a normal format.

You always want to record in highest quality format, where there are no negatives to choosing that option. Iphone12 records 1min 4k60 to 400mb, and 1min 4k60 dolbyvision HDR to 440mb, file size is fine, it's recorded in HEVC but because the file is 420 10bit regular GPU's will decode it fine. The other option is 4K60 AVC which is about 800mb, there is no AVC option for DolbyVision.

So you might suggest he records in AVC, non HDR, for easiest playback and compatibility with Vegas, but he shouldn't have to throw away added detail in his master, Vegas should be able to read the file and play it back in SDR the way Filmora9 does, and they way Resolve does when HDR settings are turned off.

Your thinking reminds me of people that uploaded to youtube in 2006 in 240p because what's the point of choosing a higher resolution, as only 240p exisits on youtube. Maybe Vegas will read dolbyvision files in the future, or the poster changes to another NLE that does. To actively choose a lower quality format for the sole reason your current editor doesn't support it is regressive. At minimum make a transcode that works in vegas, 10bit contains so much more detail for an editor to work with

RogerS wrote on 12/18/2020, 11:52 PM

Looking at the file format metadata my guess is Vegas will support basic playback. Still, what's the point if it doesn't have the full Dolby functionality? Just shoot a normal format.

You always want to record in highest quality format, where there are no negatives to choosing that option. Iphone12 records 1min 4k60 to 400mb, and 1min 4k60 dolbyvision HDR to 440mb, file size is fine, it's recorded in HEVC but because the file is 420 10bit regular GPU's will decode it fine. The other option is 4K60 AVC which is about 800mb, there is no AVC option for DolbyVision.

So you might suggest he records in AVC, non HDR, for easiest playback and compatibility with Vegas, but he shouldn't have to throw away added detail in his master, Vegas should be able to read the file and play it back in SDR the way Filmora9 does, and they way Resolve does when HDR settings are turned off.

Your thinking reminds me of people that uploaded to youtube in 2006 in 240p because what's the point of choosing a higher resolution, as only 240p exisits on youtube. Maybe Vegas will read dolbyvision files in the future, or the poster changes to another NLE that does. To actively choose a lower quality format for the sole reason your current editor doesn't support it is regressive. At minimum make a transcode that works in vegas, 10bit contains so much more detail for an editor to work with

Actually, that isn't what I'm saying. I'm not against higher quality capture, but rather not a fan of proprietary or bleeding-edge formats that aren't well supported. HDR is already too full of standards wars and incompatibilities.

It looks like the answer today for this footage is to go with IPhone apps, Final Cut X or Resolve 17 (I can't find DolbyHDR in 16 so it must have been added recently). Hopefully Vegas will at least be able to play this format back, but for the full benefit of 10-bit and DolbyHDR (which appears to have license fees), who knows. Might need a plan B.

SDavis wrote on 12/19/2020, 1:36 AM

Thanks all for input and time.

VEGASHeman wrote on 12/23/2020, 9:40 AM

@SDavis: Can you describe your system configuration (CPU/GPU)?

We downloaded and tested the couple of clips posted in this thread, and could preview them fine on our Intel systems, but did see problems on a Ryzen system, which points to an issue with the software Intel decoder we use. We are planning to update that, so I would consider this a bug, and not a feature deficiency: we should be able to read in the iPhone12 HEVC files, even if we don't support Dolby Vision HDR processing.

SDavis wrote on 12/23/2020, 2:48 PM

Intel Core i9-10850K (5.2ghz Turbo) (20 thread) (10 core)

Motherboard: ASUS Prime Z490-P /MSI Z490-A Pro (Intel Z490 Chipset)

Graphics Card: 1 x PNY Quadro P2200

A couple other data points:

1. I loaded the beach clip into DaVinci Resolve and got essentially same behavior. The audio plays but not the video. The only difference is the clip shows up as "Media Offline." I'm not sure what that's supposed to mean in this context. The video is offline, but the audio isn't?

Scott

 

j-v wrote on 12/23/2020, 3:05 PM

@SDavis:
Because you have an Intel system I think, listening to @VEGASHeman, you have to be a little patient and have to wait until the next update of VPro 18. I'm curious how those files then behave with you.

met vriendelijke groet
Marten

Camera : Pan X900, GoPro Hero7 Hero Black, DJI Osmo Pocket, Samsung Galaxy A8
Desktop :MB Gigabyte Z390M, W11 home version 24H2, i7 9700 4.7Ghz,16 DDR4 GB RAM, Gef. GTX 1660 Ti with driver
566.14 Studiodriver and Intel HD graphics 630 with driver 31.0.101.2130
Laptop  :Asus ROG Str G712L, W11 home version 23H2, CPU i7-10875H, 16 GB RAM, NVIDIA GeForce RTX 2070 with Studiodriver 576.02 and Intel UHD Graphics 630 with driver 31.0.101.2130
Vegas software: VP 10 to 22 and VMS(pl) 10,12 to 17.
TV      :LG 4K 55EG960V

My slogan is: BE OR BECOME A STEM CELL DONOR!!! (because it saved my life in 2016)