dropped frames with iPhone .MOV HD1080 60fps in edit mode

wilri001 wrote on 3/30/2017, 11:57 PM

I'm trying to edit video taken from iPhone6s in HD1080 at 60 fps (.MOV file), but it is dropping A LOT of frames playing from the timeline. I've tried with and without GPU video turned on, and no difference. I've tried the project at 60 fps, and the project at 30 fps with resample disabled, and no difference.

The same file plays with no dropped frames in Pinnacle Studio 19 and Windows movie player.

Is Vegas using the wrong CODEC?

Comments

GJeffrey wrote on 3/31/2017, 12:35 AM

Check this link.

Your video are probably with a variable frame rate (which every NLE don't like), you most probably have to convert it as explained in the above link.

john_dennis wrote on 3/31/2017, 12:46 AM

Is there a 60fps recording option?

john_dennis wrote on 3/31/2017, 1:34 AM

I just discovered a few days ago that VideoReDo TVSuite will losslessly rewrap variable frame rate .MOV files into a form that plays much better in Vegas Pro.

Hint: For some operations VideoReDo TV Suite is a GUI for ffmpeg.

Look at the preview improvement it made on this iPhone 6 video.

NickHope wrote on 3/31/2017, 4:40 AM

I just discovered a few days ago that VideoReDo TVSuite will losslessly rewrap variable frame rate .MOV files into a form that plays much better in Vegas Pro.

Hint: For some operations VideoReDo TV Suite is a GUI for ffmpeg.

Look at the preview improvement it made on this iPhone 6 video.

Nice tip and demo John, but as usual you don't get away that easily...

  1. Does MediaInfo show constant frame rate for the converted file?
  2. Are the bitrates the same?
  3. If you put the following 3 files on the timeline on separate tracks then zoom right in and step through frame by frame, do the frame boundaries line up visually?
    1. The original variable frame rate .mov file
    2. The rewrapped .mp4 file (with presumably constant frame rate)
    3. The file rewrapped to .mp4 without specifying frame rate (hence presumably same variable frame rate as #1)

 

Would do it myself but unfortunately my VideoRedo trial ran out.

 

 

Musicvid wrote on 3/31/2017, 8:58 AM

Does MediaInfo show constant frame rate for the converted file?

MediaInfo misreports many cfr files (Handbrake et al) as variable, making it a poor indicator for non-math head consumers.

What happens is that clock rounding jitter, while minute, is detected and misreported; e.g.,

90Khz / (24x1000/1001) is not rational

-------------------------------------------------------------------------------------------------------------------------------

Video

ID :1

Format :AVC

Format/Info :Advanced Video Codec

Format profile :Main@L4

Format settings, CABAC :Yes

Format settings, ReFrames :3 frames

Codec ID :avc1

Codec ID/Info :Advanced Video Coding

Duration :2h 18mn

Bit rate :773 Kbps

Width :720 pixels

Height :406 pixels

Display aspect ratio :16:9

Frame rate mode :Variable

Frame rate :23.976 fps

Minimum frame rate :23.974 fps

Maximum frame rate :23.981 fps

Color space :YUV

Chroma subsampling :4:2:0

Bit depth :8 bits

Scan type :Progressive

Bits/(Pixel*Frame) :0.110

Stream size :764 MiB (63%)

Writing library :x264 core 142 r2479 dd79a61

-------------------------------------------------------------------------------------------------------------------------------

Meanwhile, MediaInfo dev does not respond to numerous requests to loosen the noose a bit to accommodate, and libav omits a flag that would tell the correct state.

That said, both Handbrake and Videoredo get the job done nicely for Windows NLEs; I have yet to see a dropped/duped/blended frame as a result of rounding jitter.

wilri001 wrote on 3/31/2017, 9:37 AM

Thanks for the explanation. Pinnacle Studio does take a little time to import, so it's probably making a conversion to avoid this problem. I don't do a lot of iPhone video, and don't want to pay for a converter, so I'll just render iPhone video to something Vegas likes, and then use that in my project. Is AVCHD the easiest format for Vegas to play in edit mode? I see a 60i option, but not 60p. Is 60i really interlaced?

Musicvid wrote on 3/31/2017, 10:13 AM

Handbrake is free; however, VRD has lots of advantages, including stream error correction, and noninvasive cut/join with proper gop muxing.

wilri001 wrote on 3/31/2017, 10:24 AM

MediaInfo does show the .MOV file as variable bit rate at 23.6. I used the free non-commercial version of Prism to convert it quickly to .mp4 and Vegas plays it just fine.

john_dennis wrote on 3/31/2017, 10:57 AM

Good science demands independent validation of results. Analyze this!

Notice birds in flight around frame 319 .

I shot a clip with my iPad just for this exercise.

john_dennis wrote on 3/31/2017, 12:22 PM

For Nick:

  • For this exercise, specifying a bit rate in VideoReDo produces the same result as using the default template for "No Change".
  • Both options in VideoRedo increased the duration of the file from 13 s 110 ms to 13 s 114 ms. I presume this is because the new frames are a constant duration where some of the original Quicktime variable length frames were shorter than the target.   

   1.   The original variable frame rate .mov file

Complete name                            : C:\Users\John\Desktop\Rewrap iPhone Video\IMG_0737.MOV
Format                                   : MPEG-4
Format profile                           : QuickTime
Codec ID                                 : qt   0000.00 (qt  )
File size                                : 27.1 MiB
Duration                                 : 13 s 110 ms
Overall bit rate                         : 17.3 Mb/s
Encoded date                             : UTC 2017-03-31 15:09:50
Tagged date                              : UTC 2017-03-31 15:10:03
Writing library                          : Apple QuickTime
com.apple.quicktime.make                 : Apple
com.apple.quicktime.model                : iPad mini 2
com.apple.quicktime.software             : 10.2.1
com.apple.quicktime.creationdate         : 2017-03-31T08:09:50-0700

Video
ID                                       : 1
Format                                   : AVC
Format/Info                              : Advanced Video Codec
Format profile                           : High@L4.1
Format settings, CABAC                   : Yes
Format settings, ReFrames                : 1 frame
Format settings, GOP                     : M=1, N=30
Codec ID                                 : avc1
Codec ID/Info                            : Advanced Video Coding
Duration                                 : 13 s 110 ms
Bit rate                                 : 17.2 Mb/s
Width                                    : 1 920 pixels
Height                                   : 1 080 pixels
Display aspect ratio                     : 16:9
Frame rate mode                          : Variable
Frame rate                               : 29.970 (29970/1000) FPS
Minimum frame rate                       : 28.571 FPS
Maximum frame rate                       : 30.000 FPS
Color space                              : YUV
Chroma subsampling                       : 4:2:0
Bit depth                                : 8 bits
Scan type                                : Progressive
Bits/(Pixel*Frame)                       : 0.278
Stream size                              : 27.0 MiB (100%)
Title                                    : Core Media Video
Encoded date                             : UTC 2017-03-31 15:09:50
Tagged date                              : UTC 2017-03-31 15:10:03
Color range                              : Limited
Color primaries                          : BT.709
Transfer characteristics                 : BT.709
Matrix coefficients                      : BT.709

Audio
ID                                       : 2
Format                                   : AAC
Format/Info                              : Advanced Audio Codec
Format profile                           : LC
Codec ID                                 : 40
Duration                                 : 13 s 110 ms
Source duration                          : 13 s 166 ms
Bit rate mode                            : Constant
Bit rate                                 : 64.0 kb/s
Channel(s)                               : 1 channel
Channel positions                        : Front: C
Sampling rate                            : 44.1 kHz
Frame rate                               : 43.066 FPS (1024 spf)
Compression mode                         : Lossy
Stream size                              : 101 KiB (0%)
Source stream size                       : 101 KiB (0%)
Title                                    : Core Media Audio
Encoded date                             : UTC 2017-03-31 15:09:50
Tagged date                              : UTC 2017-03-31 15:10:03

Other #1
Type                                     : meta
Duration                                 : 13 s 110 ms
Bit rate mode                            : CBR

Other #2
Type                                     : meta
Duration                                 : 13 s 110 ms
Bit rate mode                            : CBR

     2.  The rewrapped .mp4 file (with presumably constant frame rate)

Complete name                            : C:\Users\John\Desktop\Rewrap iPhone Video\From Video Redo.mp4
Format                                   : MPEG-4
Format profile                           : Base Media
Codec ID                                 : isom (isom/iso2/avc1/mp41)
File size                                : 27.1 MiB
Duration                                 : 13 s 143 ms
Overall bit rate                         : 17.3 Mb/s
Writing application                      : Lavf56.25.101

Video
ID                                       : 1
Format                                   : AVC
Format/Info                              : Advanced Video Codec
Format profile                           : High@L4.1
Format settings, CABAC                   : Yes
Format settings, ReFrames                : 1 frame
Format settings, GOP                     : M=1, N=30
Codec ID                                 : avc1
Codec ID/Info                            : Advanced Video Coding
Duration                                 : 13 s 114 ms
Bit rate                                 : 17.2 Mb/s
Width                                    : 1 920 pixels
Height                                   : 1 080 pixels
Display aspect ratio                     : 16:9
Frame rate mode                          : Constant
Frame rate                               : 29.970 (30000/1001) FPS
Color space                              : YUV
Chroma subsampling                       : 4:2:0
Bit depth                                : 8 bits
Scan type                                : Progressive
Bits/(Pixel*Frame)                       : 0.278
Stream size                              : 27.0 MiB (100%)
Color range                              : Limited
Color primaries                          : BT.709
Transfer characteristics                 : BT.709
Matrix coefficients                      : BT.709

Audio
ID                                       : 2
Format                                   : AAC
Format/Info                              : Advanced Audio Codec
Format profile                           : LC
Codec ID                                 : 40
Duration                                 : 13 s 143 ms
Bit rate mode                            : Constant
Bit rate                                 : 63.2 kb/s
Channel(s)                               : 2 channels
Channel(s)_Original                      : 1 channel
Channel positions                        : Front: C
Sampling rate                            : 44.1 kHz
Frame rate                               : 43.066 FPS (1024 spf)
Compression mode                         : Lossy
Stream size                              : 101 KiB (0%)
Default                                  : Yes
Alternate group                          : 1

   3.  The file rewrapped to .mp4 without specifying frame rate (hence presumably same variable frame rate as #1)

Complete name                            : C:\Users\John\Desktop\Rewrap iPhone Video\From Video Redo no frame rate specified.mp4
Format                                   : MPEG-4
Format profile                           : Base Media
Codec ID                                 : isom (isom/iso2/avc1/mp41)
File size                                : 27.1 MiB
Duration                                 : 13 s 143 ms
Overall bit rate                         : 17.3 Mb/s
Writing application                      : Lavf56.25.101

Video
ID                                       : 1
Format                                   : AVC
Format/Info                              : Advanced Video Codec
Format profile                           : High@L4.1
Format settings, CABAC                   : Yes
Format settings, ReFrames                : 1 frame
Format settings, GOP                     : M=1, N=30
Codec ID                                 : avc1
Codec ID/Info                            : Advanced Video Coding
Duration                                 : 13 s 114 ms
Bit rate                                 : 17.2 Mb/s
Width                                    : 1 920 pixels
Height                                   : 1 080 pixels
Display aspect ratio                     : 16:9
Frame rate mode                          : Constant
Frame rate                               : 29.970 (30000/1001) FPS
Color space                              : YUV
Chroma subsampling                       : 4:2:0
Bit depth                                : 8 bits
Scan type                                : Progressive
Bits/(Pixel*Frame)                       : 0.278
Stream size                              : 27.0 MiB (100%)
Color range                              : Limited
Color primaries                          : BT.709
Transfer characteristics                 : BT.709
Matrix coefficients                      : BT.709

Audio
ID                                       : 2
Format                                   : AAC
Format/Info                              : Advanced Audio Codec
Format profile                           : LC
Codec ID                                 : 40
Duration                                 : 13 s 143 ms
Bit rate mode                            : Constant
Bit rate                                 : 63.2 kb/s
Channel(s)                               : 2 channels
Channel(s)_Original                      : 1 channel
Channel positions                        : Front: C
Sampling rate                            : 44.1 kHz
Frame rate                               : 43.066 FPS (1024 spf)
Compression mode                         : Lossy
Stream size                              : 101 KiB (0%)
Default                                  : Yes
Alternate group                          : 1

 

NickHope wrote on 3/31/2017, 1:01 PM

@wilri001 Glad you got it sorted. If you have a lot to do in the future then the double-click-a-batch-file method in the link GJeffrey posted above can't be beaten for speed and simplicity.

MediaInfo misreports many cfr files (Handbrake et al) as variable, making it a poor indicator for non-math head consumers.

What happens is that clock rounding jitter, while minute, is detected and misreported; e.g.,

90Khz / (24x1000/1001) is not rational

Thank you for that. It helps me see this whole slightly-variable-frame-rate thing in a different light. I've always wondered why phones have this "nearly constant" frame rate and now I realise that they're probably trying to be constant.

Good science demands independent validation of results. Analyze this!

Notice birds in flight around frame 319 .

Thanks! Well, every frame lines up. I wasn't sure if I was supposed to be hunting for some easily-overlooked frame-misalignment around frame 319, or just appreciating some birds 😆 (...talking of which, I'm going to the Bangkok International Motor Show tomorrow 😋😇...) By the way, what happened to the luminance?

My takeaway is that, if you have these slightly-variable-frame-rate files from phones and you don't have a converter that will perfectly quantize every frame in the stream to true cfr, it doesn't really matter. But make sure disable resample is set, just to make sure. In hindsight I probably wasted a lot of time and effort when I went down this (then this) path last year.

john_dennis wrote on 3/31/2017, 1:14 PM

"By the way, what happened to the luminance?"

The levels of a .MOV file decoded by Vegas Pro with Quicktime appear to be 000-255.

 The levels of the same file in an .mp4 container decoded by Vegas Pro appear to be ~ Studio RGB.

Musicvid wrote on 3/31/2017, 1:43 PM

That change occurred in Vegas 10 iirc.

john_dennis wrote on 3/31/2017, 2:09 PM

"That change occurred in Vegas 10 iirc."

I can check that when I get back to my machine that has 9-13 on it.

When I use VideoReDo to rewrap my camera video files (Canon G15, AVC + LPCM in a MOV wrapper, Constant Frame Rate) I lose a frame at the start of the file. I have little incentive to do this as Vegas decodes and handles the native files just fine. My Sony 4K TV won't play the camera .MOV files, however, and that just chaps my hide. It won't play XAVC All I, either.

Losing one frame is not the end of my world as the audio doesn't unclamp for four frames at the beginning and end of each file. (I'm not going to miss that when I get a new camera.)

NickHope wrote on 4/1/2017, 12:05 AM

"By the way, what happened to the luminance?"

The levels of a .MOV file decoded by Vegas Pro with Quicktime appear to be 000-255.

 The levels of the same file in an .mp4 container decoded by Vegas Pro appear to be ~ Studio RGB.

I'm seeing a much bigger shift than that. The white point of IMG_0737.MOV is about 192 and the white point of "From Video Redo.mp4" is about 128.

john_dennis wrote on 4/1/2017, 12:23 AM

The levels of the tracks are set to 50% so you could see the frame alignment. Let me get back to you on that.

robert-hite wrote on 4/2/2017, 12:31 AM

All of the sudden I am suffering this problem. I only use my Gopro 60fps and iphone 30fps. I load the gopro footage first to match the video settings then load my iphone footage last. I have never had a problem until last week. Now all of the sudden about half of my iphone footage is greyed out and won't play. I reinstalled Vegas and the issue went away, now its back. The program is constantly crashing and it keeps asking me if I want to search for a missing file that I deleted from the project and the file folder. So, I am downloading 244 hoping this will work. I have used Sony version 12 for years with no issues. I wish I would have stayed with the Sony version.

NickHope wrote on 4/2/2017, 12:41 AM

...Now all of the sudden about half of my iphone footage is greyed out and won't play...

Which iPhone version? Could you upload a sample for us to test?

Rewrapping to .mp4 will probably help in all versions of Vegas.

robert-hite wrote on 4/2/2017, 12:56 AM

Iphone 6, I read your tutorial and checked the codec. All it lists is the audio stream in the properties, no video. I noticed my qt needs an update so Im updating now to see if its fixed

NickHope wrote on 4/2/2017, 1:08 AM

The forum transcodes video uploads so any sample would have to be shared on somewhere like Google Drive, Dropbox, One Drive, Mega.nz or MediaFire.

robert-hite wrote on 4/2/2017, 1:08 AM

I updated QT and still nothing. Im not having this issue on my laptop. I looked at the properties for the same clip and it has a Video line:

 Video: 00:00:32.173, 30.025 fps progressive, 1280x720x24, H.264

I guess its a computer issue...Any ideas?

NickHope wrote on 4/2/2017, 1:14 AM

What version of Quicktime do you have on your laptop?

Best solution is still to rewrap to mp4, which will give you the right luminance, as well as fix other decoding issues. If you get as far as creating the batch file described in section 4, it's literally just a double-click of the file and then you can use the mp4 files created instead of the original mov files.

robert-hite wrote on 4/2/2017, 1:27 AM

Desktop is now 7.7.9 LT is 7.7.7. I loaded an older project on my desktop and it loaded fine, all the iphone clips were there and played fine. Then I reopened my currect project (the one with the issues and all but 3 are working now. I think Ill just convert the clips and re-edit. Just trying to save some time. I'm just confused why all of the sudden this problem started, even as I open previous projects they all work fine. One other issue is that one of the video files I deleted both from the timeline and from my working folder is always referenced when I open this project as missing and if I want to search for the missing file. I dont get that. I have saved the project several times since it was deleted, I looked in the folder to see if there's an sfk file but it won't let go of that deleted file. About half the time this project will load to 72% and hang. Ill have to ctl-alt-del and get it to restart then it asks me about the missing file. Im almost wondering if that's the issue. Thank you for your help!

NickHope wrote on 4/2/2017, 3:26 AM

One other issue is that one of the video files I deleted both from the timeline and from my working folder is always referenced when I open this project as missing and if I want to search for the missing file. I dont get that.

Project Media window > Remove All Unused Media From Project (top left icon)