NEED DROP Frame TC when exporting to 720p Sony MXF

jcloninger wrote on 6/19/2015, 5:48 PM
Hello everyone, I sure hope someone might have a solution to this problem. I've been pulling my hair out for hours over this and I just sent a tech support ticket, but figured I'd post here too.

I'm under a rush to get some episodes to Fox Sports South and my files are being rejected due to not having drop frame timecode. They require OP-1a MXF 720p60 @ 50 Mbps. Everything is fine EXCEPT for the timecode error. YES, in my project properties tab, my ruler IS on DROP. I even changed to Non-Drop to see if maybe there was a bug but there's not a difference. Now if I encode to 1080i, it IS drop frame. However, they CAN'T accept anything but 720p60. If I view the file information with MediaInfo (free little utility) all TC's are ":" for 720p. The 1080i it is ";". Unless I overlooked something, I'm fairly certain that there is a bug that when selecting 1280x720p on the Sony MXF > HD422 1280x720-60p 50 Mbps render template, that it doesn't take the ruler format.


Here's the MediaInfo for the 720p Test Clip (Note the ":" in the timecodes for text streams, etc.
General
Complete name : G:\TEST_FOX_TC-HD_720p.mxf
Format : MXF
Commercial name : XDCAM HD422
Format version : 1.3
Format profile : OP-1a
Format settings : Closed / Complete
File size : 437 MiB
Duration : 1mn 0s
Overall bit rate : 60.9 Mbps
Encoded date : 2015-06-19 22:12:50.000
Writing application : SONY Vegas 13.0.0.453
Writing library : Sony MXF Development Kit (Win32) 4.0.0.5000.1

Video
ID : 2
Format : MPEG Video
Commercial name : XDCAM HD422
Format version : Version 2
Format profile : 4:2:2@High
Format settings, BVOP : Yes
Format settings, Matrix : Custom
Format settings, GOP : M=3, N=12
Format settings, wrapping mode : Frame
Codec ID : 0D01030102046001-0401020201040300
Duration : 1mn 0s
Bit rate : 50.0 Mbps
Width : 1 280 pixels
Height : 720 pixels
Display aspect ratio : 16:9
Frame rate : 59.940 fps
Standard : Component
Color space : YUV
Chroma subsampling : 4:2:2
Bit depth : 8 bits
Scan type : Progressive
Compression mode : Lossy
Bits/(Pixel*Frame) : 0.905
Time code of first frame : 00:00:00:00
Time code source : Group of pictures header
Stream size : 359 MiB (82%)
Color primaries : BT.709
Transfer characteristics : BT.709
Matrix coefficients : BT.709

(REMOVED THE 8 CHANNEL AUDIO & CLOSED CAPTIONS INFO, IRRELEVANT FOR THIS POST)

Other #1
ID : 1-Material
Type : Time code
Format : MXF TC
Time code of first frame : 00:00:00:00
Time code settings : Material Package
Time code, striped : Yes

Other #2
ID : 1-Source
Type : Time code
Format : MXF TC
Time code of first frame : 00:00:00:00
Time code settings : Source Package
Time code, striped : Yes

Other #3
Type : Time code
Format : SMPTE TC
Muxing mode : SDTI
Time code of first frame : 00:00:00:00


________________________________________________
Here's the 1080i Test Clip Info (Note the ";")
General
Complete name : G:\TEST_FOX_TC-HD_1080.mxf
Format : MXF
Commercial name : XDCAM HD422
Format version : 1.3
Format profile : OP-1a
Format settings : Closed / Complete
File size : 433 MiB
Duration : 1mn 0s
Overall bit rate : 60.3 Mbps
Encoded date : 2015-06-19 22:08:05.000
Writing application : SONY Vegas 13.0.0.453
Writing library : Sony MXF Development Kit (Win32) 4.0.0.5000.1

Video
ID : 2
Format : MPEG Video
Commercial name : XDCAM HD422
Format version : Version 2
Format profile : 4:2:2@High
Format settings, BVOP : Yes
Format settings, Matrix : Custom
Format settings, GOP : M=3, N=15
Format settings, picture structure : Frame
Format settings, wrapping mode : Frame
Codec ID : 0D01030102046001-0401020201040300
Duration : 1mn 0s
Bit rate : 50.0 Mbps
Width : 1 920 pixels
Height : 1 080 pixels
Display aspect ratio : 16:9
Frame rate : 29.970 fps
Standard : Component
Color space : YUV
Chroma subsampling : 4:2:2
Bit depth : 8 bits
Scan type : Interlaced
Scan order : Top Field First
Compression mode : Lossy
Bits/(Pixel*Frame) : 0.805
Time code of first frame : 00:00:00:00
Time code source : Group of pictures header
Stream size : 359 MiB (83%)
Color primaries : BT.709
Transfer characteristics : BT.709
Matrix coefficients : BT.709

(REMOVED THE 8 CHANNEL AUDIO & CLOSED CAPTIONS INFO, IRRELEVANT FOR THIS POST)

Other #1
ID : 1-Material
Type : Time code
Format : MXF TC
Time code of first frame : 00:00:00;00
Time code settings : Material Package
Time code, striped : Yes

Other #2
ID : 1-Source
Type : Time code
Format : MXF TC
Time code of first frame : 00:00:00;00
Time code settings : Source Package
Time code, striped : Yes

Other #3
Type : Time code
Format : SMPTE TC
Muxing mode : SDTI
Time code of first frame : 00:00:00;00

Thank you!

Comments

NormanPCN wrote on 6/19/2015, 6:48 PM
It does look like a bug. I can reproduce your report about 720p59.94 Sony MXF 50Mbps 422 output always having nonDrop timecodes.

Maybe you can use some third party tool like ffmpeg/other to change the timecode of your MXF file.
jcloninger wrote on 6/19/2015, 7:12 PM
Thanks. I'll look into that. I hope it's possible. I have 13 episodes too send out, 3 ASAP. Maybe you can put in a request to make a patch?
NormanPCN wrote on 6/19/2015, 7:31 PM
I would not hold my breath regarding an SCS bugfix. Best to find a workaround.

I spent a few minutes trying some ffmpeg stuff and came up with this. It may not be perfect but probably close. It's a start.

ffmpeg.exe -i %1 -timecode 01:00:00;00 -map 0 -acodec copy -vcodec copy "%~dpn1_tc.mxf"
john_dennis wrote on 6/19/2015, 7:48 PM
If you have a copy of Vegas Pro 12, it will possibly open your Vegas Pro 13 projects. It might get a different result for your time code.

Edit:

No, Vegas Pro 12 opens the Vegas 13 project, but gets the same result as your example as indicated by MediaInfo.
john_dennis wrote on 6/19/2015, 8:29 PM
I tried a quick render in Vegas 9 and 10. The results from Mediainfo look the same as your failing example. Do we have a good tool for deciding if this is the reason the files are rejected?

Vegas Pro 9

Complete name : C:\Users\John\Desktop\Time Code Test\VP9 Time Code Test.mxf
Format : MXF
Commercial name : XDCAM HD422
Format profile : OP-1a
Format settings : Closed / Complete
File size : 273 MiB
Duration : 43s 527ms
Overall bit rate : 52.7 Mbps
Encoded date : 2015-06-20 01:22:24.000
Writing application : SONY Vegas 9.0
Writing library : SONY Vegas 9.0

Video
ID : 2
Format : MPEG Video
Commercial name : XDCAM HD422
Format version : Version 2
Format profile : 4:2:2@High
Format settings, BVOP : Yes
Format settings, Matrix : Default
Format settings, GOP : M=3, N=12
Format_Settings_Wrapping : Frame
Duration : 43s 527ms
Bit rate : 50.0 Mbps
Width : 1 280 pixels
Height : 720 pixels
Display aspect ratio : 16:9
Frame rate : 59.940 fps
Standard : Component
Color space : YUV
Chroma subsampling : 4:2:2
Bit depth : 8 bits
Scan type : Progressive
Compression mode : Lossy
Bits/(Pixel*Frame) : 0.905
Time code of first frame : 00:00:00:00
Time code source : Group of pictures header
Stream size : 259 MiB (95%)
Color primaries : BT.709
Transfer characteristics : BT.709
Matrix coefficients : BT.709

Audio #1
ID : 3
Format : PCM
Format settings, Endianness : Little
Format_Settings_Wrapping : Frame (AES)
Duration : 43s 527ms
Bit rate mode : Constant
Bit rate : 768 Kbps
Channel(s) : 1 channel
Sampling rate : 48.0 KHz
Bit depth : 16 bits
Stream size : 3.99 MiB (1%)

Audio #2
ID : 4
Format : PCM
Format settings, Endianness : Little
Format_Settings_Wrapping : Frame (AES)
Duration : 43s 527ms
Bit rate mode : Constant
Bit rate : 768 Kbps
Channel(s) : 1 channel
Sampling rate : 48.0 KHz
Bit depth : 16 bits
Stream size : 3.99 MiB (1%)

Other #1
ID : 1
Type : Time code
Format : MXF TC
Time code of first frame : 00:00:00:00
Time code settings : Striped

Other #2
Type : Time code
Format : SMPTE TC
Muxing mode : SDTI
Time code of first frame : 00:00:00:00

Vegas Pro 10

Complete name : C:\Users\John\Desktop\Time Code Test\VP10 Time Code Test.mxf
Format : MXF
Commercial name : XDCAM HD422
Format profile : OP-1a
Format settings : Closed / Complete
File size : 211 MiB
Duration : 33s 550ms
Overall bit rate : 52.6 Mbps
Encoded date : 2015-06-20 01:34:34.000
Writing application : SONY Vegas 9.0
Writing library : SONY Vegas 9.0

Video
ID : 2
Format : MPEG Video
Commercial name : XDCAM HD422
Format version : Version 2
Format profile : 4:2:2@High
Format settings, BVOP : Yes
Format settings, Matrix : Default
Format settings, GOP : M=3, N=12
Format_Settings_Wrapping : Frame
Duration : 33s 550ms
Bit rate : 50.0 Mbps
Width : 1 280 pixels
Height : 720 pixels
Display aspect ratio : 16:9
Frame rate : 59.940 fps
Standard : Component
Color space : YUV
Chroma subsampling : 4:2:2
Bit depth : 8 bits
Scan type : Progressive
Compression mode : Lossy
Bits/(Pixel*Frame) : 0.905
Time code of first frame : 00:00:00:00
Time code source : Group of pictures header
Stream size : 200 MiB (95%)
Color primaries : BT.709
Transfer characteristics : BT.709
Matrix coefficients : BT.709

Audio #1
ID : 3
Format : PCM
Format settings, Endianness : Little
Format_Settings_Wrapping : Frame (AES)
Duration : 33s 550ms
Bit rate mode : Constant
Bit rate : 768 Kbps
Channel(s) : 1 channel
Sampling rate : 48.0 KHz
Bit depth : 16 bits
Stream size : 3.07 MiB (1%)

Audio #2
ID : 4
Format : PCM
Format settings, Endianness : Little
Format_Settings_Wrapping : Frame (AES)
Duration : 33s 550ms
Bit rate mode : Constant
Bit rate : 768 Kbps
Channel(s) : 1 channel
Sampling rate : 48.0 KHz
Bit depth : 16 bits
Stream size : 3.07 MiB (1%)

Other #1
ID : 1
Type : Time code
Format : MXF TC
Time code of first frame : 00:00:00:00
Time code settings : Striped

Other #2
Type : Time code
Format : SMPTE TC
Muxing mode : SDTI
Time code of first frame : 00:00:00:00
jcloninger wrote on 6/19/2015, 8:54 PM
Norman, I've been playing with a command almost like that. MediaInfo IS showing the timecode as DROP but the Closed Caption streams are getting deleted. These to be exact:
Text #1
ID : 11-CC1
Format : EIA-608
Muxing mode : Ancillary data / CDP
Duration : 1mn 0s
Bit rate mode : Constant
Frame rate : 59.940 fps
Stream size : 0.00 Byte (0%)

Text #2
ID : 11-1
Format : EIA-708
Muxing mode : Ancillary data / CDP
Duration : 1mn 0s
Bit rate mode : Constant
Frame rate : 59.940 fps
Stream size : 0.00 Byte (0%)

So we're definitely on to something!

Ran this command:
>ffmpeg -i G:\_720p.mxf -timecode 01:00:00;00 -map 0 -acodec copy -vcodec copy G
:\_720p_ffmpeg.mxf

Got this error:
Stream #0:9: Data: none
Metadata:
file_package_umid: 0x060A2B340101010501010D23130000
91490747B3A
data_type : vbi_vanc_smpte_436M
Data stream encoding not supported yet (only streamcopy)

I am about 25% on uploading a test file to Fox's FMDA site. I've gotten much further! Now to figure out how to copy those CC streams.
jcloninger wrote on 6/19/2015, 8:54 PM
I tried Version 12. Same result.
jcloninger wrote on 6/19/2015, 8:57 PM
The only tool I can go by is mediainfo AND uploading to Fox's server as it will spit out an ugly error message if it finds something wrong. I'm about 40% into the upload of this test file. Last time I got 1% then error.
For mediainfo, look at OTHER #1 & 2, the timecode should be Time code should end with :00 and not :00. No colon. Needs a semicolon.
NormanPCN wrote on 6/19/2015, 9:03 PM
"Norman, I've been playing with a command almost like that. MediaInfo IS showing the timecode as DROP but the Closed Caption streams are getting deleted. These to be exact:"

Oh well. I don't know anything about CC, and certainly not about how to get ffmpeg to pass the CC through to the new file, or if it has that capability.
musicvid10 wrote on 6/19/2015, 9:07 PM
It might be a Sony design specification. MXF is a wrapper.
jcloninger wrote on 6/19/2015, 9:09 PM
It's a flaw. It works fine the same XDCAM codec the the .mxf wrapper when going to 1080i, but not 720p60.
jcloninger wrote on 6/19/2015, 9:13 PM
""Norman, I've been playing with a command almost like that. MediaInfo IS showing the timecode as DROP but the Closed Caption streams are getting deleted. These to be exact:"

Oh well. I don't know anything about CC, and certainly not about how to get ffmpeg to pass the CC through to the new file, or if it has that capability."
I think it depends on the build of ffmpeg and codecs used during the build. I have an ubuntu server running here so I may compile it with that codec if I find that's the issue...

OK, the upload site accepted that file! But it will be rejected after it goes through QC due to no CC's. Almost there!!!
NormanPCN wrote on 6/19/2015, 9:17 PM
I thought -map 0 copied all streams from src to dest, but apparently only all video and audio. Maybe use a map command to map the #1 and #2 streams, text, from src to dest.

ffmbc might have better capability here with CC.
jcloninger wrote on 6/19/2015, 9:24 PM
I'm compiling ffmbc now.
jcloninger wrote on 6/20/2015, 3:19 PM
Here's the only solution I've found so far... there's no way that I've found to preserve the CC tracks with ffmpeg or ffmbc.

I downloaded the trial of Premiere Pro CC.
After I figured out the basic backwards way they have that laid out and set up the project and sequence:
1- Import the MXF from Vegas.
2- Modify the timecode to DROP Frame.
3- Throw that on the sequence timeline.
4- DELETE the top two video tracks because that shows as CC tracks.
5- COPY the .scc file Vegas generated. Name one with 608 and the other with 708 in the names (same file, but you need both in PP.)
6- Import both .scc files into PP.
7- Right click > Modify the 608 file and set the captions as EIA-608 CC1 AND the timecode to 59.94 DROP timecode.
8- Right click > Modify the 708 file and set the captions as EIA-708 Service 1 AND the timecode to 59.94 DROP timecode.
9- Drag each .scc file on top on a new tract of the video track. Now you'll have EIA 608 & 708 captions in the embedded file (Yes, PP needs a work around too!)
10- File > Export and choose the MXF OP-1a seting.
11- Make sure your audio channels are correct and then captions and choose "Embed in Output File."
12- In the video part, I chose "enable smart rendering" and its faster (I don't think its re-encoding the video.)

So for now, the solution is Premiere Pro CC.
SONY NEEDS TO FIX THIS LITTLE BUG TO ALLOW DROP FRAME TIMECODE ON "SONY MXF > HD422 1280x720-60p 50 Mbps" RENDER TEMPLATE!!!! It works with 1080i!