ok I have this footage
1920 x 1080 @ 25fps (Check This Out)
I want to reframe it in 9:16 (1080 x1920) with the host person in this. because two cameras are used.
but it gives inaccurate tracking.
can someone tell me why this is happening.?
@iEmby Hi, I downloaded your video, the tracking was off, but the man doesn't move much apart from his arms, there's a mic right in front of him, he's wearing a turban (forgive me if that's wrong), the background behind the shelving is dark similar to his beard. I think the AI is just simply struggling to recognise him as the focal feature.
@Gid Can you try this one, tell us if it correctly tracks, doesn't look to be working for me or I don't know
how to use correctly. audio doesnt sync correctly in Vegas but shouldn't matter, the premise if that you want to make a 9:16 version for social media for Daniel Craig.
@UltraVista That one's not too bad, I changed about 6-7 keyframes, 1 when he climbs out of the window, 2-3 walking along the edge, 1 as he goes down the stairs & a couple as he steps between the buildings when the camera turns around (is that panning?) , I could've refined it further without too much bother.
Boris's Mocha people always say don't expect the tracking to be perfect first time around but it will get you close enough for you to then tweak it. This feels similar, it gets it very close & in this clip there's a lot of movement, things passing by the camera/view & a lot of parallax so I'd say it was pretty good, only minor tweaks were needed.
I think if improvements could be made it would be in the fx adjustment, moving the keyframes manually is a little awkward as there's no live update, the image doesn't move until you let go of the keyframe, there's also no sliders or onscreen widgets.
This might get deleted as it's not public material for sharing or whatever the right term is .
@Gid I saw your example and have downloaded as a reference. I wasn't doing it correctly, I thought re-centering subject was sending signals to the AI so when re-analyzed it had a better understanding of what I wanted tracked and the manual tracking was for polishing it after giving the AI extra information for it's better auto tracking, but now I understand the process. I was wondering how well it would work, glad it isn't dependent on faces and looks to recognize people from behind and side. Framing can be a bit off, but it's done much of the work.
I"ll quote your message just in case they need to remove your post, thanks for the demonstration
@UltraVista That one's not too bad, I changed about 6-7 keyframes, 1 when he climbs out of the window, 2-3 walking along the edge, 1 as he goes down the stairs & a couple as he steps between the buildings when the camera turns around (is that panning?) , I could've refined it further without too much bother.
Boris's Mocha people always say don't expect the tracking to be perfect first time around but it will get you close enough for you to then tweak it. This feels similar, it gets it very close & in this clip there's a lot of movement, things passing by the camera/view & a lot of parallax so I'd say it was pretty good, only minor tweaks were needed.
I think if improvements could be made it would be in the fx adjustment, moving the keyframes manually is a little awkward as there's no live update, the image doesn't move until you let go of the keyframe, there's also no sliders or onscreen widgets.
This might get deleted as it's not public material for sharing or whatever the right term is .
@iEmby Hi, I downloaded your video, the tracking was off, but the man doesn't move much apart from his arms, there's a mic right in front of him, he's wearing a turban (forgive me if that's wrong), the background behind the shelving is dark similar to his beard. I think the AI is just simply struggling to recognise him as the focal feature.
ok... the zooming in and zooming out is added by me in PAN & crop..
if there is no Zooming in both footages then can I AI just set fix frame automictically as per person face...?
@iEmby At 7:16 this user is looking at auto reframe, he's new to it as we are, maybe it will help you. We could do with some tutorials with the news AI tools. What was happening with my video looks to be happening to him too, person in frame but gets very close to the frame border and he has to go through fixing up the key frames. He has more difficulty then in my sample, maybe because subject is filmed from back. I'm not sure how this tool works, is it looking for people or objects, if people does it do better when it see's a face. In my example the face in frame did not help with accuracy but it was a wide shot.
@UltraVista In that video the little slider that pops up on the curves keyframes is interesting I hadn't noticed that but only individual keyframes can be changed. In the Lanes option you can select multiple keys & drag them down, but that can lead to anomalies 🤷♂️
& a couple of times I've moved one curves keyframe & it has messed up/moved centre of all the others, I can't explain that 🤷♂️
I've been playing with this quite a bit but i've had this msg when undoing a few times, In that video you shared you could see he got a little messed up & moved on to something else.
In the Lanes option you can select multiple keys & drag them down, but that can lead to anomalies 🤷♂️
& a couple of times I've moved one curves keyframe & it has messed up/moved centre of all the others, I can't explain that 🤷♂️
@Gid I've noticed the same as you, being able to move the grouping of keys is good, wondered what method they'd choose to create that necessary aspect of altering the frame, but there's that strangeness you show. In the example you made it was interesting to see the human hand vs AI with framing, more like a cameraman but also especially going up the stairs something goes wrong. Maybe it's just duplicate frames, did you put the 23.976fps source on a 29.976fps timeline or did the Vegas website media encode do that?
It could be like with optical flow, they both don't work well with duplicated frames
did you put the 23.976fps source on a 29.976fps timeline or did the Vegas website media encode do that?
@Gid I had thought the website media encoder previously adhered to uploaded frame rates up to either 30 or 29.976fps. The other unusual thing - your video was in 4K , normally I'd see resolution reduced to 1080P and lower bitrates
@UltraVista Hi,
I don't have the rendered video I posted above but funny enough I do have the project I saved at that time.
I opened that video not long after you shared it & played with it, rendered it & uploaded it on here, then saved that project & went to bed.
I tried alsorts of things, dragging in on & letting VP change the project size to match the media, I also tried dragging it on a 16:9 project because it is widescreen I thought maybe that is why the fx was putting Bond off centre, (3840x2160 29.97fps is my default project size) , I found it made no difference at 3840x2160 or the video's 3840x1656 & after that I paid little attention to the size or frame rate.
While playing with it I used the undo option to revert back to where i first imported the clip rather than dragging the clip in again & again, it was prob dragged into the 16:9 project at some point & like I say I wasn't paying any attention to the size or FR so just undid to where I first dragged it in.
I've played with it a dozen times since then but didn't save any of them so that orig project I tried first time didn't get written over.
Don't pay any attention to that video I shared, Iike I say I've played with it since & found project size makes no difference to the outcome.
@Gid This is too new to me for me to know if it's me that's making mistakes, but using the same original Bond video when I click the 'project aspect ratio' I get this from the original 3840x1656 video.
This shows AI Reframe from 3 different editors, everything is on default with no corrections, clicked Auto and render. Vegas is on left.
Can't really tell if Vegas is losing track and playing it cool or if it doesn't fully understand the 9:16 AR and why it places person right on edge of border or outside of border. Maybe if original video was 16:9 it would have done a better job.
Center video freaks out when it loses track much like webcam trackers, Track on right gets it pretty much perfect but it coincidentally loves this media content, it will easily lose track in other scenes only using the AUTO button.
@UltraVistaYeah AI is good but still has a bit to go before it's perfect if it ever will be, hopefully it will.
For now I'd use whatever's best or easiest. Like @iEmby's vid he has two static cameras & the subject doesn't move much, so I'd change change the aspect of the two clips first before any editing is done.. I presume his example is just a test of the AI FX.
Like this using just Pan/Crop, this whole vid is 5mins, that includes changing the project size & 1min of watching the clip. 🤷♂️
@iEmby Sorry you didn't event that, that's a fairly standard technique for tracking when the motion of the subject or camera flows evenly & to help the motion you're creating flow without 'jumping'. What you're doing there is creating keyframes irrespective of what's going on on screen, so with this because its backwards & forwards irregularly you look for the apexes of the subject/camera movement like like i did, then place keyframes in between the peaks to refine the tracking being careful not to have two keyframes too close together ..
Sorry you didn't event that,
😂😂 Sad.. I have a little doubt of this. So its a coincident now.
But this technique is fun and fast