@Mindmatter Yeah Boris's answer could've been clearer 🤷‍♂️🤔😕

It's called aliasing, It often occurs if the media is small but it's something i've been chasing for yrs,

I thought this would be quite a good little challenge for me as I've never had to deal with greenscreen footage before. So, I looked up something nasty at 720p to see if BCC Primatte Studio could handle it.

The original greenscreen footage can be found at:

Here's my attempt:

And here are my settings:

And finally, here's a snapshot from Vegas and the GUI.

I think BCC Primatte Studio does a really good job - I'm sure with a little more practise I could get a beautiful result even on this 'nasty' footage...

It looks really bad around the arms, but your source footage is also bad. OP is working with 4K 422 10bit, which is exactly what a chroma keyer wants

Okay - I've had a re-think...

It's best to use BCC Primatte Studio as a layer composite so if need be you can wrap the background colour onto the layer. I haven't done this here, but the edges are now much crisper and I've managed to sit the layer into the composite in a more convincing way.

Here's the revised video:

Here are the revised settings:

Here's a revised snapshot:

@john_dennis thanks John, will do later today . What exactly do you need to show in the workspace? The RGB luminance? My screenshot is actually already an internal Vegas snap taken the way you described at best full.

@john_dennis

Bear with me. This may seem like a hair-brained idea, but...

I had some 300ppi scans of old pictures on heavy material.

The edges were jagged in two planes which caused the Photoshop Magic Wand Tool to give me a jagged selection. I wanted to faithfully follow the contour of the edges and create transparency. I upscaled the pictures by a factor of 10 or more. This took a lot of processing, but the tool was then able to be more discerning in following the contour of the edges.

Humor me and try:

• Upscale your video to the largest pixel dimensions that Vegas will accept and then do your key on the whole screen.

Original Project Here: https://www.vegascreativesoftware.info/us/forum/to-animate-or-not-to-animate-that-is-the-question--109881/

Thanks a lot John, but your procedure, even if it should work, won't hide the fact that Vegas seems to have a serious problem.
I tried 3 different chroma keyers, Ignite chroma key, New Blue chroma key pro, Boris Primatte studio ( the later in composite mode, not as an FX, as they suggest), all 3 have the exact same problem. But now here's a new element:
I downloaded Resolve 17 and watched a quick n'dirty tutorial for keying, as I have no clue how to navigate Resolve. The rudimentary key I was able to do there was CLEAN. No jagged lines whatsoever.
So can someone tell me what on earth is going on in Vegas ??

@Mindmatter

"So can someone tell me what on earth is going on in Vegas ??"

I would be willing to help you investigate what's going on in Vegas, if you will share a few seconds of your original green screen camera video, publicly or privately.

Thanks a lot John, I sent you a PM with a drop box link. Let me know if it works.

I downloaded Resolve 17 and watched a quick n'dirty tutorial for keying, as I have no clue how to navigate Resolve. The rudimentary key I was able to do there was CLEAN. No jagged lines whatsoever.
So can someone tell me what on earth is going on in Vegas ??

Using timeline FX we've seen before with comparisons with Resolve that Resolve can see the true resolution of the picture or video file, but Vegas can only see the timeline resolution, but if your timeline and file is the same resolution and you have not zoomed in with a timeline fx this may be another problem

The Shade Tree Chroma Keyer responds with preliminary comments.

• From the file that I downloaded, the actual workable resolution was ~842 x 1878.

Shooting this type of work in portrait with the camera zoomed past all the lights and onto the green screen would give you larger net pixel dimensions.

• There is little contrast between the talent's clothing and the green background.

Green Screen Vectorscope

Talent's Clothing Vectorscope

• Photoshop 2022 Magic Wand wasn't stellar on the first pass.

Photoshop 2022

Photoshop 2022 Close Up

This is my third attempt...

If you look at my second (an excellent result - not because of any talent I may possess, but the tools provided by BCC Primatte Studio). This one uses the resolution image provided by OP. It's a tricky one to key as there are many factors to consider:

• The green colour bleed onto the figure
• The figures glasses v the amount of adjustment one can make to the outline to get a crisp result

All things considered (as best I can in my experiment) and only using the tools provided in BCC Primatte Studio - nothing else, I think this is also an excellent result. I'm really impressed with the software offered by BorisFX.

Image straight out of VEGAS at original resolution.

Thanks for highlighting this aspect of video editing - greenscreen that I've never attempted. I shall add what I've learned in my three attempts to my rapidly growing arsenal of VEGAS tips and tricks. I, most certainly, shall feel more confident to tackle other projects in the future ... 😉

PS - I found nothing wrong with VEGAS as host to BCC Primatte Studio.

Thank you John and Selina for your time and effort!
I can get rid of the spil on the shiny blue dress, no problem, and get a clean key except for those unbearable jagged lines. ( I had warned them about the reflective costume though).
But even with a contrastier costume, it's terrible.

Selina, I don't know how you did it but also with BBC, I get terrible jagged lines. I suppose it has to do with you working the key on a jpg still image. All keyers are unusable to me in Vegas.

Why should I have to resort to tedious workarounds - it should just work as it's supposed to.
So my question remains: why is it OK in Resolve? what is going wrong here in Vegas?? Where are those artefacts coming from in the first place?

@Former user my project is QHD on a QHD timeline, all is as it should be. The only possible explanation I can think of is that for some reason, the keyers don't see the actual footage resolution. This would be a biggie.

why not make the sample public so we all can test it for you?

@Mindmatter

"I can get rid of the spil on the shiny blue dress, no problem, and get a clean key..."

I'll leave that to you since I don't have any special skills with green screens, but here is a proposal:

Have you tried applying the Chromakey fX as a Media fX?

Here are my Vegas Pro 19-550 results in a UHD project.

Close Up

Ignore the sloppy keying.

@Former user said:

"Using timeline FX we've seen before with comparisons with Resolve that Resolve can see the true resolution of the picture or video file, but Vegas can only see the timeline resolution"

Techno-Philosophical Question of the Day

What resolution does Vegas Pro use for media fX?

@john_dennis yes I actually did this morning, I tried all keyers as media FX. I had the same issue. Jagged lines all over. Your key looks actually good - no jaggies at all - which I just don't understand. Did you use some softening or pre blur?

As I mentioned, it would be an explanation that the chroma key FX treat the footage at very low resolution. At least that's what it looks like.

@Mindmatter

Here are my results in a Vegas Pro 8K project:

Close Up

I think I'll go into academia since I always have more questions than answers and I can always find another research project to propose.

"Did you use some softening or pre blur?"

No.

Look at the jaggies on the pink costume in the other post above - surely that 's a processing issue? It can't be normal.

hmmm wondering if there's something wrong with my system then? But how would that be even possible to just affect chroma keys?