Semi live keying, can it be done inexpensivly?

gary-kohout wrote on 8/9/2012, 8:04 PM

Hello all,
What I'm wanting to do is do some training videos, and the instructor is going to actually be "in" the work area of the software. This will be a 3d CAD package, so i want the instructor to be able to for example, push the rectangle icon with his hand, then draw the rectangle with his finger. Then he would magically extend it into 3D.

Here's the problem, i need the instructor to be able to see himself on the screen, while he is inside the software so he can see where to virtually push icons etc. kind of like a weather person, except I won't be recording that part. The camera would still be recording just the instructor in front of the green screen. i guess what is really needed is some way to overlay the video feed from my camera over the screen of the 3d software. In other words, this would just be a guide for the actor to know where he's at, but the actually keying would take place in post. Any ideas?
Gary

Comments

Steve Grisetti wrote on 8/9/2012, 9:07 PM

That's not something video editing software can do, ghoot.

It's more a function of a production board. Like this:
http://www.vixid.com/index.php?m=4&rub=3&lang=en&gclid=CLOWidL827ECFaERNAodDT4Agw

(Although there is apparently software to make it work on a Mac. http://www.thedvshow.com/10-tools-for-live-chroma-keying/ )

ADB wrote on 8/9/2012, 9:33 PM

If you capture the process from the CAD package, you could use a 3d avatar in Blender, Maya, 3d studio etc to follow it.

DocSatori wrote on 8/10/2012, 5:51 AM

Lots of creative ways to do this. Here's my first intuitive idea.

Make the graphics adapt to the instructor AFTER filming the instructor - if possible. Do this either by employing Movie Studio PAN&CROP and TRACK MOTION techniques. Or, bring stills of your TALENT into your graphics application.

If it's not possible OR, IF IT is:

If you're recording with a 'semi-professional' or 'professional' camera where you can hook-up an external monitor - set some points on the monitor (put some erasable marker lines on or similar) either based on the premade graphics or at least where you want them to be later and have your talent follow to the 'marks' on the monitor.

These set marks are valuable if multiple takes are necessary which have to be edited together.

If a monitor attached to your camera(s) is not possible - a 'rustic' solution is to have some poster boards or similar drawing surface behind your 'cameras' that your talent can be gesturing to. At the least, some sticky notes or masking tape on a wall behind the camera.

If you need more precision with the gestures, you can have 'green' things on set with the talent so the talent finds the same spots/points/shapes everytime. For example, I have hung chromakeyed cloth balls from the ceiling based on where objects would be in the graphics overlay.

That's just spitballing to get your creative juices going. But, since I'm not exactly sure how much precision you require or how complex your graphic environment will be...I'll stop here.

gary-kohout wrote on 8/10/2012, 10:09 AM

Thanks guys,
One of the links led me to WireCast that will run on a PC. It would do what I want, but is about $500 and I really don't need the webcast cabability, but will keep it in mind for one day when I have money. LOL $500 really seems like a good deal for what all it does.

Doc, I like the practical ideas. I have a Canon Vixia M40, and it can output to a monitor, so what I may do for now is print a large picture of the 3D CAD interface and tape it to the monitor, with the work area cut out so you could see the video feed. That would take care of the actor interfacing with the icon. A lot of it will be handled in the software for the actual geometry that we model up, but just printing the picture would eliminate a lot of work in editing.

Thank you all for the info and great ideas!
Gary

ADB wrote on 8/10/2012, 5:58 PM

Another approach is to screen capture the CD screen.
Import to Blender 3D (free).
Remove the rectangle and build a replacement in Blender.
Video the instructor doing his thing.
Use Blender camera tracking to track the instructor's finger and make it move the rectangle, as in this test