VEGAS Pro (17 or Later) Video Projection Mapping Tutorial

fr0sty schrieb am 09.08.2020 um 06:31 Uhr

I do this on a larger scale professionally, along with other cool visual tricks with projectors (like projecting onto water droplets). Thanks to VEGAS' Mesh Warp effect, and its integration with VEGAS Post, it can be used as a video projection mapping content creation tool. Here's how to do it... and also a visual representation of exactly what video mapping is, for those of you who don't know.

This is a very simplified form of it, the more advanced projects have us making 3D scans of entire buildings, telling CG animation software specifically where each of the projectors are (as many as dozens of them all shining a part of one big image) in the to-scale virtual set that aligns with where it is in the real world (down to the height it is from the ground and the angle it's pointing at), and months of animating. However, you can do basic mapping in a matter of minutes, and the results are really cool if done right. If you have a projector laying around, try this out... you can map your dresser, closet door, walls and ceiling, any object you can fit into the beam.

It makes for a really cool tool for making unique Halloween or Christmas decorations as well.

Kommentare

RogerS schrieb am 09.08.2020 um 06:41 Uhr

Fascinating- thank for sharing how to do this with the mesh warp filter.

fr0sty schrieb am 09.08.2020 um 06:53 Uhr

This is what happens when you take each face of that cube, map a solid color onto each face of each cube, then export one frame of that (at the native resolution of your projector) into an app like VEGAS Effects (there's some 3D CG stuff in here too), making animations using the image as a guide so you know where each face of each cube is from the projector's point of view, meaning it will all line up right when you project it back onto the real thing (if it it's a little off, Mesh Warp can fix that too!).

This is what happens when you take the same image from the above step, and send it into a 3D animation app like blender or cinema 4D, render a cube to the same dimensions of the real cube(s) in the app, tell it how far away, how high, and what angle the projector is by putting a virtual camera in that exact spot and matching those parameters... check your alignment against the reference image you generated in VEGAS, render those cubes doing stuff in the software, send those frames back into VEGAS, and fix any alignment errors (within reason) in VEGAS using Mesh Warp again.

 

Zuletzt geändert von fr0sty am 09.08.2020, 07:48, insgesamt 3-mal geändert.

Systems:

Desktop

AMD Ryzen 7 1800x 8 core 16 thread at stock speed

64GB 3000mhz DDR4

Geforce RTX 3090

Windows 10

Laptop:

ASUS Zenbook Pro Duo 32GB (9980HK CPU, RTX 2060 GPU, dual 4K touch screens, main one OLED HDR)

Marco. schrieb am 12.08.2020 um 00:52 Uhr

Wow, inspiring!

fr0sty schrieb am 12.08.2020 um 07:07 Uhr

Here's some of my work:

https://www.facebook.com/Imagicvideo/videos/2139688852913647/

And our holographic water screens:

 

Zuletzt geändert von fr0sty am 12.08.2020, 07:09, insgesamt 1-mal geändert.

Systems:

Desktop

AMD Ryzen 7 1800x 8 core 16 thread at stock speed

64GB 3000mhz DDR4

Geforce RTX 3090

Windows 10

Laptop:

ASUS Zenbook Pro Duo 32GB (9980HK CPU, RTX 2060 GPU, dual 4K touch screens, main one OLED HDR)

Musicvid schrieb am 12.08.2020 um 21:41 Uhr

I think I retired from theater production about ten years too early. Congratulations on some mindblowing effects and artistry!

Marco. schrieb am 12.08.2020 um 21:50 Uhr

The Tool album release party - this wasn't an official Tool event, was it?

fr0sty schrieb am 12.08.2020 um 22:02 Uhr

The Tool album release party - this wasn't an official Tool event, was it?

No, just something me and a buddy of mine who has some lasers did for fun, we weren't even technically open to the public, it was more of a private event.

I think I retired from theater production about ten years too early. Congratulations on some mindblowing effects and artistry!

Thank you! Of all of these (besides the water screen stuff), the dance performance took the longest. There was a lot of choreography that had to go into it, making sure the kids stayed in sync with the visuals, and making sure the models we built in CG were the proper scale to align with the real thing when projected, which still required some mesh warping to get it right.

Zuletzt geändert von fr0sty am 12.08.2020, 22:10, insgesamt 2-mal geändert.

Systems:

Desktop

AMD Ryzen 7 1800x 8 core 16 thread at stock speed

64GB 3000mhz DDR4

Geforce RTX 3090

Windows 10

Laptop:

ASUS Zenbook Pro Duo 32GB (9980HK CPU, RTX 2060 GPU, dual 4K touch screens, main one OLED HDR)

Marco. schrieb am 12.08.2020 um 22:13 Uhr

Saw A Perfect Circle last year but no chance to get tickets for a Tool event.

Anyway, this projections are an amazing piece of creativity. Totally different to what I usually do.

fr0sty schrieb am 12.08.2020 um 22:20 Uhr

Tool is an amazing experience. I've been good friends with their lighting designer, Junior, for about 10 years now. He's taught me a lot about how to do a good production, and they keep stepping their game up every time they hit the road. In addition to the lights, lasers, transparent projections, and massive LED screens, their 3D audio is also amazing, and some of the most crystal clear live audio I've ever heard in an arena.

Not to mention the band, they put on a phenomenal experience every time they play.

Thanks for the compliments! Try the tutorial out with a projector, it can be quite addictive! If you get into it, check out Resolume Arena, it's software made for doing this sort of thing on the fly, in real-time. VEGAS' mesh warp capability lets us see how our animations will look properly warped onto a surface without having to leave the app, so it saves a bunch of time, and also lets us "bake in" or "mix down" our mesh warps into the video itself, which frees up CPU from having to do it in real time in Resolume (not that it is much of a CPU intensive process, but any extra power is a good thing!).

Zuletzt geändert von fr0sty am 12.08.2020, 22:24, insgesamt 3-mal geändert.

Systems:

Desktop

AMD Ryzen 7 1800x 8 core 16 thread at stock speed

64GB 3000mhz DDR4

Geforce RTX 3090

Windows 10

Laptop:

ASUS Zenbook Pro Duo 32GB (9980HK CPU, RTX 2060 GPU, dual 4K touch screens, main one OLED HDR)

Marco. schrieb am 13.08.2020 um 14:29 Uhr

... and we waited soooooo long for Fear Inoculum.

It seems it is time to afford a projector soon.

Reyfox schrieb am 13.08.2020 um 15:42 Uhr

Absolutely BRILLIANT!

This would be the last thing on my mind that VP could do!

Newbie😁

Vegas Pro 22 (VP18-21 also installed)

Win 11 Pro always updated

AMD Ryzen 9 5950X 16 cores / 32 threads

32GB DDR4 3200

Sapphire RX6700XT 12GB Driver: 25.3.1

Gigabyte X570 Elite Motherboard

Panasonic G9, G7, FZ300

AVsupport schrieb am 16.08.2020 um 05:59 Uhr

Would VP be able to do a mesh warp transform for a live input?

my current Win10/64 system (latest drivers, water cooled) :

Intel Coffee Lake i5 Hexacore (unlocked, but not overclocked) 4.0 GHz on Z370 chipset board,

32GB (4x8GB Corsair Dual Channel DDR4-2133) XMP-3000 RAM,

Intel 600series 512GB M.2 SSD system drive running Win10/64 home automatic driver updates,

Crucial BX500 1TB EDIT 3D NAND SATA 2.5-inch SSD

2x 4TB 7200RPM NAS HGST data drive,

Intel HD630 iGPU - currently disabled in Bios,

nVidia GTX1060 6GB, always on latest [creator] drivers. nVidia HW acceleration enabled.

main screen 4K/50p 1ms scaled @175%, second screen 1920x1080/50p 1ms.

fr0sty schrieb am 16.08.2020 um 08:54 Uhr

VEGAS doesn't have a mechanism for that, but Resolume Arena does. VEGAS is useful mainly for content creation (especially with Post) and baking mesh warps into one video to reduce CPU strain. Its ability to encode directly to formats like DXV, which arena pretty much requires to work right, is a big plus, since Adobe discontinued support for the format.

Zuletzt geändert von fr0sty am 16.08.2020, 08:56, insgesamt 2-mal geändert.

Systems:

Desktop

AMD Ryzen 7 1800x 8 core 16 thread at stock speed

64GB 3000mhz DDR4

Geforce RTX 3090

Windows 10

Laptop:

ASUS Zenbook Pro Duo 32GB (9980HK CPU, RTX 2060 GPU, dual 4K touch screens, main one OLED HDR)

fr0sty schrieb am 17.08.2020 um 06:47 Uhr

Here's one of my first mapping experiments... overlaying a photo of the wall onto the real thing, then animating it. All done within vegas.

 

Zuletzt geändert von fr0sty am 17.08.2020, 06:50, insgesamt 1-mal geändert.

Systems:

Desktop

AMD Ryzen 7 1800x 8 core 16 thread at stock speed

64GB 3000mhz DDR4

Geforce RTX 3090

Windows 10

Laptop:

ASUS Zenbook Pro Duo 32GB (9980HK CPU, RTX 2060 GPU, dual 4K touch screens, main one OLED HDR)

melmark4 schrieb am 05.11.2020 um 14:52 Uhr

I do this on a larger scale professionally, along with other cool visual tricks with projectors (like projecting onto water droplets). Thanks to VEGAS' Mesh Warp effect, and its integration with VEGAS Post, it can be used as a video projection mapping content creation tool. Here's how to do it... and also a visual representation of exactly what video mapping is, for those of you who don't know.

This is a very simplified form of it, the more advanced projects have us making 3D scans of entire buildings, telling CG animation software specifically where each of the projectors are (as many as dozens of them all shining a part of one big image) in the to-scale virtual set that aligns with where it is in the real world (down to the height it is from the ground and the angle it's pointing at), and months of animating. However, you can do basic mapping in a matter of minutes, and the results are really cool if done right. If you have a projector laying around, try this out... you can map your dresser, closet door, walls and ceiling, any object you can fit into the beam.

It makes for a really cool tool for making unique Halloween or Christmas decorations as well.

Have you or anyone used Vegas to project Christmas videos and pics onto their house? I have pro 15. looks like I would have to upgrade. TIA Mark