VP22 & AI Assistant experience

Comments

Reyfox wrote on 12/29/2024, 11:16 AM

You have to choose to download stock footage. And do not expect it to be exactly the place you are looking for. I believe it's stock footage from the Hub, so if the location you are specifically asking for does not appear, it is because it isn't in the Hub.

In my above video, the Polish mountains have a lot of drone footage.The town of Zakopane, nothing. But again, it was a template. I had 4 separate voice overs, 4 or so pieces of music and lots of footage that would give me an "idea" of what could be done.

I replaced almost everything with my own footage and music, changed the voice over a bit, and added the title at the beginning.

Newbie😁

Vegas Pro 22 (VP18-21 also installed)

Win 11 Pro always updated

AMD Ryzen 9 5950X 16 cores / 32 threads

32GB DDR4 3200

Sapphire RX6700XT 12GB Driver: Pro 23.Q3

Gigabyte X570 Elite Motherboard

Panasonic G9, G7, FZ300

J-Toresen wrote on 12/29/2024, 1:47 PM

@Hajowo

Rember that AI Assistant is av beta og alpha relase:

AI Assistant (Early-access build requires separate feature installer...go here for details on signing up for early early access.) 

Jøran

Hajowo wrote on 12/31/2024, 5:29 AM

Hi.

Meine Erfahrung, AI-Assistente ist zurzeit nur auf English ausgerichtet und selbst dort noch unvollkommen. Ich habe der AI einen Link über eine Google-Map zur Verfügung gestellt mit der Bitte um ein Script. Das Ergebnis wie folgt: Kannst du mir zu dieser Google-Map ein Script erstellen. Mit Szenenbeschreibung und Voiceover.

I'd be happy to help you create a script for the Google Map you provided!

Here's a draft storyboard with detailed scene descriptions and voiceovers:

Scene 1:

(Opening shot of the map, zooming in on the starting point)

Voice_over("Welcome to our journey through the streets of Berlin! We're going to explore some of the city's most iconic landmarks and hidden gems.")

Scene 2:

(Close-up shot of the Brandenburg Gate)

Voice_over("First stop: the Brandenburg Gate. This iconic symbol of German reunification is a must-see for any visitor to Berlin.")

Scene 3:

(Shot of the gate at night, with people walking and taking photos)

Voice_over("As the sun sets, the gate comes alive with activity. It's a popular spot for locals and tourists alike to take in the sights and sounds of this vibrant city.")

Scene 4:

(Cut to a shot of the Berlin Wall Memorial)

Voice_over("Next stop: the Berlin Wall Memorial. This poignant reminder of the city's turbulent past is a powerful tribute to those who fought for freedom.")

Scene 5:

(Shot of the memorial at night, with candles and flowers left in memory)

Voice_over("As we walk along the wall, you can't help but be moved by the stories of those who risked everything to escape persecution. It's a sobering reminder of the importance of human rights and freedom.")

Scene 6:

(Cut to a shot of Checkpoint Charlie)

Voice_over("Now let's head to Checkpoint Charlie, one of the most famous border crossings in Berlin. This former crossing point between East and West Berlin is now a popular tourist attraction.")

Scene 7:

(Shot of people taking photos and posing at the checkpoint)

Voice_over("As you walk through the checkpoint, you can't help but feel like you're stepping back into history. It's an unforgettable experience that will leave you with a deeper understanding of this complex city."

Scene 8:

(Cut to a shot of the Berlin Cathedral)

Voice_over("Finally, let's end our journey at the stunning Berlin Cathedral. This beautiful building is one of the city's most iconic landmarks and offers breathtaking views of the surrounding area.")

Scene 9:

(Shot of the cathedral at night, with lights shining through the stained glass windows)

Voice_over("As we look out over the city from the top of the cathedral, you can't help but feel grateful for this incredible journey. Berlin is a city that will leave you in awe, and we're honored to have shared it with you.")

The End

I hope this draft meets your needs! Let me know if there's anything else I can do for you.

Statt in Bayern landet die KI in Berlin! Total deneben. Ganz anders mein KI-Kumpel klick hier.

Last changed by Hajowo on 12/31/2024, 5:50 AM, changed a total of 1 times.

Gruß Hansi
https://pinnacle-hilfe.boards.net/

Software: DaVinci Resolve 19 Studio, Magix Video Pro X16, Vegas Pro 20,21,22
Kamera: Lumix GH6, G9II, Blackmagic PCC4K, Objektive Leica 12-60, Lumix 12-60, Sigma 16mm und 30mm, Atomos Ninja V+
Desktop: i7-9700K, GTX 1060-6GB, 32 GB RAM, SSDs 2x250GB,1TB, 2TB, 2TB M.2
Mobil: Notebook HP-ProBook 470-G7 Intel i7-10510 U, RAM 32GB, 1TB SSD, 1 TB HDD, Radeon 530.

 

Reyfox wrote on 12/31/2024, 6:41 AM

@Hajowo the AIA is still in a beta state. And the stock footage is coming from Storyblocks. If there is none for the locations that you choose, it will substitute something "similar". Remember, AIA will create a template for you, not an actual finished video with everything correct.

I used it for my video I posted above, and used it as a template, replacing most of the stock footage with my own (some was from the USA while the town is in Poland), but I understood that. I replaced the music with my own from the Vegas Hub and Smartsound using the Vegas Plugin. I added fx, and my usually editing.

 

Newbie😁

Vegas Pro 22 (VP18-21 also installed)

Win 11 Pro always updated

AMD Ryzen 9 5950X 16 cores / 32 threads

32GB DDR4 3200

Sapphire RX6700XT 12GB Driver: Pro 23.Q3

Gigabyte X570 Elite Motherboard

Panasonic G9, G7, FZ300

Hajowo wrote on 12/31/2024, 7:29 AM

Sure, Tony. I know about the beta. That's exactly why I'm pointing out the errors. In the sample, I don't want a film with video, audio and voiceover. I asked the AI ​​for a simple script based on a Google map. The AI ​​couldn't do that. The Google map showed a bike route in the Bavarian Alps, the Vegas AI provided a script about Berlin at the time of the wall between West and East Berlin. So completely wrong. I didn't ask for any stock video.

On the other hand, my freelance AI buddy presented a perfect script. That means the Vegas AI should be able to do it too 😉.

Cautious conclusion: the Vegas AI can neither speak German nor has any knowledge of geography.

Last changed by Hajowo on 12/31/2024, 7:52 AM, changed a total of 2 times.

Gruß Hansi
https://pinnacle-hilfe.boards.net/

Software: DaVinci Resolve 19 Studio, Magix Video Pro X16, Vegas Pro 20,21,22
Kamera: Lumix GH6, G9II, Blackmagic PCC4K, Objektive Leica 12-60, Lumix 12-60, Sigma 16mm und 30mm, Atomos Ninja V+
Desktop: i7-9700K, GTX 1060-6GB, 32 GB RAM, SSDs 2x250GB,1TB, 2TB, 2TB M.2
Mobil: Notebook HP-ProBook 470-G7 Intel i7-10510 U, RAM 32GB, 1TB SSD, 1 TB HDD, Radeon 530.

 

Reyfox wrote on 12/31/2024, 8:29 AM

Hansi, is that you? :D

With my video of Zakopane, I did use most of the voice over, but the way it pronounced Zakopane was wrong. I used Speech to Text and then copy/paste into Text to Speech. I typed in phonetically how to say it in English and it worked. I asked about the languages, and they said "not yet". Also, I asked about referencing my footage, "not yet". But then, I'd probably have to change the file name, and that would take up too much time.

And yes, right now, it works only in English.

 

Newbie😁

Vegas Pro 22 (VP18-21 also installed)

Win 11 Pro always updated

AMD Ryzen 9 5950X 16 cores / 32 threads

32GB DDR4 3200

Sapphire RX6700XT 12GB Driver: Pro 23.Q3

Gigabyte X570 Elite Motherboard

Panasonic G9, G7, FZ300

Hajowo wrote on 1/4/2025, 6:24 AM

Hi.

Nun ist es so weit: Der Vegas KI-Assistant hat für mich ein Skript auf Englisch erstellt! Ich habe ihm Informationen über eine Mountainbike-Tour gegeben, und daraufhin hat er eine Szenenbeschreibung sowie passende Kommentare (Voiceover) in das Skript integriert.

Derzeit ist die KI noch nicht in der Lage, Skripte direkt in deutscher Sprache zu erstellen. Deshalb habe ich die erstellten Kommentare übersetzt und anschließend mit der TTS-Funktion (Text-to-Speech) von der KI-Stimme Klaus einsprechen lassen.

Das Bildmaterial habe ich passend zur Beschreibung des KI-Assistants ausgewählt und in der Timeline zu einem fertigen Video bearbeitet. Da die meisten Bilder aus den 1990er Jahren stammen, ist die Qualität nicht optimal – allerdings ging es mir bei diesem Projekt primär darum, den Vegas KI-Assistant zu testen.

Last changed by Hajowo on 1/4/2025, 6:25 AM, changed a total of 1 times.

Gruß Hansi
https://pinnacle-hilfe.boards.net/

Software: DaVinci Resolve 19 Studio, Magix Video Pro X16, Vegas Pro 20,21,22
Kamera: Lumix GH6, G9II, Blackmagic PCC4K, Objektive Leica 12-60, Lumix 12-60, Sigma 16mm und 30mm, Atomos Ninja V+
Desktop: i7-9700K, GTX 1060-6GB, 32 GB RAM, SSDs 2x250GB,1TB, 2TB, 2TB M.2
Mobil: Notebook HP-ProBook 470-G7 Intel i7-10510 U, RAM 32GB, 1TB SSD, 1 TB HDD, Radeon 530.

 

Reyfox wrote on 1/4/2025, 6:30 AM

@Hajowo are you happy with the results? You basically did what I had to do with the voice over. Speech to Text, then Text to Speech making necessary corrections.

Newbie😁

Vegas Pro 22 (VP18-21 also installed)

Win 11 Pro always updated

AMD Ryzen 9 5950X 16 cores / 32 threads

32GB DDR4 3200

Sapphire RX6700XT 12GB Driver: Pro 23.Q3

Gigabyte X570 Elite Motherboard

Panasonic G9, G7, FZ300

Hajowo wrote on 1/4/2025, 12:39 PM

Für kleine Projekte dieser Art ist das gut brauchbar. Vorrausgesetzt es wird noch mehrsprachig. Geht es ins Große habe ich meine Bedenken. Auch das Angebot zum Einsatz von Stock-Bildmaterial hat wohl seine Grenzen. Aber warten wir mal ab.

Gruß Hansi
https://pinnacle-hilfe.boards.net/

Software: DaVinci Resolve 19 Studio, Magix Video Pro X16, Vegas Pro 20,21,22
Kamera: Lumix GH6, G9II, Blackmagic PCC4K, Objektive Leica 12-60, Lumix 12-60, Sigma 16mm und 30mm, Atomos Ninja V+
Desktop: i7-9700K, GTX 1060-6GB, 32 GB RAM, SSDs 2x250GB,1TB, 2TB, 2TB M.2
Mobil: Notebook HP-ProBook 470-G7 Intel i7-10510 U, RAM 32GB, 1TB SSD, 1 TB HDD, Radeon 530.

 

Reyfox wrote on 1/4/2025, 1:31 PM

Yes, I agree. It's good for short projects. I wouldn't do a documentary with it though, but I don't think that is what it is meant for.

Newbie😁

Vegas Pro 22 (VP18-21 also installed)

Win 11 Pro always updated

AMD Ryzen 9 5950X 16 cores / 32 threads

32GB DDR4 3200

Sapphire RX6700XT 12GB Driver: Pro 23.Q3

Gigabyte X570 Elite Motherboard

Panasonic G9, G7, FZ300

paul-marshall wrote on 1/7/2025, 4:20 AM

@Reyfox So what is it meant for?
I want an AI assistant that does just that - Assists me in progressing various tasks. Writing a short script would be one of those tasks. We've seen how AI can assist in smart masking and colorizing. I can see a future for AI enhancing other processes which at present are quite time consuming for a human too. For instance, smart audio mixing, smart color grading. I use AI for writing bits of computer code and it does that well, so how about AI writing a vegas script? Thats the kind of AI Assistand I want.

Windows 11.0 (64-bit)
Intel® Core™ i9 Eight-Core Processor i9-11900K (3.5GHz) 16MB Cache
Motherboard GIGABYTE Z590 UD AC (C (LGA1200, USB 3.2)
64GB Corsair VENGEANCE DDR4 3200MHz (4 x 16GB)
GPU Nvidia GEFORCE RTX3060Ti
I/O drives: Intel SSD PEKNU020TZ 2TB, Samsung SSD 870 EVO 1TB, Samsung SSD 870 EVO 1TB
SEAGATE BARRACUDA SATA-III 3.5" HDD, 2TB, 6GB/s, 7200RPM, 256MB CACHE
Audio: Soundblaster Z SE
Cameras: Sony AX-700, A7-IV, RX10-II
Vegas Po 22 latest version. Vegas user since V10

 

Reyfox wrote on 1/7/2025, 6:47 AM

@paul-marshall at the moment, and as far as I know, AI Assistant is for creating video storyboards. When I've asked questions about it and they were answered by Gary Rebholz, that it was for creating something like a video template. Voice over, video and music. It can write a script and did for me for what I typed in, and then I wanted video and music. It gave me that too. I did replace most of the video and all of the music and changed the voice over. If you want to know what Vegas Pro says AI Assistant is about, go HERE to the website.

Add what you want to a feature request. This is what AI Assistant is for right now. Who knows about the future?

Newbie😁

Vegas Pro 22 (VP18-21 also installed)

Win 11 Pro always updated

AMD Ryzen 9 5950X 16 cores / 32 threads

32GB DDR4 3200

Sapphire RX6700XT 12GB Driver: Pro 23.Q3

Gigabyte X570 Elite Motherboard

Panasonic G9, G7, FZ300

CosmicOutpost wrote on 1/7/2025, 8:25 AM

Well I'm really impressed with the AI Assistant! It's just what I need to throw in a script, have the AI make a story board, suggest some clips for me to add to the timeline and even add a voice over! Vegas needs to make a song and dance about this with AI Youtubers like Matt Wolf and MattVidProAI as this is a great example of the AI Agent they talk about.

If the subtitles could be more flexible as I need them in the centre of the screen and if some new styles could be added then I could do all my work in Vegas.

paul-marshall wrote on 1/8/2025, 4:32 AM

@CosmicOutpost could you show us something you have created with the AI Assistant?

Windows 11.0 (64-bit)
Intel® Core™ i9 Eight-Core Processor i9-11900K (3.5GHz) 16MB Cache
Motherboard GIGABYTE Z590 UD AC (C (LGA1200, USB 3.2)
64GB Corsair VENGEANCE DDR4 3200MHz (4 x 16GB)
GPU Nvidia GEFORCE RTX3060Ti
I/O drives: Intel SSD PEKNU020TZ 2TB, Samsung SSD 870 EVO 1TB, Samsung SSD 870 EVO 1TB
SEAGATE BARRACUDA SATA-III 3.5" HDD, 2TB, 6GB/s, 7200RPM, 256MB CACHE
Audio: Soundblaster Z SE
Cameras: Sony AX-700, A7-IV, RX10-II
Vegas Po 22 latest version. Vegas user since V10

 

CosmicOutpost wrote on 1/8/2025, 9:37 AM

@CosmicOutpost could you show us something you have created with the AI Assistant?

Sure! So this is a draft of what came out:
https://youtube.com/shorts/500QnYuil1k

Vegas took the script but truncated the words to make the narration shorter and then suggested what each clip might look like. I asked it to choose clips from the Vegas Hub which it did - along with the music and added the male voice. I had to select the media I wanted and add them to the time line where I wanted them. I added the 'occupations' overlay as a PNG and the GL wipe transitions. I forgot fade the music and YouTube didn't have a problem using the music so that's a bonus.

Subtitles not great as I found I had to render the audio clips to a new track an analyse one file to give me the speech to text subtitles which are fixed once generated so if you mess then up as I did here, there is not easy way that I know of to change them.

For shorts like this there are probably fast solutions but when I want to sit down and make a longer video, having the AIA to suggest story boards shot and find clips will be a great help. I hope the option to specify images to be selected can be included as this is a great feature for content creators to have in a tried and test editing programme.

set wrote on 1/8/2025, 4:56 PM

For subtitle, you have to put all Media Generated Titles & Texts to one same track, and then choose one of the title event, modify the look and texts, then use the button "Transfer attributes of this event to other Titles & Text events on the same track" to copy all text presets to other titles & Tracks on the same track.

But as for being too long or too short - this is quite challenging especially for 9:16, as you have to do it manually cut - paste and rearrange the durations.

Setiawan Kartawidjaja
Bandung, West Java, Indonesia (UTC+7 Time Area)

Personal FB | Personal IG | Personal YT Channel
Chungs Video FB | Chungs Video IG | Chungs Video YT Channel
Personal Portfolios YouTube Playlist
Pond5 page: My Stock Footage of Bandung city

 

System 5-2021:
Processor: Intel(R) Core(TM) i7-10700 CPU @ 2.90GHz   2.90 GHz
Video Card1: Intel UHD Graphics 630 (Driver 31.0.101.2127 (Feb 1 2024 Release date))
Video Card2: NVIDIA GeForce RTX 3060 Ti 8GB GDDR6 (Driver Version 551.23 Studio Driver (Jan 24 2024 Release Date))
RAM: 32.0 GB
OS: Windows 10 Pro Version 22H2 OS Build 19045.3693
Drive OS: SSD 240GB
Drive Working: NVMe 1TB
Drive Storage: 4TB+2TB

 

System 2-2018:
ASUS ROG Strix Hero II GL504GM Gaming Laptop
Processor: Intel(R) Core(TM) i7 8750H CPU @2.20GHz 2.21 GHz
Video Card 1: Intel(R) UHD Graphics 630 (Driver 31.0.101.2111)
Video Card 2: NVIDIA GeForce GTX 1060 6GB GDDR5 VRAM (Driver Version 537.58)
RAM: 16GB
OS: Win11 Home 64-bit Version 22H2 OS Build 22621.2428
Storage: M.2 NVMe PCIe 256GB SSD & 2.5" 5400rpm 1TB SSHD

 

* I don't work for VEGAS Creative Software Team. I'm just Voluntary Moderator in this forum.

paul-marshall wrote on 1/9/2025, 4:56 AM

@CosmicOutpost Thank you for sharing. It certainly looks quite polished. So did you write the script? Perhaps I am expecting too much, I want the AI to write the script, but AIA script writing is very much inferior to ChatGPT - in my limited experience.

Last changed by paul-marshall on 1/9/2025, 5:00 AM, changed a total of 2 times.

Windows 11.0 (64-bit)
Intel® Core™ i9 Eight-Core Processor i9-11900K (3.5GHz) 16MB Cache
Motherboard GIGABYTE Z590 UD AC (C (LGA1200, USB 3.2)
64GB Corsair VENGEANCE DDR4 3200MHz (4 x 16GB)
GPU Nvidia GEFORCE RTX3060Ti
I/O drives: Intel SSD PEKNU020TZ 2TB, Samsung SSD 870 EVO 1TB, Samsung SSD 870 EVO 1TB
SEAGATE BARRACUDA SATA-III 3.5" HDD, 2TB, 6GB/s, 7200RPM, 256MB CACHE
Audio: Soundblaster Z SE
Cameras: Sony AX-700, A7-IV, RX10-II
Vegas Po 22 latest version. Vegas user since V10

 

CosmicOutpost wrote on 1/9/2025, 5:48 AM

Thank you! I pludered Canva Magic Write whilst I had a 7 trial with them. I fed it some basic information for it to flesh out and then I made some edits to it as "dive in" is a clear pointer the AI wrote the script so look out for that! I can't afford a ChatGPT subscription so have LM model locally and find online Le Chat Mistral AI is a good writer but try to write my own scripts as much as possible and hope the AIA can help with the rest!

CosmicOutpost wrote on 1/10/2025, 4:47 AM

Ahh nuts, just tried to repeat the success and all the Vegas AIA did was list clips and not add them from the hub to the timeline then blue screened of death on me.

Massimo-- wrote on 1/21/2025, 3:11 AM

Hi, I'm running sony vegas 22 on a Nvidia rtx 1060. At the moment, I didn't use AI effects, I'm only an hobbist.

I wonder if a more recent video card, ex rtx 5060, could improve AI performance.

Thanks.

Reyfox wrote on 1/21/2025, 5:16 AM

@Massimo-- maybe because you are using "sony" vegas 22, which doesn't exist?

Last changed by Reyfox on 1/21/2025, 5:17 AM, changed a total of 1 times.

Newbie😁

Vegas Pro 22 (VP18-21 also installed)

Win 11 Pro always updated

AMD Ryzen 9 5950X 16 cores / 32 threads

32GB DDR4 3200

Sapphire RX6700XT 12GB Driver: Pro 23.Q3

Gigabyte X570 Elite Motherboard

Panasonic G9, G7, FZ300

Massimo-- wrote on 1/21/2025, 6:24 AM

@Massimo-- maybe because you are using "sony" vegas 22, which doesn't exist?

.. it's only a typo....

It's vegas pro 22.

The build should be the latest. Deep learning models, I don't know if they are installed.

At this moment I'm not at home, so I could check this evening.

Thanks.

Dexcon wrote on 1/21/2025, 6:34 AM

.. it's only a typo....

Mmmm! A typo is usually considered to be a spelling or grammatical mistake.

Cameras: Sony FDR-AX100E; GoPro Hero 11 Black Creator Edition

Installed: Vegas Pro 15, 16, 17, 18, 19, 20, 21 & 22, HitFilm Pro 2021.3, DaVinci Resolve Studio 19.0.3, BCC 2025, Mocha Pro 2024.5, NBFX TotalFX 7, Neat NR, DVD Architect 6.0, MAGIX Travel Maps, Sound Forge Pro 16, SpectraLayers Pro 11, iZotope RX10 Advanced and many other iZ plugins, Vegasaur 4.0

Windows 11

Dell Alienware Aurora 11:

10th Gen Intel i9 10900KF - 10 cores (20 threads) - 3.7 to 5.3 GHz

NVIDIA GeForce RTX 2080 SUPER 8GB GDDR6 - liquid cooled

64GB RAM - Dual Channel HyperX FURY DDR4 XMP at 3200MHz

C drive: 2TB Samsung 990 PCIe 4.0 NVMe M.2 PCIe SSD

D: drive: 4TB Samsung 870 SATA SSD (used for media for editing current projects)

E: drive: 2TB Samsung 870 SATA SSD

F: drive: 6TB WD 7200 rpm Black HDD 3.5"

Dell Ultrasharp 32" 4K Color Calibrated Monitor

 

LAPTOP:

Dell Inspiron 5310 EVO 13.3"

i5-11320H CPU

C Drive: 1TB Corsair Gen4 NVMe M.2 2230 SSD (upgraded from the original 500 GB SSD)

Monitor is 2560 x 1600 @ 60 Hz

Massimo-- wrote on 1/25/2025, 12:21 PM

@Massimo-- maybe because you are using "sony" vegas 22, which doesn't exist?

Vegas pro 22 build 239 + latest deep learning modules