Voice Isolation

marcinzm wrote on 7/12/2023, 4:31 PM

Hello,

 

I don`t have Davinci Resolve, but I know that there is an audio effect called "Voice isolation".

This audio effect improves quality of voice sound and I think that audio noise is removed either. This is AI audio effect. This effect improves quality of voice sound to be much clear and better audible.

Do you know if such similiar audio effect is available in Vegas Pro 20 or maybe you know if such audio effect is going to be released in nearest Vegas Pro upgrade.


Regards

Marcin

If you are bored, drink water, you will want to pee. -> Albert Einstein - my idol!

I am 42. I have been creating videos since 2009 (the date when my first daughter was born in). My first video software was Pinnacle, next one was Sony Vegas 8 (I am not sure if remember it correctly). I am also a developer and wedding movie operator and editor. For example: I have created an Android app which let me control Vegas Pro rendering progress level on Android smartphone. I created it for fun, because I also love programming. I also created my own plugin for Audio To Text feature specified usage from Vegas Pro 19. I created proxy creation plugin which uses multiple GPU threads (maximum 3) to create proxy files for Vegas Pro. I also written many others plugin/softwares which enhance my video editing, also wedding editing.

Camera/video camera: Sony FX3, Sony A7 III, Sony FDR AX 100, Canon 5D Mark III, GoPro Hero Black 7,8,9,10

Lenses for Sony: Tamron 28-75mm F/2.8 Di III , Sony 24mm gm 1.4 FE, Sony 20 mm G FE 1.8

Lenses for Canon: Canon EF 24-70 mm F/2.8 L USM, Canon 70-200 f/2.8 L

Drone: DJI Mavic 3 & DJI Phantom 4 Pro v2.0

 

Editing: Vegas Pro 20 (365) with a lot of third party plugins, also my own plugins written in C#

 

PC:

CPU: Intel(R) Core(TM) i9-7900X CPU @ 3.30GHz   3.31 GHz

RAM: 128 GB

GPU: Nvidia RTX 2080 TI

storage: 4 SSD drives (including two M.2 flash drives) and two HDD drives

Windows system: 10 Home edition

Comments

JJKizak wrote on 7/12/2023, 7:39 PM

I'm guessing that you would need a room full of AI computers to do a flawless job of isolating voices.

JJK

Dexcon wrote on 7/12/2023, 8:07 PM

There is no native Vegas Pro audio FX that can do voice isolation in a similar way as far as I am aware - most of VP's audio FX have been around for a decade or more (though the ExpressFX ones are more recent).

Steinberg have just released SpectraLayers Pro 10 that comes with giant leaps forward in unmixing using AI. Unmix options include unmixing noisy speech and unmixing multiple voices. Have a look at SpectraLayers Pro 10's webpage for more information - https://www.steinberg.net/spectralayers/new-features/ - and check out the demos attached to each feature's listing.

The tests I've done with SL10 at unmixing vocals from songs had spectacular results - much much better than was possible in SL9.

SL10's developer advised on SpectraLayer's forum about a week ago that the first update to SL10 (to be released next week) includes GPU unmix assistance thus enormously speeding up unmix processing. From another SL forum thread, apparently GPU assistance with unmixing noisy speech will come with the 2nd update later this year.

SpectraLayers Pro 10 (the version which has unmixing) is not inexpensive but is much lower in cost than iZotope's RX Advanced which has its own version of voice isolation. Further, crossgrading to SpectraLayers from RX5 or above (Standard or Advanced) as well as from Adobe Audition comes with a discounted price.

Unfortunately, there doesn't seem to be a trial version of SL10 available at this time.

Last changed by Dexcon on 7/12/2023, 8:26 PM, changed a total of 1 times.

Cameras: Sony FDR-AX100E; GoPro Hero 11 Black Creator Edition

Installed: Vegas Pro 15, 16, 17, 18, 19, 20, 21 & 22, HitFilm Pro 2021.3, DaVinci Resolve Studio 19.0.3, BCC 2025, Mocha Pro 2025.0, NBFX TotalFX 7, Neat NR, DVD Architect 6.0, MAGIX Travel Maps, Sound Forge Pro 16, SpectraLayers Pro 11, iZotope RX11 Advanced and many other iZ plugins, Vegasaur 4.0

Windows 11

Dell Alienware Aurora 11:

10th Gen Intel i9 10900KF - 10 cores (20 threads) - 3.7 to 5.3 GHz

NVIDIA GeForce RTX 2080 SUPER 8GB GDDR6 - liquid cooled

64GB RAM - Dual Channel HyperX FURY DDR4 XMP at 3200MHz

C drive: 2TB Samsung 990 PCIe 4.0 NVMe M.2 PCIe SSD

D: drive: 4TB Samsung 870 SATA SSD (used for media for editing current projects)

E: drive: 2TB Samsung 870 SATA SSD

F: drive: 6TB WD 7200 rpm Black HDD 3.5"

Dell Ultrasharp 32" 4K Color Calibrated Monitor

 

LAPTOP:

Dell Inspiron 5310 EVO 13.3"

i5-11320H CPU

C Drive: 1TB Corsair Gen4 NVMe M.2 2230 SSD (upgraded from the original 500 GB SSD)

Monitor is 2560 x 1600 @ 60 Hz

Former user wrote on 7/12/2023, 10:14 PM

Hello,

 

I don`t have Davinci Resolve, but I know that there is an audio effect called "Voice isolation".

Do you know if such similiar audio effect is available in Vegas Pro 20 or maybe you know if such audio effect is going to be released in nearest Vegas Pro upgrade.

There's a free one https://github.com/werman/noise-suppression-for-voice

I compare original/Resolve's Voice Isolation/RN noise suppression

Note that it's a compromise between keeping the voice 100% intact with removing the highest amount of noise.

In the Resolve example, I missed the distorted 'after' so actually I probably should have allowed more noise in an attempt to have a non distored 'after'. With RN noise suppression I allowed a lot more noise then I would have wished but still the Voice is distorted. It may have a use in limited noisy circumstances

rraud wrote on 7/13/2023, 10:25 AM

SpectraLayers Pro (SLP) used to have a full functioning 30-day trial, I do not know if the trial is still available. Otherwise SLP is my go-to app for restoration. Not exactly a budget item, but lower cost than iZ's RX 10 Adv. (which is also good).

Robin-Lobel wrote on 7/13/2023, 11:40 AM

The trial for SpectraLayers 10 will be available next week. Meanwhile, you can check this page comparing SpectraLayers 10, RX 10.4, Acoustica 7.4 and Clarity Vx 14 on different denoising/restoration tasks : https://divideconcept.github.io/Restoration-Comparison/

Robert Johnston wrote on 7/13/2023, 1:38 PM

@marcinzm Resolve Voice Isolation does a really good job of eliminating wind noise. That's what I use it for. There's no effect in Vegas 20 that can do as good a job. For some other types of sounds that Resolve doesn't handle well, I use Adobe Audition Sound Removal or Noise Removal.

Intel Core i7 10700K CPU @ 3.80GHz (to 4.65GHz), NVIDIA GeForce RTX 2060 SUPER 8GBytes. Memory 32 GBytes DDR4. Also Intel UHD Graphics 630. Mainboard: Dell Inc. PCI-Express 3.0 (8.0 GT/s) Comet Lake. Bench CPU Multi Thread: 5500.5 per CPU-Z.

Vegas Pro 21.0 (Build 108) with Mocha Vegas

Windows 11 not pro

wjauch wrote on 7/13/2023, 7:56 PM

Audo . ai allows 20 minutes of audio processing each month using AI. The demo is pretty incredible, I've used it a couple of times with good result, but not as good as the demo. It's not inside Vegas, you upload your audio, download the processed version and manually replace on timeline.

Former user wrote on 7/13/2023, 8:49 PM

@wjauch That does do a good job, a little raspy but none of the ones I compared were perfect either

fr0sty wrote on 7/13/2023, 9:01 PM

Vegas isn't using AI for audio... Yet... But some really cool video tools are coming soon, stuff that goes beyond the AI tools already present, and is useful to everyone. You'll hear more about that in the very near future.

Systems:

Desktop

AMD Ryzen 7 1800x 8 core 16 thread at stock speed

64GB 3000mhz DDR4

Geforce RTX 3090

Windows 10

Laptop:

ASUS Zenbook Pro Duo 32GB (9980HK CPU, RTX 2060 GPU, dual 4K touch screens, main one OLED HDR)

RogerS wrote on 7/13/2023, 9:16 PM

NVIDIA also has a noise removal app- never tried it so don't know how well it works: https://www.nvidia.com/en-us/geforce/guides/nvidia-rtx-voice-setup-guide/ [Appears to work at the streaming/recording stage vs in post]

Last changed by RogerS on 7/13/2023, 9:21 PM, changed a total of 1 times.

Custom PC (2022) Intel i5-13600K with UHD 770 iGPU with latest driver, MSI z690 Tomahawk motherboard, 64GB Corsair DDR5 5200 ram, NVIDIA 2080 Super (8GB) with latest studio driver, 2TB Hynix P41 SSD and 2TB Samsung 980 Pro cache drive, Windows 11 Pro 64 bit https://pcpartpicker.com/b/rZ9NnQ

ASUS Zenbook Pro 14 Intel i9-13900H with Intel graphics iGPU with latest ASUS driver, NVIDIA 4060 (8GB) with latest studio driver, 48GB system ram, Windows 11 Home, 1TB Samsung SSD.

VEGAS Pro 21.208
VEGAS Pro 22.239

Try the
VEGAS 4K "sample project" benchmark (works with VP 16+): https://forms.gle/ypyrrbUghEiaf2aC7
VEGAS Pro 20 "Ad" benchmark (works with VP 20+): https://forms.gle/eErJTR87K2bbJc4Q7

Former user wrote on 7/13/2023, 9:48 PM

@RogerS You can get that for free also in the form of VoiceFX(Demo), with paid version being $60. The main limitation of the Demo version is that there are no controls, it's on and off only. https://www.xaymar.com/projects/voicefx/

I don't like this result, but could work fine in other scenarios