Samsung S23 Ultra camera video audio out of sync.

Former user wrote on 4/28/2024, 4:33 PM

Hi, I normally make videos that have the noise of machines where it's hard to hear an out of sync problem, also I don't stand in front of the camera talking so I've never noticed a lip sync problem. In fact I haven't noticed any problem before.

But I've been poorly / off work for over a yr & haven't really done any filming where syncing could be an issue, I'm feeling beter, slowly getting my 💩 together & needed to clean my wood planer that has an inch of rust on it, I noticed the sound just wasn't right, the video plays the same out of sync in VLC, MPC players & Vegas,

This is a sample in Vegas of the rust scraping, you can see it's not quite right, this is from a clip that's just 35secs long but the length of clip makes no difference/

I've been online & there's a thousand different 'solutions' but most are related to Bluetooth connections, streaming to things like headphones, I've unpaired all my Bluetooth stuff & turned Bluetooth off, this shouldn't affect the camera tho. There's an Option for 'Developers Option' in the phone but there's no obvious solution in there either & again online 'solutions' reg this are related to Bluetooth.

Here's 2 very short samples of taping on a frying pan where the out of sync is obvious, one is 30p the other is 60p, it's more noticeable on the 60p, I know these are variable media but that shouldn't be a problem & I've tried converting them with Shutter encoder,

These files are untouched, unaltered straight from the phone, I know there's a couple of people on here with Samsung S23 phones so I'm wondering if they have the same problem & would appreciate any feedback, Samsung send me updates almost every wk so who knows where this problem arose.

https://drive.google.com/drive/folders/1vtMaLrVtPnBqUXTtGdAjCmBXefaNsH3b?usp=sharing

This is roughly how much out it is,

Thanks.

 

 

Comments

set wrote on 4/28/2024, 5:44 PM

Gid, first right click on the media in Vegas timeline, then Properties> General tab, look at plug-in section below, what FileIO plugin is it used to read your S23 media? is it so4compoundplug or mxcompoundplug?

Setiawan Kartawidjaja
Bandung, West Java, Indonesia (UTC+7 Time Area)

Personal FB | Personal IG | Personal YT Channel
Chungs Video FB | Chungs Video IG | Chungs Video YT Channel
Personal Portfolios YouTube Playlist
Pond5 page: My Stock Footage of Bandung city

 

System 5-2021:
Processor: Intel(R) Core(TM) i7-10700 CPU @ 2.90GHz   2.90 GHz
Video Card1: Intel UHD Graphics 630 (Driver 31.0.101.2127 (Feb 1 2024 Release date))
Video Card2: NVIDIA GeForce RTX 3060 Ti 8GB GDDR6 (Driver Version 551.23 Studio Driver (Jan 24 2024 Release Date))
RAM: 32.0 GB
OS: Windows 10 Pro Version 22H2 OS Build 19045.3693
Drive OS: SSD 240GB
Drive Working: NVMe 1TB
Drive Storage: 4TB+2TB

 

System 2-2018:
ASUS ROG Strix Hero II GL504GM Gaming Laptop
Processor: Intel(R) Core(TM) i7 8750H CPU @2.20GHz 2.21 GHz
Video Card 1: Intel(R) UHD Graphics 630 (Driver 31.0.101.2111)
Video Card 2: NVIDIA GeForce GTX 1060 6GB GDDR5 VRAM (Driver Version 537.58)
RAM: 16GB
OS: Win11 Home 64-bit Version 22H2 OS Build 22621.2428
Storage: M.2 NVMe PCIe 256GB SSD & 2.5" 5400rpm 1TB SSHD

 

* I don't work for VEGAS Creative Software Team. I'm just Voluntary Moderator in this forum.

Former user wrote on 4/28/2024, 5:55 PM

@set Thanks, but this is the video themselves or the /phone camera , it's offset in my media players also, that's why I supplied a couple of files to see if they're offset in others PC's too,

This is one. 👍

set wrote on 4/28/2024, 6:17 PM

ah... ok... here's both of media as read in my system in VP21:

 

And, for little curiosity, test in Capcut:

Setiawan Kartawidjaja
Bandung, West Java, Indonesia (UTC+7 Time Area)

Personal FB | Personal IG | Personal YT Channel
Chungs Video FB | Chungs Video IG | Chungs Video YT Channel
Personal Portfolios YouTube Playlist
Pond5 page: My Stock Footage of Bandung city

 

System 5-2021:
Processor: Intel(R) Core(TM) i7-10700 CPU @ 2.90GHz   2.90 GHz
Video Card1: Intel UHD Graphics 630 (Driver 31.0.101.2127 (Feb 1 2024 Release date))
Video Card2: NVIDIA GeForce RTX 3060 Ti 8GB GDDR6 (Driver Version 551.23 Studio Driver (Jan 24 2024 Release Date))
RAM: 32.0 GB
OS: Windows 10 Pro Version 22H2 OS Build 19045.3693
Drive OS: SSD 240GB
Drive Working: NVMe 1TB
Drive Storage: 4TB+2TB

 

System 2-2018:
ASUS ROG Strix Hero II GL504GM Gaming Laptop
Processor: Intel(R) Core(TM) i7 8750H CPU @2.20GHz 2.21 GHz
Video Card 1: Intel(R) UHD Graphics 630 (Driver 31.0.101.2111)
Video Card 2: NVIDIA GeForce GTX 1060 6GB GDDR5 VRAM (Driver Version 537.58)
RAM: 16GB
OS: Win11 Home 64-bit Version 22H2 OS Build 22621.2428
Storage: M.2 NVMe PCIe 256GB SSD & 2.5" 5400rpm 1TB SSHD

 

* I don't work for VEGAS Creative Software Team. I'm just Voluntary Moderator in this forum.

Former user wrote on 4/28/2024, 6:36 PM

@set Thanks, yep that's the same as I get, at least I know it's not my PC.

I've reset & cleared the phone camera's cache, tried HEVC etc. but no improvement.

I buy what I hope is the best phone camera I can because it's convenient for me when I'm working, I can put it i my pocket & pull it out whenever I want. For my videos the picture & audio quality is more than good enough but this is poss going to bug me. .

If I find a solution I'll update this post for anyone in the future.

Thanks again 👍

Former user wrote on 4/28/2024, 6:53 PM

@set Just for the sake of trying I recorded the same with my GoPro11, it seems worse 😵 I don't know what's going on, I wonder if it's a transfer thing, I download from the cameras using a USB type C from the cameras into a fast USB on my PC..

This is that GoPro click - https://drive.google.com/file/d/1KjNbm1nwojWJgLPmVamNAiLamySaHsYB/view?usp=sharing

(I added a bit of brightness just to see the knife, this didn't change the audio/video sync)

set wrote on 4/28/2024, 7:22 PM

USB Transfer is just copying data, no effect... this is about the video stream & audio stream recording in the camera system. I think it's just okay if you need to really adjust the position, to make it extremely perfect exact position, where in the video stream, by the time the knife touching then pan, the sound of 'impact' going out and recorded in the audio stream.

On the other side... are the differences really seen / felt ? I guess, anyone have their own thought.

 

Perhaps I can share one of my multicamera recording, where I feed sound one from the room's ambient mic, and the other from mixer's line, and here's what I noticed:

Last changed by set on 4/28/2024, 7:23 PM, changed a total of 2 times.

Setiawan Kartawidjaja
Bandung, West Java, Indonesia (UTC+7 Time Area)

Personal FB | Personal IG | Personal YT Channel
Chungs Video FB | Chungs Video IG | Chungs Video YT Channel
Personal Portfolios YouTube Playlist
Pond5 page: My Stock Footage of Bandung city

 

System 5-2021:
Processor: Intel(R) Core(TM) i7-10700 CPU @ 2.90GHz   2.90 GHz
Video Card1: Intel UHD Graphics 630 (Driver 31.0.101.2127 (Feb 1 2024 Release date))
Video Card2: NVIDIA GeForce RTX 3060 Ti 8GB GDDR6 (Driver Version 551.23 Studio Driver (Jan 24 2024 Release Date))
RAM: 32.0 GB
OS: Windows 10 Pro Version 22H2 OS Build 19045.3693
Drive OS: SSD 240GB
Drive Working: NVMe 1TB
Drive Storage: 4TB+2TB

 

System 2-2018:
ASUS ROG Strix Hero II GL504GM Gaming Laptop
Processor: Intel(R) Core(TM) i7 8750H CPU @2.20GHz 2.21 GHz
Video Card 1: Intel(R) UHD Graphics 630 (Driver 31.0.101.2111)
Video Card 2: NVIDIA GeForce GTX 1060 6GB GDDR5 VRAM (Driver Version 537.58)
RAM: 16GB
OS: Win11 Home 64-bit Version 22H2 OS Build 22621.2428
Storage: M.2 NVMe PCIe 256GB SSD & 2.5" 5400rpm 1TB SSHD

 

* I don't work for VEGAS Creative Software Team. I'm just Voluntary Moderator in this forum.

Former user wrote on 4/28/2024, 7:43 PM

@set 

USB Transfer is just copying data, no effect... 

Yep, I took the GoPro card out & downloaded the file with a card reader USB gadget thing, the files were exactly the same as when I downloaded using the Type C connection.

On the other side... are the differences really seen / felt ?

No I don't think so, like I say most of my vids are just noise that isn't noticeable if it's a frame or two out of sync, & if it is important or noticeable I'll take a closer look to sync them.

This is the sort of noise I'd normally be making, trying out my new saw, (the wood is too thin for this test & falls through the hole in the bottom of the saw's base, this vid won't be getting uploaded to the net 😊)

This is my phone & the Gopro, no out of sync is noticeable on either vid, & when put together I did a similar thing to your vid with the two audios 👍

mark-y wrote on 4/29/2024, 11:05 AM

My family friend, a photographer in Idaho, has the same camera phone, and I've edited several movie clips for her since she got the phone last year.

As with your footage, the audio sync (and a whole bushel of other stuff!) is different every time if you:

  • Use a different Vegas version
  • Use a different internal decoder
  • Compare a render to the source
  • Rewrap the source to CFR
  • Play your source in a player

The cause is nothing new or unique, it turns out.

One thing that is puzzling is the incongruent metadata between the presumed 59.94 base framerate and the PAL designation ?

I haven't paid precise attention to sync with my friend's footage, but if you still need to make an adjustment after converting your source to CFR (in Shutter Encoder), it will at least be by a consistent amount.

Former user wrote on 4/29/2024, 11:34 AM

@mark-y Thanks,

One thing that is puzzling is the incongruent metadata between the presumed 59.94 base framerate and the PAL designation ?

I'm not 100% sure I understand that but I'll look into it 👍

 after converting your source to CFR (in Shutter Encoder), it will at least be by a consistent amount.

That's good to know, I was wondering about that, I don't want to be trying to sync a track that's like a rubber band 😁 👍, Since buying Vegas18 I often convert to ProRes with Shutter Encoder, the main clip for this is UHD 60p 18.28mins 9.3GB, Shutter Encoder converted it in about 4mins, that's well worth time spent to get the better performance in Vegas, I've seen a huge playback difference with this (300) build but simple 12frame transitions (in 30p vids, 24frames in 60p) still won't be totally smooth even after a couple of loop plays (0 effects added), but with ProRes they're smooth as silk first time.

I've never used pro video cameras, for 20yrs+ I've just always tried to get the best phone camera, ease of use & portability as i mentioned, Do pro cameras have sync issues if you delve in close enough n look.?

mark-y wrote on 4/29/2024, 1:19 PM

Your S23 Samsung shoots Variable Frame Rate. Vegas has problems with VFR. Always has.

You can rewrap it to CFR in ffmpeg, or use Shutter Encoder or Handbrake to convert it, which ever you prefer.

This should improve, or at least stabilize your audio sync issues.

I don't know of any "pro" cameras that list VFR as a feature, although there may be some.

Variable frame rate is only one of hundreds of compression "tricks" that consumer portable devices use to cram more data into a smaller space. Not surprisingly, nonlinear editors are not not necessarily cooperative.

mark-y wrote on 4/29/2024, 7:50 PM

One thing that is puzzling is the incongruent metadata between the presumed 59.94 base framerate and the PAL designation ?

I'm not 100% sure I understand that but I'll look into it 👍

PAL frame rates are either 25 or 50.

Former user wrote on 4/29/2024, 8:24 PM

@mark-y Ah thanks yep I understand a little about that, I'm in the UK England, my phone options are 30 or 60p, & Gopro options are 24, 30, 60, 120 or 240 depending on size & aspect ratio. The Gopro MediaInfo doesn't say whether it's PAL or NTSC?

I've wondered about this reg my monitor, playback with moving objects in Vegas sometimes shows a minor horizontal line type glitch, it's hard to catch it with a screen capture so I've never asked about it, my Dell 32" monitor is set at 60hz. but it has 50hz option. could the differences in al these make visual problems?

It's normally at the top roughly 1/3 down, this is the closest recreation i can make with Gimp, can you see this circle, the top third is offset by a fraction, image seeing this appear randomly very quickly while playing the Vegas preview but if you stop play it looks fine.

Dexcon wrote on 4/30/2024, 2:57 AM

... Gopro options are 24, 30, 60, 120 or 240 depending on size & aspect ratio. The Gopro MediaInfo doesn't say whether it's PAL or NTSC?

With my GoPro 10, the NTSC frame rates are the default settings as far as I can recall, but if you go to Preferences/General and scroll down to "flicker rate" and change that setting from 60Hz to 50Hz, frame rates will then be PAL frame rates - 25, 50, etc.

I assume, though don't know for sure, that the GoPro 11 should have the same 50/60 Hz options so as to change between NTSC and PAL frame rates. GoPro 8 was much more straightforward because the frame options were clearly given elsewhere.

From GoPro 11's user manual:

Anti-Flicker

Choose the regional frame rate for recording and playback on a TV.

Set 60Hz (NTSC) for North America. Try 50Hz (PAL) if you're outside of

North America. The right format for your region will help prevent flicker

on a TV/HDTV when you play back video that was recorded indoors.

It therefore is the same as in GoPro 10.

Last changed by Dexcon on 4/30/2024, 3:09 AM, changed a total of 1 times.

Cameras: Sony FDR-AX100E; GoPro Hero 11 Black Creator Edition

Installed: Vegas Pro 15, 16, 17, 18, 19, 20, 21 & 22, HitFilm Pro 2021.3, DaVinci Resolve Studio 19.0.3, BCC 2025, Mocha Pro 2025.0, NBFX TotalFX 7, Neat NR, DVD Architect 6.0, MAGIX Travel Maps, Sound Forge Pro 16, SpectraLayers Pro 11, iZotope RX11 Advanced and many other iZ plugins, Vegasaur 4.0

Windows 11

Dell Alienware Aurora 11:

10th Gen Intel i9 10900KF - 10 cores (20 threads) - 3.7 to 5.3 GHz

NVIDIA GeForce RTX 2080 SUPER 8GB GDDR6 - liquid cooled

64GB RAM - Dual Channel HyperX FURY DDR4 XMP at 3200MHz

C drive: 2TB Samsung 990 PCIe 4.0 NVMe M.2 PCIe SSD

D: drive: 4TB Samsung 870 SATA SSD (used for media for editing current projects)

E: drive: 2TB Samsung 870 SATA SSD

F: drive: 6TB WD 7200 rpm Black HDD 3.5"

Dell Ultrasharp 32" 4K Color Calibrated Monitor

 

LAPTOP:

Dell Inspiron 5310 EVO 13.3"

i5-11320H CPU

C Drive: 1TB Corsair Gen4 NVMe M.2 2230 SSD (upgraded from the original 500 GB SSD)

Monitor is 2560 x 1600 @ 60 Hz

Former user wrote on 4/30/2024, 6:45 AM

@Dexcon Thanks I'll have a look, you need to go into the GoPro app to do that which I rarely use but I won't be changing it though, my phone only creates 30 & 60p, I don't want to be mix n matching different frame rates in a project.

I just need to add that the 'minor horizontal line type glitch' I mentioned above is with all media whether it's converted to CFR or not, It's hard to recreate & doesn't always happen. I'll try & capture if I do notice it again.

Dexcon wrote on 4/30/2024, 7:17 AM

.. you need to go into the GoPro app to do that ...

Not at all ... I just swipped down on GoPro's window and then swipped left and the Preferences menu button (it is large) appears - click on it and the options including 'Anti-Flicker' opens up. Maybe that option isn't available in GP11 though that would mean that it couldn't be changed out on location without having to go online.. I also rarely use the GoPro app except for updates.

Agreed to maintain frame rates between capture devices for the one project. Nonetheless, I've had to transcode HEVC from both my GoPro 10 and Samsung S23 Ultra cameras to mp4 AVC (transcoding in either VP or Resolve Studio 18) because HEVC has thus far struggled in Vegas Pro and, for that matter, also in Resolve Studio 18. Others of course have different experiences with HEVC. And with Samsung S23 video, to transcode VFR to CFR (as mentioned earlier in this thread). BTW, the majority of my media used in a project is mp4 AVC in 4K 25 fps from a Sony camera.

NB: I've never understood why phone cameras are only NTSC frame rates (@ 60Hz) when most of the world - including China and India - uses 50 Hz thus meaning PAL frame rates such as 25/50 fps.

Cameras: Sony FDR-AX100E; GoPro Hero 11 Black Creator Edition

Installed: Vegas Pro 15, 16, 17, 18, 19, 20, 21 & 22, HitFilm Pro 2021.3, DaVinci Resolve Studio 19.0.3, BCC 2025, Mocha Pro 2025.0, NBFX TotalFX 7, Neat NR, DVD Architect 6.0, MAGIX Travel Maps, Sound Forge Pro 16, SpectraLayers Pro 11, iZotope RX11 Advanced and many other iZ plugins, Vegasaur 4.0

Windows 11

Dell Alienware Aurora 11:

10th Gen Intel i9 10900KF - 10 cores (20 threads) - 3.7 to 5.3 GHz

NVIDIA GeForce RTX 2080 SUPER 8GB GDDR6 - liquid cooled

64GB RAM - Dual Channel HyperX FURY DDR4 XMP at 3200MHz

C drive: 2TB Samsung 990 PCIe 4.0 NVMe M.2 PCIe SSD

D: drive: 4TB Samsung 870 SATA SSD (used for media for editing current projects)

E: drive: 2TB Samsung 870 SATA SSD

F: drive: 6TB WD 7200 rpm Black HDD 3.5"

Dell Ultrasharp 32" 4K Color Calibrated Monitor

 

LAPTOP:

Dell Inspiron 5310 EVO 13.3"

i5-11320H CPU

C Drive: 1TB Corsair Gen4 NVMe M.2 2230 SSD (upgraded from the original 500 GB SSD)

Monitor is 2560 x 1600 @ 60 Hz

Former user wrote on 4/30/2024, 7:40 AM

@Dexcon Ah thanks, this is a fairly new Gopro for me, those options do feel familiar in the back of my mind so maybe I looked when I first got it but not since & have forgotten 👍. My old Gopro Hero 4 was hard to see the screen so I rarely changed anything on that once it was set up.

This Gopro 11 is set to 60hz

I too usually use the AVC option on the phone because of Vegas struggling with HEVC but this new (300) version plays my Gopro HEVC really well, full 59.94fps playback at Good (Full) without a problem, (I use Good (Half)), I've even considered changing to HEVC on the phone so it matches the Gopro, don't want to rock the boat at the mo.

 

set wrote on 4/30/2024, 8:03 AM

NB: I've never understood why phone cameras are only NTSC frame rates (@ 60Hz) when most of the world - including China and India - uses 50 Hz thus meaning PAL frame rates such as 25/50 fps.

Same dilemma...when combining pro 25p vs cellphone 30p... but I just keep going.

Setiawan Kartawidjaja
Bandung, West Java, Indonesia (UTC+7 Time Area)

Personal FB | Personal IG | Personal YT Channel
Chungs Video FB | Chungs Video IG | Chungs Video YT Channel
Personal Portfolios YouTube Playlist
Pond5 page: My Stock Footage of Bandung city

 

System 5-2021:
Processor: Intel(R) Core(TM) i7-10700 CPU @ 2.90GHz   2.90 GHz
Video Card1: Intel UHD Graphics 630 (Driver 31.0.101.2127 (Feb 1 2024 Release date))
Video Card2: NVIDIA GeForce RTX 3060 Ti 8GB GDDR6 (Driver Version 551.23 Studio Driver (Jan 24 2024 Release Date))
RAM: 32.0 GB
OS: Windows 10 Pro Version 22H2 OS Build 19045.3693
Drive OS: SSD 240GB
Drive Working: NVMe 1TB
Drive Storage: 4TB+2TB

 

System 2-2018:
ASUS ROG Strix Hero II GL504GM Gaming Laptop
Processor: Intel(R) Core(TM) i7 8750H CPU @2.20GHz 2.21 GHz
Video Card 1: Intel(R) UHD Graphics 630 (Driver 31.0.101.2111)
Video Card 2: NVIDIA GeForce GTX 1060 6GB GDDR5 VRAM (Driver Version 537.58)
RAM: 16GB
OS: Win11 Home 64-bit Version 22H2 OS Build 22621.2428
Storage: M.2 NVMe PCIe 256GB SSD & 2.5" 5400rpm 1TB SSHD

 

* I don't work for VEGAS Creative Software Team. I'm just Voluntary Moderator in this forum.