Text To Subtitles. Possible?

iEmby wrote on 8/20/2024, 4:41 AM

Hi guys... how r u?

i need a help in something which i can't figure out.

i have a client who speak Punjabi (Gurmukhi) language which is an Indian language.

i have to create its subtitles.

but unfortunately Vegas Speech To Text have other Indian Languages but not Punjabi.

I don't know which API they are using for it.

But anyway i have to convert speech to text via WhatsApp Voice Input feature after setting my Gborad keyboard language to Punjabi.

which works 95% ok even when my client speak very rough and cultural punjabi.

then i have to convert that text (which is in Unicode format) to AnmolLipi font (a valid punjabi font) from a web site.

after then i have to follow a long procedure

First i have to add markers on that video as per spoken line by my client

then as per markers i have to sort that text paragraph into lines (as Vegasaue Text Generator needed)

then i use Vegasaur Text Generator and then generate text on markers.

so my query is just one thing..

can i do this all more fast..

can i create subtitles from a text paragraph which align every line and word as per person speaks.

is it can be done in VEGAS?

or is there any other software for this?

please suggest.

Thankyou.

Back to post

Comments

iEmby wrote on 8/23/2024, 10:03 PM

ok sir.. so at the moment i am quitting on Punjabi subtitling after tried at many places and software.

ok can i create subtitles in english but punjabi..

like this is punjabi

which means in English is Go and Talk

so can i write its pronunciation

Ja Ke Gal Karo as subtitles?

I hope you understand

RogerS wrote on 8/23/2024, 10:25 PM

Whisper X is presumably on GitHub and you may be able to fool Subtitle Edit by replacing another whisper exe with it, or run it from the command line. I don't think any of these make use of AMD GPUs so VRAM shouldn't matter. I doubt they'll work better with Punjabi, sadly.

RogerS wrote on 8/25/2024, 4:40 AM

I just checked and Whisper X is incorporated into SubtitleEdit so you don't have to use it via the command line.
File the steps here and build it within Python.
https://github.com/m-bain/whisperX

I don't think any of the Whisper variants would do better with Punjabi- they need to improve the models.

iEmby wrote on 8/25/2024, 10:55 AM

I don't think any of the Whisper variants would do better with Punjabi- they need to improve the models.

yes ,, agreed ...
that's why i loose hope on it now..