AI lipsync software...
 
Notifications
Clear all

AI lipsync software to replace Papagayo

15 Posts
6 Users
3 Reactions
3,623 Views
Posts: 9
Topic starter
(@ocupmoc)
Active Member
Joined: 10 years ago
[#58311]

Hi all,

Did anybody figure out if we can get Papagayo replaced with an AI version?
There are plenty of AI apps that can lipsync a video from an imported audio file so I guess it should be possible to export those lip movements to a text file right?
I do love the end-result but I could do without the many hours of editing the phonemes.

All help will be greatly appreciated.

Cheers,
Arco


14 Replies
dirknerkle
Posts: 10309
(@dirknerkle)
Illustrious Member
Joined: 18 years ago

Spending the time synchronizing the music to the effects is what makes this hobby different from all the run-of-the-mill sequencing. It's what makes the show sparkle. It allows you to capture the soul of the music. AI can't do that.


Reply
ErnieHorning
Posts: 4434
(@erniehorning)
Famed Member
Joined: 19 years ago

If you have xLights, there's a web app called AutoLyrics ( https://autolyrics.lightingfanatics.com/index.php ) that will use a text file containing all the words and the music to make a timing track for xLights.

It's not fast nor does it indicate that it's even done. Just give it a few minutes, refresh the page and check if it's got the timing track done. It depends on the song and how clear the words are.

Ron Howard from xTreme Sequences has a nice video on this and how to use it.
https://www.youtube.com/watch?v=Q_kH4De3AT0


Reply
Posts: 133
(@mel4853)
Estimable Member
Joined: 19 years ago

This works pretty well. I used it last year and was just using it last night on some songs. It's not perfect but nobody noticed in my show last year.


Reply
Posts: 9
Topic starter
(@ocupmoc)
Active Member
Joined: 10 years ago
dirknerkle wrote:
Spending the time synchronizing the music to the effects is what makes this hobby different from all the run-of-the-mill sequencing. It's what makes the show sparkle. It allows you to capture the soul of the music. AI can't do that.
dirknerkle wrote:

dirknerkle wrote:

It is not so much synching the effects, I only have animated characters, so this is only about the bulk of the lipsync work. Finetuning is always needed. Nevertheless many thanks for your feedback, much appreciated.


Reply
Page 1 / 3
Share: