Lipsinc options in Daz studio, a Video review

wolf359

In another thread  I had promsed to make a video review of some the lipsinc options  in Daz studio past &present.
 
I thought this may deserve its own  thread for those who did not see the original discussion
Here is a link to My video review of those lipsinc options for Daz studio:
https://drive.google.com/file/d/1xOSyocgvpRfrYw821IxxdYVLuQI5rALm/view

 

WendyLuvsCatz

very interesting

I decided to have a go in Mimic pro for Carrara, on 8 generations of Vickies

first thing I notice is they don't all blink the same time but they do all blink

it will take probably 8 hours to render the video

wolf359

Also here is a  quick test of the 
Poser pro 2014 talk designer using the long forgotten
Poser 6 female "Jessie".

To be honest the poser talk designer produces a decent base 
result but  is sadly not only restricted to
the unpopular poser native figures, but only seems to work with their default shapes and will override any custom morphs 
you may be using with the figures during lipsinc

https://drive.google.com/file/d/1sQ9H7D6LvSMcV0np-Fm4piRr8_cjWA1r/view

 

Luv Lee

wolf359 said:

In another thread  I had promsed to make a video review of some the lipsinc options  in Daz studio past &present.
 
I thought this may deserve its own  thread for those who did not see the original discussion
Here is a link to My video review of those lipsinc options for Daz studio:
https://drive.google.com/file/d/1xOSyocgvpRfrYw821IxxdYVLuQI5rALm/view

 

You suh, kindly rock...

WendyLuvsCatz

Victoria

1 2 3 4

5 6 7 8

since I used your audio for comparison I unlisted it

I may try one with each Vicky later individually using my voice

WendyLuvsCatz

it won't be staying up, I got hit with a copyright claim for Enya 

can a short time but I will do another with a different voice recording clse ups and maybe showing NLA clip adjustability

hopefully gets to be viewed by Wolf359 and others before I delete it

wolf359

it won't be staying up, I got hit with a copyright claim for Enya 

You must have caught her in a "catty" mood

Same song used:

Still, I am going back to using my Google drive only to share videos from now on.

wolf359

Wendy BTW I've attached the sad ending femal audio  to this post without the Enya background track
Just remove the .txt from the zip filename

WendyLuvsCatz

wolf359 said:

Wendy BTW I've attached the sad ending femal audio  to this post without the Enya background track
Just remove the .txt from the zip filename

TY I may try it too when I get around to my close ups, I did a silly thing in Carrara and need to wait a few hours or I will lose something I didn't save

WendyLuvsCatz

a bit off topic as Carrara

but this is how the 8 generations of Victoria speak with the Carrara mimic plugin

sadly only the first 4 generations could be exported fully to DAZ studio as pz2 files using a plugin no longer sold at DAZ by Fenric

g3 & 8 can bone movements via BVH with that plugin but lacks morphs

juve_satriani

Wendy_Carrara said:

very interesting

I decided to have a go in Mimic pro for Carrara, on 8 generations of Vickies

first thing I notice is they don't all blink the same time but they do all blink

it will take probably 8 hours to render the video

I Wonder if you can exporting facial motion data for use in Daz studio? Fine tuning mouth via Graphical Ui really needed.especially for non english language dialogue.

WendyLuvsCatz

Well you can in DAZ studio with the 32bit lip sync save a pose file and edit that

maybe what is needed is some sort of spreadsheet so one can swap out viseme/phonemes 

mindsong

Thanks wolf359 for the review and Wendy for those comparisons.

I viewed the Carrara "one-by-one" and am more impressed than I expected I'd be. With a bit of tweaking, those are pretty useable! (I like the background numbers in each snippit :). Interesting lip-motion during the silence in the "all 8" version. I'm thinking "i buried paul" or some-such when I watch that... I like the comparison between all 8 vickies as they speak. That's great!

wolf359, your review was well-done and useful. Thanks for showing each result three times in the context of each tool. I didn't realize how useful that was until I was watching it, and was able to see new lip-sync characteristics of each session more clearly as each repeat occurred. Nicely done, and interesting. I'm a Genesis1 user and love Mimic-Pro, but the papagayo thread has me looking that way now... Thanks for starting that other 'papagayo' thread too.

--ms

 

WendyLuvsCatz

mindsong said:

Thanks wolf359 for the review and Wendy for those comparisons.

I viewed the Carrara "one-by-one" and am more impressed than I expected I'd be. With a bit of tweaking, those are pretty useable! (I like the background numbers in each snippit :). Interesting lip-motion during the silence in the "all 8" version. I'm thinking "i buried paul" or some-such when I watch that... I like the comparison between all 8 vickies as they speak. That's great!

wolf359, your review was well-done and useful. Thanks for showing each result three times in the context of each tool. I didn't realize how useful that was until I was watching it, and was able to see new lip-sync characteristics of each session more clearly as each repeat occurred. Nicely done, and interesting. I'm a Genesis1 user and love Mimic-Pro, but the papagayo thread has me looking that way now... Thanks for starting that other 'papagayo' thread too.

--ms

 

that mouth movement was them singing Enya's tune which I had silenced using YouTube's copyrighted music removal tool

mindsong

Wendy_Carrara said:

mindsong said:

Thanks wolf359 for the review and Wendy for those comparisons.

I viewed the Carrara "one-by-one" and am more impressed than I expected I'd be. With a bit of tweaking, those are pretty useable! (I like the background numbers in each snippit :). Interesting lip-motion during the silence in the "all 8" version. I'm thinking "i buried paul" or some-such when I watch that... I like the comparison between all 8 vickies as they speak. That's great!

wolf359, your review was well-done and useful. Thanks for showing each result three times in the context of each tool. I didn't realize how useful that was until I was watching it, and was able to see new lip-sync characteristics of each session more clearly as each repeat occurred. Nicely done, and interesting. I'm a Genesis1 user and love Mimic-Pro, but the papagayo thread has me looking that way now... Thanks for starting that other 'papagayo' thread too.

--ms

 

that mouth movement was them singing Enya's tune which I had silenced using YouTube's copyrighted music removal tool

Ah, so you're saying that there aren't any hidden alien contact messages or premonitions buried subtly within your varied artworks? So much for the thesis of my new book. (yah, while I'm all about good copyright protection, that big media search company that 'removes' such content isn't really active in my personal domain any more. I think their motto is 'do know evil' or something like that. Can't talk about it here though...

--ms

wolf359

Thanks for showing each result three times in the context of each tool. I didn't realize how useful that was until I was watching it, and was able to see new lip-sync characteristics of each session more clearly as each repeat occurred. Nicely done, and interesting. I'm a Genesis1 user and love Mimic-Pro, but the papagayo thread has me looking that way now... Thanks for starting that other 'papagayo' thread too.

You are most welcome!!
Fun fact: that video was literally my first time ever actually using "windows movie maker" as My Mac was tied up in a 5 day long render thus I had no access to Imovie or Final Cut where I normally edit video.

WMM is not bad for simple, short video's like this one.

I know Facial mocap is all the rage these days but I am not aware of any truly viable Facial mocap options for Daz studio...Maybe in the near future??.

I too still use Mimic pro3 with a G2 exported CR2 because Genesis 2 is still my primary generation for animation as I have hundreds of morphs for them and develop my own clothing content for them as well

Here is a sample of the Genesis 2 male driven by Mimic pro 3

However I may start using Papagayo in production as I just love its  simple elegant display of your audio waveform and you can hear syllables by just clicking on them for lining up your phonemes with the text.

I use Mimic live with the few Genesis 3 Characters That use
( Ivan7 and Fat George) as I have figured out how to use pre-recorded Audio
with mimic Live using a second computer to pipe in hard line audio as described here:
https://www.daz3d.com/forums/discussion/115371/for-my-fellow-animators-using-mimic-live
 

Ivy

Wendy_Carrara said:

a bit off topic as Carrara

but this is how the 8 generations of Victoria speak with the Carrara mimic plugin

sadly only the first 4 generations could be exported fully to DAZ studio as pz2 files using a plugin no longer sold at DAZ by Fenric

g3 & 8 can bone movements via BVH with that plugin but lacks morphs

that looks really great Wendy the best i seen yet.

I don't use many voices in my animation so if i need a lipsynce i just use the 32 byte version of daz. when I'm using  genesis 8  I've been hand keyframing my mouth movements for lack of a g8.dmc .. but like i said i hardly use dialogue in my animation. i try to make my films so they can be understood by anyone without voices which is not as easy as one would think.

BTW good thread wolf thanks for the good info.:)