New Face MoCap Coming

135

Comments

  • HavosHavos Posts: 5,403

    I have an iPhone that can run this. I need an iPhone in order to test the apps I develop for IOS. However I have almost zero need for animation right now, as our apps only use still images, so I can't see what I would do with this new product.

  • WendyLuvsCatzWendyLuvsCatz Posts: 38,597
    edited September 2020

    yeah I would love a facial mocap app that used a webcam like Facerig does,

    for the price of an iPhoneX I can buy a nicer graphics card if I had the money which is why I am uninterested in the UE4 version of Facemotion too.

    edit

    I see there is a thread, those interested should post there while us Appleware phonephobes can stay here and grizzle cheeky

    Post edited by WendyLuvsCatz on
  • lilweeplilweep Posts: 2,561

     

    Havos said:

    I have an iPhone that can run this. I need an iPhone in order to test the apps I develop for IOS. However I have almost zero need for animation right now, as our apps only use still images, so I can't see what I would do with this new product.

    thanks for your autobiography.

     

    I think this product would be a lot better if it was targeting more motion around the lips etc.  It seems like a lot of nuances of the lip motion when speaking is not captured (at least in the promo videos) so seems like you might as well just keyframe the animation.

  • CybersoxCybersox Posts: 9,085

    I think the attached video is probably the best demonstration of what's possible, and from looking at that.... well, on the positive side, it does a fairly good job with the eyes, eyebrows and general movements of the head.  On the negative side, however, the mouth expressions are inconsistant at best... note that a toothy grin becomes an open mouth... and the "lip synch" is just the jaw flapping, without even the basic lip movements for the frictives and plosives.  Overall, it's probably good enough for monsters and other non humans, but it's a long way from being usable on a realistic character speaking actual dialog without having to do a ton of manual editing and reanimation afterwords, and it doesn't seem to include any built in provisions for that like Reallussion's similar Faceware does. Tossing in the prerequisite to buy or own a ridiculously overpriced phone is the final deal killer for me, although I suspect that this MIGHT work with the new iPad series 3 models that also have lidar, given that similar iPhone mocap programs are being advertised as doing so.       

  • This thread started for the original Face Mojo. Since then Laylo and Free Nomon went their separate ways. Laylo kept the name Face Mojo since he came up with it, but Free Nomon did all the work on the blendshapes, etc. and he kept those and has made improvements which should be showing up in the Daz Store soon as Facemotion. 

  • It does work with the new iPad series 3 model. It's the TrueDepth camera it needs.

  • FauvistFauvist Posts: 2,152

    I have a new (2019) MacBook Pro 16" and 2019 iPad, neither of which have a TrueDepth camera.  Maybe in 8 years when I buy a new Mac I can buy the Face Mojo.  Pity.

     

     

  • Fauvist said:

    I have a new (2019) MacBook Pro 16" and 2019 iPad, neither of which have a TrueDepth camera.  Maybe in 8 years when I buy a new Mac I can buy the Face Mojo.  Pity.

     

     

    I have a 2019 iPad too and it was my second iPad (admittedly a gift) so no, not in a hurry to update

    is just wifi unlike a damn data draining phone

  • I have it bought FaceMojo...I think there are 2 competing ones now.  Don't know what went down but there is FaceMoj and the other one made by Free Nomon.  Both work great.

    All the expressions are used for my comic.   I'm about to do a  film and movie as well.  Very easy to use.  :)

  • ChrisSerketChrisSerket Posts: 202
    edited September 2020

    How nice, two people who create very similar products, and neither came up with the idea that instead of opting for Apple, go for Android, which is the one who has more users in the market.
    I find it very bizarre.
    I have an iphone 3 and I wouldn't go for a new Apple phone either, as my current Android phone outperforms my past bad experiences with Apple.

    Post edited by ChrisSerket on
  • WendyLuvsCatzWendyLuvsCatz Posts: 38,597
    edited September 2020

    I would just love a webcam solution myself.

    It is possible, there are papers and code out there but I don't have the skills to do it myself, I have looked at them too.

    some however the fact they are opensource actually stops people from commercial ventures  

    one popular one used by Blender users, OpenPose which  I mentioned before and had hoped interested people like Philemo had written code for us for, is strictly noncommercial unless huge fees paid to the University involved so unlikely to find its way to DAZ

    I did look at it but was completely beyond my skillset to even use it in Blender with their models

    https://www.blendernation.com/2020/04/27/openpose-to-blender-facial-motion-capture-tutorials/

    I use Facerig otherwise with their own characters but apparently that is being rewritten with a completely subscription based new program, on the brightside apparently there will be a free noncommercial version on Steam for Zoom, Skype, Discord users.

    the one I have is $21 and fun but noncommercial too.

    Ulsee is the company behind it and possibly someone could work with them to produce a DAZ based version.

    Post edited by WendyLuvsCatz on
  • CybersoxCybersox Posts: 9,085

    How nice, two people who create very similar products, and neither came up with the idea that instead of opting for Apple, go for Android, which is the one who has more users in the market.
    I find it very bizarre.
    I have an iphone 3 and I wouldn't go for a new Apple phone either, as my current Android phone outperforms my past bad experiences with Apple.

    It is frustrating. Android users outnumber iPhone users by a better than 3 to one margin (75% of the market vs. 23%), the top of the line Android phones are all technically superior to iPhones at a lower price, and the iPhone is the single most environmentally damaging phone on the market thanks to Apple's accelerated program of systematically crippling older phones.  So why do programmers spend so much time focusing on the overpriced evil that are iPhones?  Well, while it's easy to blame it all on brainwashing, the main reason is simplicity.  There's only one company that makes iPhones, so the only variations in programming are created by Apple itself, whereas there are dozens of  Android manufacturers, most of which have made their own tweaks and variations to the basic software.  Likewsie, at any given time there are a maximum of 6 models of iPhone that are actively being supported by Apple whereas there are thousands of models of Android phone actively in use.  Needless to say, that means that writing, testing and making sure that the program actually works is a hell of a lot easier with Apple, so much so that it often offsets automatically writing off three fourths of the entire market.   

  • How nice, two people who create very similar products, and neither came up with the idea that instead of opting for Apple, go for Android, which is the one who has more users in the market.
    I find it very bizarre.
    I have an iphone 3 and I wouldn't go for a new Apple phone either, as my current Android phone outperforms my past bad experiences with Apple.

    From what I understand and read a month ago when I found out about these is that it has to do with apple's facial recognition technology that is not available on Android phones. I was reading a number of forums about this and some developers had said that if Android can replicate it then it is possible, but until then they can't duplicate it with just the regular camera. This is what I read on several forums about different facial recognition apps and youtube videos. 

    I had a Pixel and was in the market for a new phone since the dang thing stopped ringing and the speaker phone wouldn't work either and the guy at Verizon told me an iPhone 11 was five bucks cheaper a month than the Androids I was looking at, so I figured I'd just get the iPhone so I could do the facial mocap. 

  • How nice, two people who create very similar products, and neither came up with the idea that instead of opting for Apple, go for Android, which is the one who has more users in the market.
    I find it very bizarre.
    I have an iphone 3 and I wouldn't go for a new Apple phone either, as my current Android phone outperforms my past bad experiences with Apple.

    From what I understand and read a month ago when I found out about these is that it has to do with apple's facial recognition technology that is not available on Android phones. I was reading a number of forums about this and some developers had said that if Android can replicate it then it is possible, but until then they can't duplicate it with just the regular camera. This is what I read on several forums about different facial recognition apps and youtube videos. 

    I had a Pixel and was in the market for a new phone since the dang thing stopped ringing and the speaker phone wouldn't work either and the guy at Verizon told me an iPhone 11 was five bucks cheaper a month than the Androids I was looking at, so I figured I'd just get the iPhone so I could do the facial mocap. 

    Yes, I had already heard about this.

     

    Cybersox said:

    How nice, two people who create very similar products, and neither came up with the idea that instead of opting for Apple, go for Android, which is the one who has more users in the market.
    I find it very bizarre.
    I have an iphone 3 and I wouldn't go for a new Apple phone either, as my current Android phone outperforms my past bad experiences with Apple.

    It is frustrating. Android users outnumber iPhone users by a better than 3 to one margin (75% of the market vs. 23%), the top of the line Android phones are all technically superior to iPhones at a lower price, and the iPhone is the single most environmentally damaging phone on the market thanks to Apple's accelerated program of systematically crippling older phones.  So why do programmers spend so much time focusing on the overpriced evil that are iPhones?  Well, while it's easy to blame it all on brainwashing, the main reason is simplicity.  There's only one company that makes iPhones, so the only variations in programming are created by Apple itself, whereas there are dozens of  Android manufacturers, most of which have made their own tweaks and variations to the basic software.  Likewsie, at any given time there are a maximum of 6 models of iPhone that are actively being supported by Apple whereas there are thousands of models of Android phone actively in use.  Needless to say, that means that writing, testing and making sure that the program actually works is a hell of a lot easier with Apple, so much so that it often offsets automatically writing off three fourths of the entire market.   

    I did not know about the environment, and the data is interesting.

     

    I would just love a webcam solution myself.

    It is possible, there are papers and code out there but I don't have the skills to do it myself, I have looked at them too.

    some however the fact they are opensource actually stops people from commercial ventures  

    one popular one used by Blender users, OpenPose which  I mentioned before and had hoped interested people like Philemo had written code for us for, is strictly noncommercial unless huge fees paid to the University involved so unlikely to find its way to DAZ

    I did look at it but was completely beyond my skillset to even use it in Blender with their models

    https://www.blendernation.com/2020/04/27/openpose-to-blender-facial-motion-capture-tutorials/

    I use Facerig otherwise with their own characters but apparently that is being rewritten with a completely subscription based new program, on the brightside apparently there will be a free noncommercial version on Steam for Zoom, Skype, Discord users.

    the one I have is $21 and fun but noncommercial too.

    Ulsee is the company behind it and possibly someone could work with them to produce a DAZ based version.

    Strongly agree about the webcam, or at least use an Android cell phone as a pc webcam. There is a free application called MANYCAM that allows you to use your cell phone (either Android or Iphone (Windows Phone there I don't know)) or even the Ps3 Eye on Cam as a webcam.
    Moreover, with a certain program I tried ManyCam both with my Android cell phone and with my Ps3 Eye on Cam (also Kinect) as facial motion capture hardware.
    Wendy, I think you know him, since I saw you yesterday in another forum asking about this program, which is called F-CLONE (something tells me that the creator was inspired by ICLONE to name it hahahahahaha).
    Does it capture the movement?
    YES, IT CATCHES IT.
    The problem?
    Once captured at least I have not exported the animations. I have followed the author's tutorial to the letter, even creating the directory in the same place as the author and with the same folder name, but no, the folder is always blank. And this author, it is from the one who uploaded the hardware and then went up in smoke.
    If someone managed to get the animation files to appear, they would like to listen to it, since in itself it is a super easy solution (to use), inexpensive and with multiple compatible devices.

  • F-Clone has always sounded dodgey to me, never many details and nobody seems to have anything good to say about it if at all.

  • F-Clone has always sounded dodgey to me, never many details and nobody seems to have anything good to say about it if at all.

    That's right, but it's rare that you can achieve the most complex (facial mocap) but not the easiest thing that would be exporting the movement.
    It kind of works but not at the same time.
    On youtube and on renderosity I saw several users that it worked for them, but most of them still complained about the badness of the program, because it was not so professional.
    Still, it seems the closest to what many of us are looking for, right now I'm making a few random attempts to get it to work the hard way.
    If you get positive results, you will be the first to know :) :)

  • TugpsxTugpsx Posts: 753

    Any update? Curious if anyone has been able to get these working?

  • Kevin SandersonKevin Sanderson Posts: 1,643
    edited December 2020

    Face Mojo is in the store. Free Nomon (Kenneth) who worked on it originally has one called Facemotion along with Mixamotion and will be bringing his to Daz soon. He has a YouTube channel where you can find out more. He's working on a real time version which he shows in his latest video. Free Nomon's looks better to me. I never got F-Clone working and the creator vanished.

    Post edited by Kevin Sanderson on
  • AllenArtAllenArt Posts: 7,172

    Well, this one looks slightly less "wooden" than the one that came recently to the store. I liked the way his lips move at least...lol.

  • Yeah, Free Nomon has better modified morphs. The girls move better. The lower lip on the guys is a little stiff but better than Face Mojo that made it to the store. That one didn't keep the morphs Free Nomon worked on.

  • I did all of the face mocap with Facemotion from Free Nomon in this. I absolutely love it. Sure, sometimes I have to make some adjustments if I didn't look right where I needed to, but it just brings so much life to the character that's natural. 

    (39) Peaches - A Daz 3D animated film - YouTube

  • TugpsxTugpsx Posts: 753

    I bought the FaceMojo version only to realize that it required the $50 iphone application also. I havent used it yet and my return it.

  • Leonides02Leonides02 Posts: 1,379

    benniewoodell said:

    I did all of the face mocap with Facemotion from Free Nomon in this. I absolutely love it. Sure, sometimes I have to make some adjustments if I didn't look right where I needed to, but it just brings so much life to the character that's natural. 

    (39) Peaches - A Daz 3D animated film - YouTube

     

    Great job on the animation! Both the expressions and the movement were quite good.

  • benniewoodell said:

    I did all of the face mocap with Facemotion from Free Nomon in this. I absolutely love it. Sure, sometimes I have to make some adjustments if I didn't look right where I needed to, but it just brings so much life to the character that's natural. 

    (39) Peaches - A Daz 3D animated film - YouTube

    Outstanding, @benniewoodell!

  • shadowhawk1shadowhawk1 Posts: 2,200

    Seriously! A program that requries the purchase of a $400+ iphone or ipad to use? I wouldn't use apple products if they were the only option. I can understand selling products that require photoshp, GIMP, Blender and such but to back and support a program that requires you to purchase a phone or device you may not need from a manufacturer that you may not wish to support is really a new low in my book. 

  • wolf359wolf359 Posts: 3,837

    Daz sells content that uses the shader/material system of its 
    primary render engine(Iray)
    that requires the purchase of a not so cheap GPU from ONE hardware company to get tolerable render times.

     

    Considering the economics of software development
    and the expected ROI from the target demographic
    I would say the Plugin is reasonably priced.

    The Apple, Ark kit, true depth camera system for facial mocap
    seems well supported these days.

    We even have such an option over in the Reallusion/CC3 eco-system
    as well as at least two such options that support Blender Directly
    and of course Autodesk,Maxon and likely the major game engines.

    There will likely be other non Apple /Iphone solutions for facial mocap in the near future IMHO.

     
     

  • @Leonides02 and @TheMysteryIsThePoint thank you so very much for taking the time to watch and the very kind comments, it reallly means a lot! 

  • benniewoodell said:

    @Leonides02 and @TheMysteryIsThePoint thank you so very much for taking the time to watch and the very kind comments, it reallly means a lot! 

    You are very welcome. The face cap, especially the eyes and eyebrows was really quite decent. But your moneymaker was still the story.

    When that !@#$ Peaches posted that she had found her "Forever", the use of the repeated word hit me right in the feels. Really, really well done.

    I think the job of the visuals is simply to exist without destroying the viewer's willingness to engage with a character emotionally. You've given proof that this particular technology is up to the hardest part of the task: the eyes. I was going to make my own shapekeys in Blender and drive them and write a script to drive their strengths with ARKit data, but I think I'll just use this now :)

  • shadowhawk1shadowhawk1 Posts: 2,200

    wolf359 said:

    Daz sells content that uses the shader/material system of its 
    primary render engine(Iray)
    that requires the purchase of a not so cheap GPU from ONE hardware company to get tolerable render times.

     

    Considering the economics of software development
    and the expected ROI from the target demographic
    I would say the Plugin is reasonably priced.

    The Apple, Ark kit, true depth camera system for facial mocap
    seems well supported these days.

    We even have such an option over in the Reallusion/CC3 eco-system
    as well as at least two such options that support Blender Directly
    and of course Autodesk,Maxon and likely the major game engines.

    There will likely be other non Apple /Iphone solutions for facial mocap in the near future IMHO.

     

     Requiring a spefic video card to use Iray is not even a decent comparison of having to replace your current cell phone with an over priced product just to use ONE feature. I won't go into dealing with over priced applications from said company or having to use special formats that can't be used on other systems. 

  • Kevin SandersonKevin Sanderson Posts: 1,643
    edited December 2020

    You don't have to replace your cell phone. Just buy an unlocked used one. You're just using the TrueDepth camera and app. You can use an iPad with a TrueDepth camera as well.

    Post edited by Kevin Sanderson on
Sign In or Register to comment.