Loading...
> >

Workflow from Rokoko to DAZ via MotionBuilder

2»

Comments

  • FirePro9FirePro9 Posts: 456

    VERY Impressive Lunarlume!  Will be watching for the plugin.

  • LunarlumeLunarlume Posts: 8

    Thanks! With iRay at 720p with 200 samples it took around eight hours per minute to render. Hard to say in total as several scenes have other scenes used as textures - best guess is around 200 hours. I let my computer work while I was sleeping...

    Working on a Rokoko Mocap only version for the plugin so it can be finished sooner. The script editing/vocal track autoedit/viseme matching part is really rough, and the VDB animator and the texture animator still crashes Daz too often. Will be putting it on the Daz store when ready.

  • linoge8888linoge8888 Posts: 74
    edited September 2022

    Lunarlume said:

    Working on a Rokoko Mocap only version for the plugin so it can be finished sooner. 

     

    OH MY... It looks like a real life changer! Bye bye Maya... Could it be compatible with the first smartsuit ? and as far as I know, the gloves don't capture the thumbs, do you confirm ? 

    Post edited by linoge8888 on
  • LunarlumeLunarlume Posts: 8

    Not sure about the SmartSuit version one. The original version of the plugin was developed using Rokoko Studio (now legacy) before the version two was shipped. It has needed some minor adaptations to also work with Rokoko Studio beta. Integration is with the Rokoko Studio Live Stream, custom option, with JSON v3. You can use the LZ4 or leave it off. If the first suit works with the current Rokoko Studio, it should talk to the Daz Plugin.

    The SmartGloves 2 have one sensor per finger, and do have thumbs. Can't say about version one. Picture is from Rokoko Studio highlighting the joints recorded. The hands do show more joints than actual sensors - the rokoko software assumes a general curve for fingers.

    rokoko_joints.jpg
    775 x 800 - 40K
  • catmastercatmaster Posts: 226

    Does the Rokoko suit work better than webcam mocaps?

    The AutoRig Pro retargeting worked really well when used with Animation Layers to clean up the results. Mixamo was the easiest to convert, other mocap formats were also not difficult after the rest poses of the meshes were matched.

    Recently tried to use the Plask AI to convert porn videos into adult animations. The results were too messy to worth cleaning up.

  • TheMysteryIsThePointTheMysteryIsThePoint Posts: 2,946

    I think that probably by this time next year, we'll all be using move.ai for mocap and retargeting. We won't really know until there are some independent reviews, but it looks very promising and look like they're doing things to decrease the hardware investment, e.g. older iPhones.

  • linoge8888linoge8888 Posts: 74

    OH! Never heard about move.ai before. It looks very promising indeed and could be the end of Xsens and Rokoko in the medium-term. The workflow remains unclear, though.

  • TheMysteryIsThePointTheMysteryIsThePoint Posts: 2,946

    linoge8888 said:

    OH! Never heard about move.ai before. It looks very promising indeed and could be the end of Xsens and Rokoko in the medium-term. The workflow remains unclear, though.

    The workflow is pretty well documented on the doc site you can access after you are let into the beta program. And the co-founder as well as four other move.ai employees man their discord server. I've already spoken to the co-founder directly. One really gets the impression that they are hungry and really want to upset the entire industry.

     

Sign In or Register to comment.