V Tubers and DAZ users
WendyLuvsCatz
Posts: 38,220
I have been looking at the weird world of Vtubers.
Most use Anime type programs like Vroid, MikuMikuDance and Live 2D Cubism
some make their own mesh from scratch like the one mentioned here in this video below
(which also briefly shows Shudu hence my post)
I am wondering if DAZ characters are going to take off as VTubers since they too can be live linked with Unreal Engine and Apple ARkit
and if DAZ wants to maybe wants some of that sweet Vlogging pie by incorporating it into DAZ studio itself maybe using Filament for realtime rendering overlayable on a video stream
since Mimic Live is gone maybe realtime facial capture is the future?
Daz 3D is part of 
Connect
DAZ Productions, Inc.
7533 S Center View Ct #4664
West Jordan, UT 84084
Licensing Agreement | Terms of Service | Privacy Policy | EULA
© 2024 Daz Productions Inc. All Rights Reserved.
Comments
Maybe with a couple of updates, I could see PBR mode being used for this sort of stuff. I'm guessing that if anyone wants to seriously use DAZ for this sort of stuff though, they would either be creating or commisining custm characters
might want to check out the tafi avatars if you haven't already :)
they are Unity sadly or I would have.
I do use DAZ people in Unreal but not owning an iPhone I cannot do live facial capture.
I did buy the Poserecorder for DAZ studio to make Vlogs
wow ..I'm way out of touch on this stuff. No clue. Vtubers? Vlogger? any of it ??
I'm still learning DS. Plus, 3D printing. and now python, plus a couple other graphics programs.
I have seen a few of them. A number of the Vtubers out there are company efforts, and many vtubers are fairly simple in design. Like some don't interact all that much, you just see their facial expressions. Plus most vtubers never show their actor's face. I think a number of vtubers may be voice actors making money on the side, or if the vtube gig pays well enough, making the vtube gig their main job. A lot of vtubers tend to have a certain cute anime like voice. I think some vtubers are using a software like FaceRig to stream with. FaceRig has been around since 2015, so it isn't new. In fact there are some threads on DA asking how to get Daz models into FaceRig.
CodeMiko is something totally different, and on a whole different level than anyone else. Nobody is doing what CodeMiko does. She started it all by herself, but she now has an editor who will take videos and make clip shows. The clips are a secondary channel. I prefer the clips, because honestly I can't take Miko for too long in one sitting...she does need that editor. She can be very funny, but her humor can also wear thin on me (IMO). There is no question that the woman has incredible talent and drive. She custom wrote all of this code, this is not some kind of program people can buy, and she modeled and rigged everything. She designed it all, not only to give her Miko character a lot of features, but she also added custom features for her Twitch users that are really unique. When people pay tips, she has custom code that offers the rewards for those tips instantly. When users are able to adjust her size, again, that is all due to her code skills making that possible, not Twitch. And to top off the coding, she has some comedic skills, too, otherwise nobody would tune it to her. No matter how amazing her code skills are she still has to perform, and people who stream for a living do it a lot. This girl is streaming for like 8 hours every day, and she still works on the character and code in her down time to try and make it better.
That said, her humor is not for everybody. Her voice can sometimes be grating, too, she is like a Korean Fran Drescher if anybody remembers her, LOL. She does a lot of streams out of the suit, just normal streams of herself, and these tend to be toned down compared to the cartoonish Miko character.
I use Facerig and now Animaze on Facebook sometimes, usually my Birthday or Christmas, did a couple of times on Skype when I had it too, I import 3D props, you can render for editing to create Live2D avatars using DAZ I believe, not tried.
2D is definitely the easiest way to go, I reckon Clip Studio could do it too, also stuff like Dragonbones and Spine in Unity.
Vseeface, Vroid et are popular for 3D but certainly on the toony side too
Tafi is certainly jumping on that Metaverse already.
Been trying to customise some Ready Player Me Avatars for Animaze, so far only retexturing, while I can export FBX the rigged GTLF files from Blender and get the Blendshapes working in iClone6 I don't seem to be able to make the round trip intact with added animations back into Animaze and I lose the Blendshapes in Unreal, (I am not using the Developers tools and SDK as beyond my ability) I would otherwise dress them at least in DAZ clothing or try my own modeling attempts preserving the rigging hierarchy.
I personally want the more realistic DAZ look not the virtual waifu or Fortnite look hence this thread
An easier way from DAZ would be welcome as its not redistributing just streaming video feed so EULA friendly.
(I just want the facecapture myself)
Vlogging is not directly connected to Vtubers - a vlog is just a video log, a vlogger is someone who vlogs. Similar to how blog is a shortened version of weblog (or business weblog to give its original full name).
I have been watching Younah, which is Codemiko. I was watching her when she was doing streams where she was working on her Mikoverse a couple years ago. It was quite amazing to see her develope this world from the start. She actually does this all in what is called Blueprint in UE4. When she first introduced CodeMiko. Younah meant to be just anomymous. Yet people kept calling her a overeight white dude in his 40's. And she also missed being herself on stream. So she decided to reveal her human self. She calls herself the Technition. I'm so happy she has grown into a succesful Vtuber. She also is going to be doing more with G4TV. Not sure if any remember that channel on cable.
Also she uses a lot of Daz clothing in her wardrobe for Miko.
By the time we figure out what any of this is - it'll be gone.
I became aware of her shortly after CodeMiko just started gaining traction a year or so ago. She was featured on a few websites, I can't remember which ones. She was bound to get attention since nobody is doing what she is doing. I think anybody who tunes in will realize this is stuff that has never been done before. But being able to keep people watching and interested is due to her ability to entertain.
I thought she made the clothes, too. I didn't recognize them. That's pretty interesting. Actually...if I were Daz I would be contacting this girl for some kind of promotion deal. Because of the nature of what she does, she is the perfect person to pitch Daz Studio and its assets. And if she was willing (which I don't know if she would be willing), a CodeMiko Genesis character would probably sell pretty well. But even more important than the raw sales numbers this would potentially draw in a whole bunch of new customers to the Daz store. She has a lot of rabid fans who might check out Daz just to support her. Daz could do all kinds of stuff with this, offering bundles that have the outfits she uses, and some other props, like that flaming sword, or her desk set.
So like, if Daz is reading this...I'd be checking on this ASAP.
That would be a HUGE mistake if she did. People would do things to her virtual persona. Horrifying things. This is different from a normal Daz character because 1) CodeMiko is her virtual persona and online brand, not just some pretty she character made. 2) And her persona/brand is famous, which makes selling it even riskier.
To be clear, I'm not some prude complaining about Daz users making erotic art where the subjects are willing, consensual participants enjoying fun sexy times, I'm talking about the other stuff. Really messed up stuff. And if you don't know what kinds of things I'm talking about, consider yourself lucky. Though I wouldn't blame her if she doesn't want to see her online persona used for vanilla Rule 34 stuff either.
I think that is where DAZ could shine as people would dial up their own chosen personas like they do for art just also have the ability to stream with it as an avatar too!
it just needs an interface, they already have Filament that could easily pull off real-time with hats, hoods, nonrealistic hairs even on my original crappy intel graphics PC
Many hide behind their OCs they create with DAZ already as renders.
The live2D Cubism ones are increadibly popular I am seeing them used by my favourite YouTube Reddit story readers like Mark Narrations for their livestreams too.
Wendy, take a look at f-Clone 1.12 if you can find it these days. Works on Windows with any standard webcam and saves out a PZ2 file targetted at G3 in DAZ. You then just drop this output file onto a G3 (ideally) or G8 (less good) head and press play. It can also push out a live data-stream via a websocket, and there are cheap plugins for opening a websocket for Unity. No good for lip sync though, as like most sub $1,000 solutions it very often skips and fails to catch the subtle movements. For better quality than f-Clone you'd want the old Zign Track 2 and a face full of dotty markers. That has been around forever and offers both Poser and DAZ face mocap output from any good webcam for $99.
actually PoseRecorder is not too bad on G8, I have been testing it on various videos as well as captures of myself
What is the most interesting thing that CodeMiko wants to do is, Create a Mikoverse. Where she will help other people who want to be Vtubers. She wants to help them with the equipment and creation of their characters and bring them into her own world. It's quite an ambitious project. The biggest cost of course is a good computer and also the motion capture system. She is using the hugely exspensive Xsense. Though there is another company that is coming out with a system that will be under 1K usd. Where as the Xsense is upwards pass 15k usd and it's also a membership you have to pay for. So the 1k system will be awesome.
a Poserecorder capture, I keep losing audio on these videos off the Internet Archives in Hitfilm Express.
All seemed OK editing but after rendering, meh silent!
I could not be bothered redoing it as the work itself (a poem) might not be creative commons
I still would like to learn Live2D. I'm sure you could map out a Genesis character render for Live 2D purposes.
It's just that Live2D is a subscription, whereas things like Spine (also doing 2d deformation with physics) is a one-time payment... or FOSS, like Dragonbones.
he is always brilliant in his use of 3D content and mocap
So guys , What or which low budget option for facial or lips synchronize if using DAZ figures ?
BTW I`m not go into Realistic style,more like Toon or Anime . So what kind workflow you guys think possible for me ?
Keep in 3D until finished or Render each mouth/lips movements and using 2D program like Character Animation or Adobe Animate ?
Thanks
using the lipsync in the 32bit for free has to be the most budget option by far.
At 4:42 minutes in... that's Young Minto's outfit.
She uses many Daz products. She uses that sexy Nun outfit and a new one. Can't remember whats its called. Its Purple tight scitfi outfit with visor glasses.
Vtubing has been around for a few years and it's not going anywhere, it's way too popular. It's not voice actors trying to make money on the side, though they could if they wanted to. Many people don't want to show their real face while streaming or uploading video's.
Nux Taku has been around on youtube since 2014. He has always used an image to represent himself. It has upgraded over time, though has always been used throughout his videos to show emotion or reaction to something. In January he went full 3D vtuber and using it on youtube and twitch.
Overly Sarcastic Productions, a youtube channel that's been around since 2011 I have been following for a few years to help with my writing. They have never shown their faces and relied on hand drawn 2D animations to represent themselves. And there are so many others out there who have been around a while and upgraded from 2D to 3D and from single images or hand drawn animations to full on real time animation.
So to say this is a fad that will disappear is so not correct, it is in fact growing. The majority of vtubers use anime and games as inspiration for their avatars. There is a very small handful that want to use realistic looking avatars, at this time.
I have been very interested in creating a 3D avatar, as I do not want to show my real face in video's or streaming, been scouring all the tutorials and what programs are needed, what tech is needed. It's constantly changing.