Plugin Request - Stable Diffusion Materials

Hi,

could DAZ itself or some plugin maker develop some magic to use stable diffusion in the DAZ pipeline?

- create textures/materials based on prompt

- create material that is automatically inpainted by AI post-render

Would be so fun to stack the two solutions.

Could be the greatest productivity boost in 3dcg ever.

 

 

Comments

  • I'm not seeing how a plugin would do those things.  You can certainly use Daz Studio and Stable Diffusion today.  Just setup your SD output folder to where you store Daz textures and then you can configure them in Daz Studio.  Setting up material properties really wouldn't make sense, if you're using SD for creating textures, you would want to send them to Substance to create the other non-diffuse maps anyway (bump, normal, etc.).

    For inpainting, you'd need to mask out what you want inpainted anyway so a plugin wouldn't help there.

  • McGyverMcGyver Posts: 7,066
    edited December 2022

    That would be cool, but until someone does something like that, maybe you'll find this useful...
    There is this AI assisted PBR material generator from the people who make Armor Paint...

     https://armorlab.org/   and  https://armorlab.org/manual.html

    There is also this, but I think it's kinda weak because it doesn't do normal maps or anything but a diffuse texture... and anything remotely useful you have to buy using credits... https://withpoly.com/ 

    There is also a plug-in/ add on for Blender that uses Stable Diffusion to generate textures... 

    Post edited by McGyver on
Sign In or Register to comment.