Plugin Request - Stable Diffusion Materials
![colcurve](https://secure.gravatar.com/avatar/a5dd346115b701521124a19978f6ed20?&r=pg&s=100&d=https%3A%2F%2Fvanillicon.com%2Fa5dd346115b701521124a19978f6ed20_100.png)
in The Commons
Hi,
could DAZ itself or some plugin maker develop some magic to use stable diffusion in the DAZ pipeline?
- create textures/materials based on prompt
- create material that is automatically inpainted by AI post-render
Would be so fun to stack the two solutions.
Could be the greatest productivity boost in 3dcg ever.
Comments
I'm not seeing how a plugin would do those things. You can certainly use Daz Studio and Stable Diffusion today. Just setup your SD output folder to where you store Daz textures and then you can configure them in Daz Studio. Setting up material properties really wouldn't make sense, if you're using SD for creating textures, you would want to send them to Substance to create the other non-diffuse maps anyway (bump, normal, etc.).
For inpainting, you'd need to mask out what you want inpainted anyway so a plugin wouldn't help there.
That would be cool, but until someone does something like that, maybe you'll find this useful...
There is this AI assisted PBR material generator from the people who make Armor Paint...
https://armorlab.org/ and https://armorlab.org/manual.html
There is also this, but I think it's kinda weak because it doesn't do normal maps or anything but a diffuse texture... and anything remotely useful you have to buy using credits... https://withpoly.com/
There is also a plug-in/ add on for Blender that uses Stable Diffusion to generate textures...