The General Release and the Public Build are *identical* in every way except for whatever way you have them configured; they don't share application settings/data.
The General Release and the Public Build are *identical* in every way except for whatever way you have them configured; they don't share application settings/data.
I have some items that reference other items that now fail because they cannot read content that is now encrypted.
Load times have gotten significantly longer since daz connect was implemented.
If encyption stopped a validated copy of DS from loading content it would be unusable. Content that isn't encrypted really isn't _(it is, however, compressed) unless it's ex-encrypted stuf that was not reinstalled. If you are having failures to load then it some other issue.
I wonder if somethign is interfering with the CMS - that might account both for slow loading and for missing file errors that aren't justified. The obvious first question is what security software do you use?
I've not heard of Windows Defender causing issues, though if it was timing related that might be visible only for people with a lot of content installed (I have a lot, but not a lot installed via CMS-aware modes). I'm not sure what more you could try to narrow down the cause - other, perhaps, than to discounnect from the web, turn off Windows Defender, and see if speed improves.
I will try that and let you know what the results are.
Is there general documentation to optimize all aspects of Daz? I am pushing the envelop in many ways here, bought much better/faster equipment etc. So I am open to a lot of experimentation.
It's a problem with all programs, they would much rather load/save a couple of large files rather than thousands of little files, as they can deal with the large files in a fraction of the time it takes to deal with all of the small files.
With the Genesis series of figures it's the Morphs folder that's the killer, the more morph packs and characters you have the worse it gets.
I have a gazzilion number of morphs for G2 (and G1 also) and I never get any problems loading stuff, worst case is 10-15 seconds for laoding a scene, so it's not some general problem just because you have lots of morphs or something like that, though I only use DIM/manual installation for content.
Only morphs that are actually used are loaded, the rest is not loaded so the number of files have little impact on performance for that, it can of course cause some overhead for the Smart content and things like that that must find all the names for the different morphs and so on.
It's a problem with all programs, they would much rather load/save a couple of large files rather than thousands of little files, as they can deal with the large files in a fraction of the time it takes to deal with all of the small files.
With the Genesis series of figures it's the Morphs folder that's the killer, the more morph packs and characters you have the worse it gets.
This makes sense to me, I will trying to uninstall morphs and see what that does to load time.
No it does not make any sense, only morph's that are actually used (<>0%) are loaded, the other ones are not loaded (the names of the morphs are loaded into the paramater/shaping panes though, that's all).
Check if it's actually is disk access that is causing any slowdown (you said " the CPU, Memory and IO are at low utilization", did IO include disk access ?), is the anti virus scanning the DAZ content directories, if it is exclude that ?
Reading the above it sounds like you have some problem with the content itself, depending how the Postgres implementation is done it is possible that it spend a lot of time there if something is wrong with your setup.
Yes, that I what I am saying, all of the shaping morphs and any of the rotation and translation morphs that are used will be loaded. That is per figure that can grow rather quickly.
Only morphs that are set to a non-zero value have their deltas loaded, all others are just very small reference data that don't add greatly to the figures file size. Renderosity item are not encrypted and cannot be installed by Connect, any problems you are having with them is due to either being installed wrong or packaged wrong. I have a laptop with a slow 5400 rpm harddrive and while don't have as many characters for my figures as some people here I have never had a figure take more than a minute to load (some scenes with multiple figures, props and environment can take as long as five minutes).
It is very likely my use case is not the same as yours.
Simply, I have Genesis 2/3 characters that use (meaning not set at 0) hundreds of shape morphs which would have to be loaded in order to render the character.
Many morphs suchs as expression or symmetrical shape morphs use other underlying morphs.
I can click on "Currently Used" and see more than 100 morphs. One trick I have recently learned is to use GenX to create a single morph of that character. My load times have dropped singnifcantly because I am loading a single morph vs. the 100 or so I previously loaded.
The Renderosity items reference items that are now encrypted in DAZ connect. Since they cannot read those items due to encryption it fails with file cannot be found. In these cases I have to roll back to the DIM version of the item assuming that it exists. Encrypted items and DAZ Connect items cause errors with the Photoshop Bridge as well. Mainly because the Daz Connect Library is protected by DAZ so the exports from the PhotoShop Bridge fail. The Encrypted items will not export at all.
The reason I have these issues is that over the years I have bought 9000+ items which takes up more than 1.65TBs on my hard drive. So if anyone is going to have these issues it would be me. Having said that my issues are a very low percentage of my items and I would say not any higher than the bug rate for other items. It is not that big of a deal honestly but it does happen on occassion.
Connect does not automatically encrypt files, it is the asinine "Cloud" folder and placing every item in its own sub-folder that breaks referencing files. I morph the heck out my characters when used in scenes and they still only take about a minute to load
Connect does not automatically encrypt files, it is the asinine "Cloud" folder and placing every item in its own sub-folder that breaks referencing files. I morph the heck out my characters when used in scenes and they still only take about a minute to load
I never said that Connect encrypts all files. I said those that are cause a problem for me.
Can you give more details about "it is the asinine "Cloud" folder and placing every item in its own sub-folder that breaks referencing files." as I need to figure out a workaround for this.
Considering what my system is like compared to what you describe yours is like, it is obvious to me we are not doing the same things.
Connect does not automatically encrypt files, it is the asinine "Cloud" folder and placing every item in its own sub-folder that breaks referencing files. I morph the heck out my characters when used in scenes and they still only take about a minute to load
For Victoria 4/Michael 4 this si potentially an issue - which is why those are no Connect-ready. For Genesis or later there is no issue with the way the files are split, it has always been possible to have support assets for a figure spread across multiple content directories. Some add-ons with hard-coded relative paths in scripts can be an issue, as they could if moved under a non-Connect install, butt hose will fail on first load and are the exceptions.
The V4/M4 I think is my issue, That makes sense now.
I have been migrating off of those older figures anyway. So now that I know what the issue is, I will use GenX to transfer the shapes and leave them behind.
Connect does not automatically encrypt files, it is the asinine "Cloud" folder and placing every item in its own sub-folder that breaks referencing files. I morph the heck out my characters when used in scenes and they still only take about a minute to load
For Victoria 4/Michael 4 this si potentially an issue - which is why those are no Connect-ready. For Genesis or later there is no issue with the way the files are split, it has always been possible to have support assets for a figure spread across multiple content directories. Some add-ons with hard-coded relative paths in scripts can be an issue, as they could if moved under a non-Connect install, butt hose will fail on first load and are the exceptions.
That was more information for anyone reading later who is a script developer - scripts from the store are geenrally encrypted so there's nothing to be done on our end as users.
Comments
I thought so, too!
- Greg
I suspect it is the Daz Connect content that is encrypted. I am working on a test that can prove that.
, Not all Daz Connect content is encrypted. IF the content is encrypted it will say so on the store page,
I have some items that reference other items that now fail because they cannot read content that is now encrypted.
Load times have gotten significantly longer since daz connect was implemented.
If encyption stopped a validated copy of DS from loading content it would be unusable. Content that isn't encrypted really isn't _(it is, however, compressed) unless it's ex-encrypted stuf that was not reinstalled. If you are having failures to load then it some other issue.
I will randomly get a failure of Renderosity items, it will error out saying file cannot be found.
To resolve it I uninstall and reinstall the encrypted item.
What I am wondering, is when DAZ is taking a long time to load, the CPU, Memory and IO are at low utilization.
Is there some way to have DAZ use more resources on my machine to load faster. I have all of the settings set for speed.
I wonder if somethign is interfering with the CMS - that might account both for slow loading and for missing file errors that aren't justified. The obvious first question is what security software do you use?
Good question, I only use windows defender.
It also may have something to do with having 8,600 items downloaded with 1.3TB of files downloaded.
I have an SSD dedicated for DAZ files with 889GB of files installed.
Also, thanks for the help.
I've not heard of Windows Defender causing issues, though if it was timing related that might be visible only for people with a lot of content installed (I have a lot, but not a lot installed via CMS-aware modes). I'm not sure what more you could try to narrow down the cause - other, perhaps, than to discounnect from the web, turn off Windows Defender, and see if speed improves.
I will try that and let you know what the results are.
Is there general documentation to optimize all aspects of Daz? I am pushing the envelop in many ways here, bought much better/faster equipment etc. So I am open to a lot of experimentation.
I am not the OP but I do not consider this solved.
The long load time for me and others still exists. I was hoping to continue the dialog and explore some solutions together.
Update: I ran a test with the network card and windows defender disabled.
It had negligible impact on the loading time.
However, the IO on the disk drive never went above 10% and the CPU was using only one core during the load. Though during rendering it uses all cores.
Is there a way to have DAZ use all cores as part of the load?
No, only a few things are multi-threaded (and so able to use multiple cores)
OK, so there is very little I can do there.
Is there a guide somewhere that goes over how to optimize Daz?
Nott hat I am aware of
It's a problem with all programs, they would much rather load/save a couple of large files rather than thousands of little files, as they can deal with the large files in a fraction of the time it takes to deal with all of the small files.
With the Genesis series of figures it's the Morphs folder that's the killer, the more morph packs and characters you have the worse it gets.
I have a gazzilion number of morphs for G2 (and G1 also) and I never get any problems loading stuff, worst case is 10-15 seconds for laoding a scene, so it's not some general problem just because you have lots of morphs or something like that, though I only use DIM/manual installation for content.
Only morphs that are actually used are loaded, the rest is not loaded so the number of files have little impact on performance for that, it can of course cause some overhead for the Smart content and things like that that must find all the names for the different morphs and so on.
This makes sense to me, I will trying to uninstall morphs and see what that does to load time.
No it does not make any sense, only morph's that are actually used (<>0%) are loaded, the other ones are not loaded (the names of the morphs are loaded into the paramater/shaping panes though, that's all).
Check if it's actually is disk access that is causing any slowdown (you said " the CPU, Memory and IO are at low utilization", did IO include disk access ?), is the anti virus scanning the DAZ content directories, if it is exclude that ?
Reading the above it sounds like you have some problem with the content itself, depending how the Postgres implementation is done it is possible that it spend a lot of time there if something is wrong with your setup.
Yes, that I what I am saying, all of the shaping morphs and any of the rotation and translation morphs that are used will be loaded. That is per figure that can grow rather quickly.
Only morphs that are set to a non-zero value have their deltas loaded, all others are just very small reference data that don't add greatly to the figures file size. Renderosity item are not encrypted and cannot be installed by Connect, any problems you are having with them is due to either being installed wrong or packaged wrong. I have a laptop with a slow 5400 rpm harddrive and while don't have as many characters for my figures as some people here I have never had a figure take more than a minute to load (some scenes with multiple figures, props and environment can take as long as five minutes).
It is very likely my use case is not the same as yours.
Simply, I have Genesis 2/3 characters that use (meaning not set at 0) hundreds of shape morphs which would have to be loaded in order to render the character.
Many morphs suchs as expression or symmetrical shape morphs use other underlying morphs.
I can click on "Currently Used" and see more than 100 morphs. One trick I have recently learned is to use GenX to create a single morph of that character. My load times have dropped singnifcantly because I am loading a single morph vs. the 100 or so I previously loaded.
The Renderosity items reference items that are now encrypted in DAZ connect. Since they cannot read those items due to encryption it fails with file cannot be found. In these cases I have to roll back to the DIM version of the item assuming that it exists. Encrypted items and DAZ Connect items cause errors with the Photoshop Bridge as well. Mainly because the Daz Connect Library is protected by DAZ so the exports from the PhotoShop Bridge fail. The Encrypted items will not export at all.
The reason I have these issues is that over the years I have bought 9000+ items which takes up more than 1.65TBs on my hard drive. So if anyone is going to have these issues it would be me. Having said that my issues are a very low percentage of my items and I would say not any higher than the bug rate for other items. It is not that big of a deal honestly but it does happen on occassion.
Connect does not automatically encrypt files, it is the asinine "Cloud" folder and placing every item in its own sub-folder that breaks referencing files. I morph the heck out my characters when used in scenes and they still only take about a minute to load
I never said that Connect encrypts all files. I said those that are cause a problem for me.
Can you give more details about "it is the asinine "Cloud" folder and placing every item in its own sub-folder that breaks referencing files." as I need to figure out a workaround for this.
Considering what my system is like compared to what you describe yours is like, it is obvious to me we are not doing the same things.
For Victoria 4/Michael 4 this si potentially an issue - which is why those are no Connect-ready. For Genesis or later there is no issue with the way the files are split, it has always been possible to have support assets for a figure spread across multiple content directories. Some add-ons with hard-coded relative paths in scripts can be an issue, as they could if moved under a non-Connect install, butt hose will fail on first load and are the exceptions.
The V4/M4 I think is my issue, That makes sense now.
I have been migrating off of those older figures anyway. So now that I know what the issue is, I will use GenX to transfer the shapes and leave them behind.
Rob has a sample script showing how scripts can get an absolute location from a relative path even if isntalled via Connect http://docs.daz3d.com/doku.php/public/software/dazstudio/4/referenceguide/scripting/api_reference/samples/file_io/file_find/start
I will take a look.
Thanks
That was more information for anyone reading later who is a script developer - scripts from the store are geenrally encrypted so there's nothing to be done on our end as users.
I see.
So what performance issues are you aware of when loading off of libraries on DropBox or OneDrive?
Obivously they will get in the way but I am wondering to what extend.