Iray Intermittently Stops Utilizing Video Card(s)

Gator_2236745

Happens too often where Iray stops utilizing my video cards.

Render Settings - Advanced, I have both cards checked, CPU unchecked.  OptiX Prime Acceleration checked.  Interactive devices same (except OptiX isn't an option). 

When you start a new render, it just appears to be CPU only.  I'll keep an eye on it with nVidia inspector, easiest to tell (especially when only 1 card craps out).  Closing DS and opening again clears it.

Richard Haseltine

Often that means the previous scene rendered exceeded the memory on the GPU. Sometimes it is necessary to restart Windows itself to get out of that. Checking the log (Help>Troubleshooting>View log) should elt you check that is you scroll back through the render messages.

namffuak

I've got an open trouble ticket - if you use Posix Acceleration Iray will occasionally have a memory allocation issue. Once that occurs it becomes repeatable and the quick fix is to disable the Posix Accerlation.

Richard Haseltine

OptiX Prime?

Gator_2236745

namffuak said:

I've got an open trouble ticket - if you use Posix Acceleration Iray will occasionally have a memory allocation issue. Once that occurs it becomes repeatable and the quick fix is to disable the Posix Accerlation.

Richard Haseltine said:

OptiX Prime?

Hmm, next time it happens I will have to look at the logs & try disabling OptiX Prime.

DrNewcenstein

I get this as well. Someone made a Daz Script that purges memory (Content Library>Scripts>Utilities: Purge Memory) that appears to work failry well, but I'm not sure if that is supposed to be clearing system RAM or card VRAM, or both, and I have no idea where it came from.

It's my undertanding the issue also depends on how much VRAM your card has. However, I've got one scene using The Reading Room (default textures) with the included lamps, wall, and ceiling light fixtures set to provide the scene lighting, 2 chairs, and 4 non-HD G2 figures, a 12GB Titan Z running externally and an internal 6GB GTX 980,  and even without the CPU checked for rendering or interactive, the CPU spikes to 100%, and hovers around 60%.
VRAM usage for each card is only in the 2.5-3GB range, even though the GPU Usage meter for them is showing 98% (EVGA Precision X).

 

Gator_2236745

OK, it happened and I grabbed the log.  It's obviously an issue with clearing the VRAM.  Unable to allocate .08 GB??

 

2016-09-03 08:49:00.342 Iray INFO - module:category(IRAY:RENDER):   1.0   IRAY   rend info : Rendering with 2 device(s):
2016-09-03 08:49:00.342 Iray INFO - module:category(IRAY:RENDER):   1.0   IRAY   rend info :     CUDA device 1 (GeForce GTX TITAN X)
2016-09-03 08:49:00.342 Iray INFO - module:category(IRAY:RENDER):   1.0   IRAY   rend info :     CUDA device 0 (GeForce GTX TITAN X)
2016-09-03 08:49:00.342 Iray INFO - module:category(IRAY:RENDER):   1.0   IRAY   rend info : Rendering...
2016-09-03 08:52:14.530 WARNING: dzneuraymgr.cpp(261): Iray ERROR - module:category(IRAY:RENDER):   1.8   IRAY   rend error: Unable to allocate 81375004 bytes from 63219302 bytes of available device memory
2016-09-03 08:52:14.530 WARNING: dzneuraymgr.cpp(261): Iray ERROR - module:category(IRAY:RENDER):   1.2   IRAY   rend error: CUDA device 1 (GeForce GTX TITAN X): Scene setup failed
2016-09-03 08:52:14.530 WARNING: dzneuraymgr.cpp(261): Iray ERROR - module:category(IRAY:RENDER):   1.2   IRAY   rend error: CUDA device 1 (GeForce GTX TITAN X): Device failed while rendering
2016-09-03 08:52:14.592 WARNING: dzneuraymgr.cpp(261): Iray ERROR - module:category(IRAY:RENDER):   1.3   IRAY   rend error: Unable to allocate 4194304 bytes from 1694105 bytes of available device memory
2016-09-03 08:52:14.592 WARNING: dzneuraymgr.cpp(261): Iray ERROR - module:category(IRAY:RENDER):   1.4   IRAY   rend error: CUDA device 0 (GeForce GTX TITAN X): Scene setup failed
2016-09-03 08:52:14.592 WARNING: dzneuraymgr.cpp(261): Iray ERROR - module:category(IRAY:RENDER):   1.4   IRAY   rend error: CUDA device 0 (GeForce GTX TITAN X): Device failed while rendering
2016-09-03 08:52:14.592 WARNING: dzneuraymgr.cpp(261): Iray WARNING - module:category(IRAY:RENDER):   1.4   IRAY   rend warn : All available GPUs failed.
2016-09-03 08:52:14.592 Iray INFO - module:category(IRAY:RENDER):   1.4   IRAY   rend info : Falling back to CPU rendering.
2016-09-03 08:52:14.592 WARNING: dzneuraymgr.cpp(261): Iray ERROR - module:category(IRAY:RENDER):   1.4   IRAY   rend error: All workers failed: aborting render
2016-09-03 08:52:14.592 Iray INFO - module:category(IRAY:RENDER):   1.0   IRAY   rend info : CPU: using 8 cores for rendering

Gator_2236745

namffuak said:

I've got an open trouble ticket - if you use Posix Acceleration Iray will occasionally have a memory allocation issue. Once that occurs it becomes repeatable and the quick fix is to disable the Posix Accerlation.

That did work!!!  It happened, I disabled OptiX Prime, and it's rendering with both GPUs again. 

ETA - After a quick render with OptiX disabled, I enabled it and it still worked.