Daz crashing because of Cuda error.

Recently my Daz has been crashing.  I thought it was because I inistalled some 3rd party characters so I stopped using them thinking that may be the problem.  No good.  The scene has 4 characters in it and nothing complicated going on.  I have taken to manually saving every 10-15 minutes.

I generally have the main viewport in "Texture Shaded" and the aux viewport in "NVidia Iray".  (I've been using this setup for the last 2 years without problems.)

I have a RTX 3090 and 128 GB of RAM.  Using a 500 GB SSD.  Haven't had issues until recently.

I've upgraded all drivers so I'm not sure where else to look.

Here is the crash log:

********************************************************************************************

2023-05-09 10:27:32.842 Iray [INFO] - IRAY:RENDER ::   1.22  IRAY   rend info : CUDA device 0 (NVIDIA GeForce RTX 3090): Allocated 6.249 MiB for frame buffer
2023-05-09 10:27:32.842 Iray [INFO] - IRAY:RENDER ::   1.8   IRAY   rend info : CUDA device 0 (NVIDIA GeForce RTX 3090): Allocated 1.906 GiB of work space (2048k active samples in 0.000s)
2023-05-09 10:27:32.842 Iray [INFO] - IRAY:RENDER ::   1.8   IRAY   rend info : CUDA device 0 (NVIDIA GeForce RTX 3090): Optimizing for cooperative usage (performance could be sacrificed)
2023-05-09 10:27:33.066 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [ERROR] - IRAY:RENDER ::   1.22  IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): Tail kernel failed after 0.200s
2023-05-09 10:27:33.068 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [ERROR] - IRAY:RENDER ::   1.22  IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): an illegal memory access was encountered (while launching CUDA renderer in <internal>:719)
2023-05-09 10:27:33.070 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [ERROR] - IRAY:RENDER ::   1.22  IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): Failed to launch renderer
2023-05-09 10:27:33.070 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [ERROR] - IRAY:RENDER ::   1.8   IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): Device failed while rendering
2023-05-09 10:27:33.070 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [WARNING] - IRAY:RENDER ::   1.8   IRAY   rend warn : CUDA device 0 (NVIDIA GeForce RTX 3090) is no longer available for rendering.
2023-05-09 10:27:33.073 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [WARNING] - IRAY:RENDER ::   1.8   IRAY   rend warn : All available GPUs failed.
2023-05-09 10:27:33.073 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [WARNING] - IRAY:RENDER ::   1.8   IRAY   rend warn : No devices activated. Enabling CPU fallback.
2023-05-09 10:27:33.074 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [ERROR] - IRAY:RENDER ::   1.8   IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): [Guidance sync] Failed slave device (remaining 0, done 0).
2023-05-09 10:27:33.075 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [WARNING] - IRAY:RENDER ::   1.8   IRAY   rend warn : Re-rendering iteration because of device failure
2023-05-09 10:27:33.075 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [ERROR] - IRAY:RENDER ::   1.8   IRAY   rend error: All workers failed: aborting render
2023-05-09 10:27:33.075 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [ERROR] - IRAY:RENDER ::   1.8   IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): an illegal memory access was encountered (while de-allocating memory)
2023-05-09 10:27:33.076 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [ERROR] - IRAY:RENDER ::   1.8   IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): an illegal memory access was encountered (while de-allocating memory)
2023-05-09 10:27:33.076 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [ERROR] - IRAY:RENDER ::   1.8   IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): an illegal memory access was encountered (while de-allocating memory)
2023-05-09 10:27:33.077 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [ERROR] - IRAY:RENDER ::   1.8   IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): an illegal memory access was encountered (while de-allocating memory)
2023-05-09 10:27:33.077 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [ERROR] - IRAY:RENDER ::   1.8   IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): an illegal memory access was encountered (while de-allocating memory)
2023-05-09 10:27:33.079 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [ERROR] - IRAY:RENDER ::   1.8   IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): an illegal memory access was encountered (while de-allocating memory)
2023-05-09 10:27:33.079 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [ERROR] - IRAY:RENDER ::   1.8   IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): an illegal memory access was encountered (while de-allocating memory)
2023-05-09 10:27:33.080 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [ERROR] - IRAY:RENDER ::   1.8   IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): an illegal memory access was encountered (while de-allocating memory)
2023-05-09 10:27:33.080 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [ERROR] - IRAY:RENDER ::   1.8   IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): an illegal memory access was encountered (while de-allocating memory)
2023-05-09 10:27:33.081 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [ERROR] - IRAY:RENDER ::   1.0   IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): an illegal memory access was encountered (while de-allocating memory)
2023-05-09 10:27:33.081 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [ERROR] - IRAY:RENDER ::   1.0   IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): an illegal memory access was encountered (while de-allocating memory)
2023-05-09 10:27:33.083 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [ERROR] - IRAY:RENDER ::   1.0   IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): an illegal memory access was encountered (while de-allocating memory)
2023-05-09 10:27:33.083 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [ERROR] - IRAY:RENDER ::   1.0   IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): an illegal memory access was encountered (while de-allocating memory)
2023-05-09 10:27:33.084 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [ERROR] - IRAY:RENDER ::   1.0   IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): an illegal memory access was encountered (while de-allocating memory)
2023-05-09 10:27:33.084 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [ERROR] - IRAY:RENDER ::   1.0   IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): an illegal memory access was encountered (while de-allocating memory)
2023-05-09 10:27:33.085 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [ERROR] - IRAY:RENDER ::   1.0   IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): an illegal memory access was encountered (while de-allocating memory)

*****************************************************************************************

Can anyone help with this?

Thank you.

Comments

  • crosswindcrosswind Posts: 6,986
    edited May 2023

    Suggestions as below:

    1. Use GPU-Z to oberserve the status of your 3090 card, especially Memory Used and temperature
    2. Install a Public Build of Ds to test the same scene
    3. Check if the card is stably plugged in PCie socket, and PSU and power supply cables as well

    Post edited by crosswind on
  • Thank you for pointing me at the utility.  I'm going to give this a shot.

Sign In or Register to comment.