Loading...
> >

Iray rendering switching to cpu mid render all of a sudden... (Solved)

BoomaticBoomatic Posts: 2
edited November 2019 in Technical Help (nuts n bolts)

Hi all,
This is my first post on the forum so I do hope I'm posting it in the correct location.

Okay, so this program only started happening today and I have no idea what's going on or what's changed...

So yesterday I was rendering perfectly fine with no issues "rendered 17 images in total" it was getting late so I saved my scene, closed Daz and put my system into sleep mode.
Today I woke the system up, booted up Daz and loaded the very same scene.
The last image I rendered yesterday had the wrong DOF settings so all I did was correct it and set the render off again, this is when the issue started.

Around 4 minutes into the render, I noticed that it had switched from rendering with the GPU to the CPU "this had never happened to me before"
I stopped the render, closed the image and started it off again only for it to do the same thing.

I closed the program, opened it again and tried again, you guessed it, the same result.
I did all the usual checks (Render Settings -> Advanced Both GPU's were checked + OptiX) (CPU was unchecked)

I decided to start a new scene and load a simple Gen 3 starter model into it, I hit render and again... the same issue...
This was very confusing as from what I know it usually only switches to the CPU if there isn't enough VRAM for the scene.

Here are my System Specs, I definitly have enough power to render a simple Gen 3 model only.

CPU : Intel I7-7800X @ 3.50ghz
RAM : 64GB (Idles around 6GB used)
HDD : 2x 2TB (20% full)
GPU 1 : NVIDIA GeForce RTX 2080 TI (11gb dedicated) (Latest Driver : 26.21.14.4112)
GPU 2 : NVIDIA GeForce RTX 2080 TI (11gb dedicated) (Latest Driver : 26.21.14.4112)
Daz : 4.12

By this point, I had no idea why it was doing this, I did the following all the while loading up Daz3d after each point and ending with the same result.

  1. Rebooting the System.
  2. Rolling back the NVIDIA drivers.
  3. Using DDU to totally remove the drivers and installing them again.
  4. Remove Daz and then installing it again.
  5. Trying the Daz 4.12 Beta version
  6. Rolling back to Daz 4.11
  7. Disabling my AV just in case that was somehow affecting it.
  8. Checking Temps, they're all within the normal range "not overheating".
  9. Removing the GPUs from the system and then putting them back in.
  10. Booting up some FX demanding games, they all run fine, nothing wrong with the cards.

After all of this, I was still getting the same result, after a couple of minutes of it render with the GPU it would all of a sudden switch to the CPU.
Sometimes the program would simply crash without showing an error window...

So here I am, begging for some help as this is driving me crazy!
Nothing changed overnight (In terms of drivers/window updates etc), this just started happening with no reason that I'm aware of.

This is what is being saved in the log file.

2019-11-10 20:57:46.149 Iray [INFO] - IRAY:RENDER ::   1.0   IRAY   rend info : Rendering with 2 device(s):2019-11-10 20:57:46.149 Iray [INFO] - IRAY:RENDER ::   1.0   IRAY   rend info : 	CUDA device 1 (GeForce RTX 2080 Ti)2019-11-10 20:57:46.149 Iray [INFO] - IRAY:RENDER ::   1.0   IRAY   rend info : 	CUDA device 0 (GeForce RTX 2080 Ti)2019-11-10 20:57:46.149 Iray [INFO] - IRAY:RENDER ::   1.0   IRAY   rend info : Rendering...2019-11-10 20:57:46.150 Iray [VERBOSE] - IRAY:RENDER ::   1.4   IRAY   rend progr: CUDA device 1 (GeForce RTX 2080 Ti): Processing scene...2019-11-10 20:57:46.151 Iray [VERBOSE] - IRAY:RENDER ::   1.11  IRAY   rend progr: CUDA device 0 (GeForce RTX 2080 Ti): Processing scene...2019-11-10 20:57:46.194 Iray [VERBOSE] - IRAY:RENDER ::   1.2   IRAY   rend stat : Geometry memory consumption: 41.8675 MiB (device 1), 0 B (host)2019-11-10 20:57:46.194 Iray [INFO] - IRAY:RENDER ::   1.2   IRAY   rend info : Using OptiX version 6.1.22019-11-10 20:57:46.197 Iray [VERBOSE] - IRAY:RENDER ::   1.12  IRAY   rend stat : Geometry memory consumption: 41.8675 MiB (device 0), 0 B (host)2019-11-10 20:57:46.208 Iray [INFO] - IRAY:RENDER ::   1.2   IRAY   rend info : Initializing OptiX for CUDA device 12019-11-10 20:57:46.208 Iray [INFO] - IRAY:RENDER ::   1.12  IRAY   rend info : Initializing OptiX for CUDA device 02019-11-10 20:57:53.288 Iray [INFO] - IRAY:RENDER ::   1.2   IRAY   rend info : Importing lights for motion time 02019-11-10 20:57:53.290 Iray [VERBOSE] - IRAY:RENDER ::   1.2   IRAY   rend stat : Texture memory consumption: 943.796 MiB for 89 bitmaps (device 1)2019-11-10 20:57:53.290 Iray [INFO] - IRAY:RENDER ::   1.2   IRAY   rend info : Initializing light hierarchy.2019-11-10 20:57:53.292 Iray [INFO] - IRAY:RENDER ::   1.2   IRAY   rend info : Light hierarchy initialization took 0.002s2019-11-10 20:57:53.293 Iray [VERBOSE] - IRAY:RENDER ::   1.12  IRAY   rend stat : Texture memory consumption: 943.796 MiB for 89 bitmaps (device 0)2019-11-10 20:57:53.293 Iray [VERBOSE] - IRAY:RENDER ::   1.12  IRAY   rend stat : Lights memory consumption: 6.87891 KiB (device 0)2019-11-10 20:57:53.294 Iray [VERBOSE] - IRAY:RENDER ::   1.2   IRAY   rend stat : Lights memory consumption: 6.87891 KiB (device 1)2019-11-10 20:57:53.314 Iray [VERBOSE] - IRAY:RENDER ::   1.2   IRAY   rend stat : Material measurement memory consumption: 0 B (GPU)2019-11-10 20:57:53.425 Iray [VERBOSE] - IRAY:RENDER ::   1.2   IRAY   rend stat : Materials memory consumption: 358.648 KiB (GPU)2019-11-10 20:57:53.427 Iray [VERBOSE] - IRAY:RENDER ::   1.2   IRAY   rend stat : PTX code (127 KiB) for SM 7.5 generated in 0.111s2019-11-10 20:57:53.430 Iray [VERBOSE] - IRAY:RENDER ::   1.12  IRAY   rend stat : PTX code (127 KiB) for SM 7.5 generated in 2.2e-06s2019-11-10 20:57:53.589 Iray [INFO] - IRAY:RENDER ::   1.12  IRAY   rend info : JIT-linking wavefront kernel in 0.070s2019-11-10 20:57:53.606 Iray [INFO] - IRAY:RENDER ::   1.2   IRAY   rend info : JIT-linking wavefront kernel in 0.092s2019-11-10 20:57:53.606 Iray [INFO] - IRAY:RENDER ::   1.12  IRAY   rend info : JIT-linking mega kernel in 0.017s2019-11-10 20:57:53.606 Iray [INFO] - IRAY:RENDER ::   1.11  IRAY   rend info : CUDA device 0 (GeForce RTX 2080 Ti): Scene processed in 7.456s2019-11-10 20:57:53.607 Iray [INFO] - IRAY:RENDER ::   1.2   IRAY   rend info : JIT-linking mega kernel in 0.002s2019-11-10 20:57:53.607 Iray [INFO] - IRAY:RENDER ::   1.4   IRAY   rend info : CUDA device 1 (GeForce RTX 2080 Ti): Scene processed in 7.458s2019-11-10 20:57:53.610 Iray [INFO] - IRAY:RENDER ::   1.11  IRAY   rend info : CUDA device 0 (GeForce RTX 2080 Ti): Allocated 48.2702 MiB for frame buffer2019-11-10 20:57:53.613 Iray [INFO] - IRAY:RENDER ::   1.4   IRAY   rend info : CUDA device 1 (GeForce RTX 2080 Ti): Allocated 48.2702 MiB for frame buffer2019-11-10 20:57:53.668 Iray [INFO] - IRAY:RENDER ::   1.11  IRAY   rend info : CUDA device 0 (GeForce RTX 2080 Ti): Allocated 1.6875 GiB of work space (2048k active samples in 0.057s)2019-11-10 20:57:53.668 Iray [INFO] - IRAY:RENDER ::   1.11  IRAY   rend info : CUDA device 0 (GeForce RTX 2080 Ti): Used for display, optimizing for interactive usage (performance could be sacrificed)2019-11-10 20:57:53.678 Iray [INFO] - IRAY:RENDER ::   1.4   IRAY   rend info : CUDA device 1 (GeForce RTX 2080 Ti): Allocated 1.6875 GiB of work space (2048k active samples in 0.065s)2019-11-10 20:57:53.678 Iray [INFO] - IRAY:RENDER ::   1.4   IRAY   rend info : CUDA device 1 (GeForce RTX 2080 Ti): Used for display, optimizing for interactive usage (performance could be sacrificed)2019-11-10 20:57:54.046 Iray [INFO] - IRAY:RENDER ::   1.11  IRAY   rend info : Allocating 1-layer frame buffer2019-11-10 20:57:54.128 Iray [INFO] - IRAY:RENDER ::   1.0   IRAY   rend info : Received update to 00001 iterations after 7.978s.2019-11-10 20:57:54.158 Iray [INFO] - IRAY:RENDER ::   1.0   IRAY   rend info : Received update to 00002 iterations after 8.009s.2019-11-10 20:57:54.385 Iray [INFO] - IRAY:RENDER ::   1.0   IRAY   rend info : Received update to 00003 iterations after 8.235s.2019-11-10 20:57:54.452 Iray [INFO] - IRAY:RENDER ::   1.0   IRAY   rend info : Received update to 00004 iterations after 8.303s.2019-11-10 20:57:54.952 Iray [INFO] - IRAY:RENDER ::   1.0   IRAY   rend info : Received update to 00006 iterations after 8.803s.2019-11-10 20:57:55.055 Iray [INFO] - IRAY:RENDER ::   1.0   IRAY   rend info : Received update to 00008 iterations after 8.905s.2019-11-10 20:57:56.080 Iray [INFO] - IRAY:RENDER ::   1.0   IRAY   rend info : Received update to 00012 iterations after 9.931s.2019-11-10 20:57:56.228 Iray [INFO] - IRAY:RENDER ::   1.0   IRAY   rend info : Received update to 00016 iterations after 10.079s.2019-11-10 20:57:58.310 Iray [INFO] - IRAY:RENDER ::   1.0   IRAY   rend info : Received update to 00024 iterations after 12.161s.2019-11-10 20:57:58.455 Iray [INFO] - IRAY:RENDER ::   1.0   IRAY   rend info : Received update to 00032 iterations after 12.306s.2019-11-10 20:58:01.084 WARNING: ..\..\..\..\..\src\sdksource\cloud\dzcloudtasknotifier.cpp(178): recv failed errno=100542019-11-10 20:58:02.763 Iray [INFO] - POST:RENDER ::   1.0   POST   rend info : using cuda device 1, "GeForce RTX 2080 Ti" (7.5), buffers: fp16, cuDNN v7500, rt v100102019-11-10 20:58:13.864 Iray [INFO] - POST:RENDER ::   1.0   POST   rend info : layers created for resolution 1481 1068, inp 6, outp 3, cuDNN memory 2.5 MB, total 285.3 MB2019-11-10 20:58:14.425 Iray [INFO] - IRAY:RENDER ::   1.0   IRAY   rend info : Received update to 00048 iterations after 28.276s.2019-11-10 20:58:14.447 Iray [INFO] - IRAY:RENDER ::   1.0   IRAY   rend info : Received update to 00064 iterations after 28.298s.2019-11-10 20:58:17.127 Iray [INFO] - IRAY:RENDER ::   1.0   IRAY   rend info : Received update to 00116 iterations after 30.978s.2019-11-10 20:58:17.691 Iray [INFO] - IRAY:RENDER ::   1.0   IRAY   rend info : Received update to 00164 iterations after 31.542s.2019-11-10 20:58:22.424 Iray [INFO] - IRAY:RENDER ::   1.0   IRAY   rend info : Received update to 00182 iterations after 36.275s.2019-11-10 20:58:22.521 Iray [INFO] - IRAY:RENDER ::   1.0   IRAY   rend info : Received update to 00199 iterations after 36.372s.2019-11-10 20:58:27.155 Iray [INFO] - IRAY:RENDER ::   1.0   IRAY   rend info : Received update to 00217 iterations after 41.005s.2019-11-10 20:58:27.368 Iray [INFO] - IRAY:RENDER ::   1.0   IRAY   rend info : Received update to 00234 iterations after 41.219s.2019-11-10 20:58:32.825 Iray [INFO] - IRAY:RENDER ::   1.0   IRAY   rend info : Received update to 00252 iterations after 46.675s.2019-11-10 20:58:35.541 WARNING: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(305): Iray [ERROR] - IRAY:RENDER ::   1.3   IRAY   rend error: CUDA device 1 (GeForce RTX 2080 Ti): an illegal memory access was encountered (while launching CUDA renderer)2019-11-10 20:58:35.541 WARNING: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(305): Iray [ERROR] - IRAY:RENDER ::   1.3   IRAY   rend error: CUDA device 1 (GeForce RTX 2080 Ti): Failed to launch renderer2019-11-10 20:58:35.541 WARNING: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(305): Iray [ERROR] - IRAY:RENDER ::   1.4   IRAY   rend error: CUDA device 1 (GeForce RTX 2080 Ti): Device failed while rendering2019-11-10 20:58:35.541 WARNING: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(305): Iray [ERROR] - IRAY:RENDER ::   1.4   IRAY   rend error: CUDA device 1 (GeForce RTX 2080 Ti): an illegal memory access was encountered (while initializing memory buffer)2019-11-10 20:58:35.541 WARNING: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(305): Iray [ERROR] - IRAY:RENDER ::   1.4   IRAY   rend error: CUDA device 1 (GeForce RTX 2080 Ti): an illegal memory access was encountered (while de-allocating memory)2019-11-10 20:58:35.542 WARNING: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(305): Iray [ERROR] - IRAY:RENDER ::   1.4   IRAY   rend error: CUDA device 1 (GeForce RTX 2080 Ti): an illegal memory access was encountered (while de-allocating memory)2019-11-10 20:58:35.542 WARNING: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(305): Iray [ERROR] - IRAY:RENDER ::   1.4   IRAY   rend error: CUDA device 1 (GeForce RTX 2080 Ti): an illegal memory access was encountered (while de-allocating memory)2019-11-10 20:58:35.542 WARNING: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(305): Iray [ERROR] - IRAY:RENDER ::   1.4   IRAY   rend error: CUDA device 1 (GeForce RTX 2080 Ti): an illegal memory access was encountered (while de-allocating memory)2019-11-10 20:58:35.543 WARNING: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(305): Iray [ERROR] - IRAY:RENDER ::   1.4   IRAY   rend error: CUDA device 1 (GeForce RTX 2080 Ti): an illegal memory access was encountered (while de-allocating memory)2019-11-10 20:58:35.543 WARNING: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(305): Iray [ERROR] - IRAY:RENDER ::   1.4   IRAY   rend error: CUDA device 1 (GeForce RTX 2080 Ti): an illegal memory access was encountered (while de-allocating memory)2019-11-10 20:58:35.543 WARNING: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(305): Iray [ERROR] - IRAY:RENDER ::   1.4   IRAY   rend error: CUDA device 1 (GeForce RTX 2080 Ti): an illegal memory access was encountered (while de-allocating memory)2019-11-10 20:58:35.543 WARNING: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(305): Iray [ERROR] - IRAY:RENDER ::   1.4   IRAY   rend error: CUDA device 1 (GeForce RTX 2080 Ti): an illegal memory access was encountered (while de-allocating memory)2019-11-10 20:58:35.543 WARNING: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(305): Iray [ERROR] - IRAY:RENDER ::   1.4   IRAY   rend error: CUDA device 1 (GeForce RTX 2080 Ti): an illegal memory access was encountered (while de-allocating memory)2019-11-10 20:58:35.544 WARNING: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(305): Iray [ERROR] - IRAY:RENDER ::   1.4   IRAY   rend error: CUDA device 1 (GeForce RTX 2080 Ti): an illegal memory access was encountered (while de-allocating memory)2019-11-10 20:58:35.552 WARNING: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(305): Iray [ERROR] - IRAY:RENDER ::   1.7   IRAY   rend error: CUDA device 0 (GeForce RTX 2080 Ti): an illegal memory access was encountered (while launching CUDA renderer)2019-11-10 20:58:35.553 WARNING: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(305): Iray [ERROR] - IRAY:RENDER ::   1.7   IRAY   rend error: CUDA device 0 (GeForce RTX 2080 Ti): Failed to launch renderer2019-11-10 20:58:35.553 WARNING: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(305): Iray [ERROR] - IRAY:RENDER ::   1.11  IRAY   rend error: CUDA device 0 (GeForce RTX 2080 Ti): Device failed while rendering2019-11-10 20:58:35.553 WARNING: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(305): Iray [WARNING] - IRAY:RENDER ::   1.11  IRAY   rend warn : All available GPUs failed.2019-11-10 20:58:35.553 WARNING: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(305): Iray [WARNING] - IRAY:RENDER ::   1.11  IRAY   rend warn : No devices activated. Enabling CPU fallback.2019-11-10 20:58:35.553 WARNING: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(305): Iray [ERROR] - IRAY:RENDER ::   1.11  IRAY   rend error: CUDA device 0 (GeForce RTX 2080 Ti): an illegal memory access was encountered (while initializing memory buffer)2019-11-10 20:58:35.554 WARNING: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(305): Iray [ERROR] - IRAY:RENDER ::   1.11  IRAY   rend error: All workers failed: aborting render2019-11-10 20:58:35.554 WARNING: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(305): Iray [ERROR] - IRAY:RENDER ::   1.11  IRAY   rend error: CUDA device 0 (GeForce RTX 2080 Ti): an illegal memory access was encountered (while de-allocating memory)2019-11-10 20:58:35.554 WARNING: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(305): Iray [ERROR] - IRAY:RENDER ::   1.11  IRAY   rend error: CUDA device 0 (GeForce RTX 2080 Ti): an illegal memory access was encountered (while de-allocating memory)2019-11-10 20:58:35.554 WARNING: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(305): Iray [ERROR] - IRAY:RENDER ::   1.11  IRAY   rend error: CUDA device 0 (GeForce RTX 2080 Ti): an illegal memory access was encountered (while de-allocating memory)2019-11-10 20:58:35.554 WARNING: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(305): Iray [ERROR] - IRAY:RENDER ::   1.11  IRAY   rend error: CUDA device 0 (GeForce RTX 2080 Ti): an illegal memory access was encountered (while de-allocating memory)2019-11-10 20:58:35.555 WARNING: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(305): Iray [ERROR] - IRAY:RENDER ::   1.11  IRAY   rend error: CUDA device 0 (GeForce RTX 2080 Ti): an illegal memory access was encountered (while de-allocating memory)2019-11-10 20:58:35.555 WARNING: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(305): Iray [ERROR] - IRAY:RENDER ::   1.11  IRAY   rend error: CUDA device 0 (GeForce RTX 2080 Ti): an illegal memory access was encountered (while de-allocating memory)2019-11-10 20:58:35.555 WARNING: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(305): Iray [ERROR] - IRAY:RENDER ::   1.11  IRAY   rend error: CUDA device 0 (GeForce RTX 2080 Ti): an illegal memory access was encountered (while de-allocating memory)2019-11-10 20:58:35.555 WARNING: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(305): Iray [ERROR] - IRAY:RENDER ::   1.11  IRAY   rend error: CUDA device 0 (GeForce RTX 2080 Ti): an illegal memory access was encountered (while de-allocating memory)2019-11-10 20:58:35.556 WARNING: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(305): Iray [ERROR] - IRAY:RENDER ::   1.11  IRAY   rend error: CUDA device 0 (GeForce RTX 2080 Ti): an illegal memory access was encountered (while de-allocating memory)2019-11-10 20:58:35.556 WARNING: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(305): Iray [ERROR] - IRAY:RENDER ::   1.11  IRAY   rend error: CUDA device 0 (GeForce RTX 2080 Ti): an illegal memory access was encountered (while de-allocating memory)2019-11-10 20:58:35.556 WARNING: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(305): Iray [ERROR] - IRAY:RENDER ::   1.0   IRAY   rend error: CUDA device 1 (GeForce RTX 2080 Ti): an illegal memory access was encountered (while de-allocating memory)2019-11-10 20:58:35.556 WARNING: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(305): Iray [ERROR] - IRAY:RENDER ::   1.0   IRAY   rend error: CUDA device 1 (GeForce RTX 2080 Ti): an illegal memory access was encountered (while de-allocating memory)2019-11-10 20:58:35.557 WARNING: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(305): Iray [ERROR] - IRAY:RENDER ::   1.0   IRAY   rend error: CUDA device 1 (GeForce RTX 2080 Ti): an illegal memory access was encountered (while de-allocating memory)2019-11-10 20:58:35.557 WARNING: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(305): Iray [ERROR] - IRAY:RENDER ::   1.0   IRAY   rend error: CUDA device 1 (GeForce RTX 2080 Ti): an illegal memory access was encountered (while de-allocating memory)2019-11-10 20:58:35.557 WARNING: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(305): Iray [ERROR] - IRAY:RENDER ::   1.0   IRAY   rend error: CUDA device 0 (GeForce RTX 2080 Ti): an illegal memory access was encountered (while de-allocating memory)2019-11-10 20:58:35.557 WARNING: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(305): Iray [ERROR] - IRAY:RENDER ::   1.0   IRAY   rend error: CUDA device 0 (GeForce RTX 2080 Ti): an illegal memory access was encountered (while de-allocating memory)2019-11-10 20:58:35.557 WARNING: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(305): Iray [ERROR] - IRAY:RENDER ::   1.0   IRAY   rend error: CUDA device 0 (GeForce RTX 2080 Ti): an illegal memory access was encountered (while de-allocating memory)2019-11-10 20:58:35.557 WARNING: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(305): Iray [ERROR] - IRAY:RENDER ::   1.0   IRAY   rend error: CUDA device 0 (GeForce RTX 2080 Ti): an illegal memory access was encountered (while de-allocating memory)2019-11-10 20:58:35.562 Iray [INFO] - IRAY:RENDER ::   1.0   IRAY   rend info : CPU: using 12 cores for rendering2019-11-10 20:58:35.562 Iray [INFO] - IRAY:RENDER ::   1.0   IRAY   rend info : Rendering with 1 device(s):2019-11-10 20:58:35.562 Iray [INFO] - IRAY:RENDER ::   1.0   IRAY   rend info : 	CPU2019-11-10 20:58:35.562 Iray [INFO] - IRAY:RENDER ::   1.0   IRAY   rend info : Rendering...2019-11-10 20:58:35.562 Iray [INFO] - IRAY:RENDER ::   1.11  IRAY   rend info : Using Embree 2.8.02019-11-10 20:58:35.562 Iray [INFO] - IRAY:RENDER ::   1.11  IRAY   rend info : Initializing Embree2019-11-10 20:58:35.563 Iray [VERBOSE] - IRAY:RENDER ::   1.4   IRAY   rend progr: CPU: Processing scene...2019-11-10 20:58:35.816 Iray [INFO] - IRAY:RENDER ::   1.4   IRAY   rend info : CPU: Scene processed in 0.254s2019-11-10 20:58:35.816 Iray [VERBOSE] - IRAY:RENDER ::   1.11  IRAY   rend stat : Native CPU code generated in 0.129s2019-11-10 20:58:35.839 Iray [INFO] - IRAY:RENDER ::   1.4   IRAY   rend info : CPU: Allocated 48.2702 MiB for frame buffer2019-11-10 20:58:38.538 Iray [INFO] - IRAY:RENDER ::   1.4   IRAY   rend info : Allocating 1-layer frame buffer2019-11-10 20:58:38.599 WARNING: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(305): Iray [WARNING] - POST:RENDER ::   1.0   POST   rend warn : renderer iray has no more devices available. Postprocessing falling back to CPU.2019-11-10 20:58:38.600 WARNING: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(305): Iray [WARNING] - POST:RENDER ::   1.0   POST   rend warn : Postprocessing is running on the CPU, but Denoiser is requested. Denoising is not available on CPU.2019-11-10 20:58:38.689 Iray [INFO] - IRAY:RENDER ::   1.0   IRAY   rend info : Received update to 00253 iterations after 52.532s.2019-11-10 20:58:41.328 Iray [INFO] - IRAY:RENDER ::   1.0   IRAY   rend info : Received update to 00254 iterations after 55.171s.2019-11-10 20:58:47.041 Iray [INFO] - IRAY:RENDER ::   1.0   IRAY   rend info : Received update to 00256 iterations after 60.883s.2019-11-10 20:58:52.589 Iray [INFO] - IRAY:RENDER ::   1.0   IRAY   rend info : Received update to 00258 iterations after 66.431s.2019-11-10 20:58:58.061 Iray [INFO] - IRAY:RENDER ::   1.0   IRAY   rend info : Received update to 00260 iterations after 71.904s.2019-11-10 20:59:03.789 Iray [INFO] - IRAY:RENDER ::   1.0   IRAY   rend info : Received update to 00262 iterations after 77.631s.2019-11-10 20:59:09.397 Iray [INFO] - IRAY:RENDER ::   1.0   IRAY   rend info : Received update to 00264 iterations after 83.240s.2019-11-10 20:59:14.812 Iray [INFO] - IRAY:RENDER ::   1.0   IRAY   rend info : Received update to 00266 iterations after 88.654s.2019-11-10 20:59:23.053 Iray [INFO] - IRAY:RENDER ::   1.0   IRAY   rend info : Received update to 00269 iterations after 96.895s.2019-11-10 20:59:31.233 Iray [INFO] - IRAY:RENDER ::   1.0   IRAY   rend info : Received update to 00272 iterations after 105.075s.2019-11-10 20:59:39.425 Iray [INFO] - IRAY:RENDER ::   1.0   IRAY   rend info : Received update to 00275 iterations after 113.267s.2019-11-10 20:59:51.371 Iray [INFO] - IRAY:RENDER ::   1.0   IRAY   rend info : Received update to 00279 iterations after 125.214s.2019-11-10 21:00:03.141 Iray [INFO] - IRAY:RENDER ::   1.0   IRAY   rend info : Received update to 00283 iterations after 136.984s.

 

 

 

Post edited by Boomatic on

Comments

  • BoomaticBoomatic Posts: 2

    Ps. It's also showing this in the error sometimes :

    2019-11-10 21:00:15.273 WARNING: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(305): Iray [ERROR] - IRAY:RENDER ::   1.14  IRAY   rend error: Error synching on OptixPipeline event (CUDA error string: an illegal memory access was encountered, CUDA error code: 700)2019-11-10 21:00:15.273 WARNING: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(305): Iray [ERROR] - IRAY:RENDER ::   1.14  IRAY   rend error: optixPipelineDestroy(m_pipeline) failed: CUDA error

     

  • Richard HaseltineRichard Haseltine Posts: 102,464

    There are several threads, or part threads, on this kind of behaviour - you might want to look in the Daz Studio discussion forum.

    Which driver versions have you tried?  Have you tried a really simple scene, such as a sphere promitive?

  • Catherine3678abCatherine3678ab Posts: 8,394

    Hi,

    Yes you have posted in the right forum but not very many people have thorough knowledge about these drivers, me either.

    However there were some driver updates recently, worked for some and not for others, I think they were rolling back to the previous driver.

    When I see NVidia updating the gamedrivers on my computer, I trip over to their website and redownload the Study drivers which also appeared to have been updated. Might be worth the trip.

     

  • kenshaw011267kenshaw011267 Posts: 3,805

    Looking through the log, on what iteration do you invoke the denoiser? It strongly looks like something causes both your cards to run out of VRAM in the middle of the render which I've had happen when the denoiser starts.

    But the simple scene should have worked in that case.

    Do the scenes always render to roughly 250 iterations before dropping to CPU?

  • PadonePadone Posts: 3,790
    edited November 2019
    Bluetopika said:
    So yesterday I was rendering perfectly fine with no issues "rendered 17 images in total" it was getting late so I saved my scene, closed Daz and put my system into sleep mode.

    In my experience the sleep mode doesn't work always fine with drivers. So I'd recommend avoiding it.

    That said, are you sure you rebooted windows ? That is, to reboot it's not enough to switch off the pc since this way it doesn't reboot. You have to use the reboot option in the start menu. After rebooting you see your cpu time restarts from zero in the task manager. If the cpu time doesn't restart then you did't get a reboot.

    Post edited by Padone on
  • kenshaw011267kenshaw011267 Posts: 3,805
    edited November 2019
    Padone said:
    Bluetopika said:
    So yesterday I was rendering perfectly fine with no issues "rendered 17 images in total" it was getting late so I saved my scene, closed Daz and put my system into sleep mode.

    In my experience the sleep mode doesn't work always fine with drivers. So I'd recommend avoiding it.

    That said, are you sure you rebooted windows ? That is, to reboot it's not enough to switch off the pc since this way it doesn't reboot. You have to use the reboot option in the start menu. After rebooting you see your cpu time restarts from zero in the task manager. If the cpu time doesn't restart then you did't get a reboot.

    The issue is fast start in Win 8 and 10. It is on by default and when you do a system shutdown it writes the state of the windows kernel to disk. Then when you power on Windows loads that saved state rather than going through the complete initialization. It cuts boot time by a little for people with Windows installed on a HDD but can also lead to some weird issues.

    You turn it off, or on, in the control panel->system->power & sleep-> advanced power settings->Choose what the power buttons do (you need to be logged in on administrative account to change the setting but for most home users this shouldn't be an issue.

    But IME people don't do a shutdown and then physically power on a system when they want to reboot they use shutdown which does an actual full initialization. I'm also doubtful that a driver's state could be causing the issue described.

    Post edited by kenshaw011267 on
  • BoomaticBoomatic Posts: 2

    Hi all,
    Thank you for all of the suggestions above but the cause has now been determined thanks to a very helpful friend of mine.

    This was a Hardware problem with one of the RTX 2080 TI cards.
    Even though the card still runs games / other programs perfectly fine, it would appear as though one of the memory modules has given up.
    Resulting in the (an illegal memory access was encountered (while de-allocating memory) Error which in turn was causing Daz to switch to the CPU to render instead.

    After disabling this card / removing it, everything is running perfectly again "just rendering a little slower than before due to only using one card now".

    I hope this will help anyone that encounters this issue in the future.

    Thank you for your time.

  • kenshaw011267kenshaw011267 Posts: 3,805
    Boomatica said:

    Hi all,
    Thank you for all of the suggestions above but the cause has now been determined thanks to a very helpful friend of mine.

    This was a Hardware problem with one of the RTX 2080 TI cards.
    Even though the card still runs games / other programs perfectly fine, it would appear as though one of the memory modules has given up.
    Resulting in the (an illegal memory access was encountered (while de-allocating memory) Error which in turn was causing Daz to switch to the CPU to render instead.

    After disabling this card / removing it, everything is running perfectly again "just rendering a little slower than before due to only using one card now".

    I hope this will help anyone that encounters this issue in the future.

    Thank you for your time.

    That doesn't sound right at all. Switch the cards in the system before you RMA it. I'm betting it works fine as well.

  • alan bard newcomeralan bard newcomer Posts: 2,242

    good idea on switching the cards..  and take the working card and try it in the other slot .. do you have 2 or 3 slots.. try them all in different configs

     

Sign In or Register to comment.