New Nvidia driver (418.81) potentially causing issues

So today I downloaded the latest Nvidia driver, 418.81. After that I tried rendering something and GPU-Z started telling me that GPU use was at 0%. I thought it was odd, seeing as how it was just one figure and a 16k HDRI dome. I tried another scene and the same thing happened. So then I tried rendering a simple ball primitive and a smaller 2k HDRI dome, but still the same. I dug into the troubleshooting log and found this:
2019-02-05 21:15:55.827 WARNING: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(304): Iray ERROR - module:category(IRAY:RENDER): 1.17 IRAY rend error: CUDA device 0 (GeForce RTX 2080): an illegal instruction was encountered (while launching CUDA renderer in core_renderer_wf.cpp:437)
Among many many other error messages.
It had been rendering fine (sort of) before the driver update so I rolled back the driver and GPU usage is back to normal. I think that something in the new driver update might not play well with IRAY or ray tracing...
Not sure if anyone else has been seeing this, but just wanted to show what I found in case it gets someone else.
Comments
I always wait at least a week before updating the drivers so that potential problems get exposed and, hopefully, corrected pronto. If it is widespread, there will be flak.
There is another thread already on this subject, so it's not just you. Nvidia Driver Issue
It definitely caused problems. I had problems and had to roll back a version. Other people reported the same.
The predominant school of thought is to always keep your drivers up to date. However, with the all-too-common problems that seem to arise from driver updates, I am inclined to subscribe to the "if it ain't broke, don't fix it" school of thought. I suspect that most people do not even bother looking at the available documentation that comes with driver updates that describes what the included changes/fixes actually address. The latter should be standard operating procedure, in my opinion. If there is nothing there that affects you, I would be inclined to forego the update, especially since many of the driver updates for mainstream cards are primarily designed to improve gaming performance. But to each their own, as the saying goes.
I had same issues with 418.81, I had to go back to 417.71 ...
CUDA fails to initialize and falls back to CPU render ...
2019-02-13 13:08:48.300 WARNING: dzneuraymgr.cpp(307): Iray ERROR - module:category(IRAY:RENDER): 1.3 IRAY rend error: CUDA device 0 (GeForce GTX 1050 Ti): Kernel [0] failed after 0.006s
2019-02-13 13:08:48.322 WARNING: dzneuraymgr.cpp(307): Iray ERROR - module:category(IRAY:RENDER): 1.3 IRAY rend error: CUDA device 0 (GeForce GTX 1050 Ti): an illegal instruction was encountered (while launching CUDA renderer in core_renderer_wf.cpp:807)
2019-02-13 13:08:48.323 WARNING: dzneuraymgr.cpp(307): Iray ERROR - module:category(IRAY:RENDER): 1.3 IRAY rend error: CUDA device 0 (GeForce GTX 1050 Ti): Failed to launch renderer
2019-02-13 13:08:48.323 WARNING: dzneuraymgr.cpp(307): Iray ERROR - module:category(IRAY:RENDER): 1.7 IRAY rend error: CUDA device 0 (GeForce GTX 1050 Ti): an illegal instruction was encountered (while de-allocating memory)
2019-02-13 13:08:48.323 WARNING: dzneuraymgr.cpp(307): Iray ERROR - module:category(IRAY:RENDER): 1.7 IRAY rend error: CUDA device 0 (GeForce GTX 1050 Ti): an illegal instruction was encountered (while de-allocating memory)
2019-02-13 13:08:48.323 WARNING: dzneuraymgr.cpp(307): Iray ERROR - module:category(IRAY:RENDER): 1.7 IRAY rend error: CUDA device 0 (GeForce GTX 1050 Ti): an illegal instruction was encountered (while de-allocating memory)
2019-02-13 13:08:48.323 WARNING: dzneuraymgr.cpp(307): Iray ERROR - module:category(IRAY:RENDER): 1.7 IRAY rend error: CUDA device 0 (GeForce GTX 1050 Ti): an illegal instruction was encountered (while de-allocating memory)
2019-02-13 13:08:48.323 WARNING: dzneuraymgr.cpp(307): Iray ERROR - module:category(IRAY:RENDER): 1.7 IRAY rend error: CUDA device 0 (GeForce GTX 1050 Ti): Device failed while rendering
2019-02-13 13:08:48.324 WARNING: dzneuraymgr.cpp(307): Iray WARNING - module:category(IRAY:RENDER): 1.7 IRAY rend warn : All available GPUs failed.
2019-02-13 13:08:48.324 Iray INFO - module:category(IRAY:RENDER): 1.7 IRAY rend info : Falling back to CPU rendering.
I installed Octane render 4 and it didn't work so looked on forum and learnt that driver broke it so reinstalled my previous one, you would think they'd make sure iray worked though!
We are told that nVidia is aware of and working to fix the issue.
NVIDIA has released a driver update (418.91)
I just downloaded and tested new driver update here, still having issues with CUDA rendering.
Same issues, same errors, rolling back again to 417.71 ...
2019-02-13 15:41:04.220 WARNING: dzneuraymgr.cpp(307): Iray ERROR - module:category(IRAY:RENDER): 1.4 IRAY rend error: CUDA device 0 (GeForce GTX 1050 Ti): Kernel [0] failed after 0.003s
2019-02-13 15:41:04.244 WARNING: dzneuraymgr.cpp(307): Iray ERROR - module:category(IRAY:RENDER): 1.4 IRAY rend error: CUDA device 0 (GeForce GTX 1050 Ti): an illegal instruction was encountered (while launching CUDA renderer in core_renderer_wf.cpp:807)
2019-02-13 15:41:04.245 WARNING: dzneuraymgr.cpp(307): Iray ERROR - module:category(IRAY:RENDER): 1.4 IRAY rend error: CUDA device 0 (GeForce GTX 1050 Ti): Failed to launch renderer
2019-02-13 15:41:04.245 WARNING: dzneuraymgr.cpp(307): Iray ERROR - module:category(IRAY:RENDER): 1.3 IRAY rend error: CUDA device 0 (GeForce GTX 1050 Ti): Device failed while rendering
2019-02-13 15:41:04.245 WARNING: dzneuraymgr.cpp(307): Iray WARNING - module:category(IRAY:RENDER): 1.3 IRAY rend warn : All available GPUs failed.
2019-02-13 15:41:04.245 Iray INFO - module:category(IRAY:RENDER): 1.3 IRAY rend info : Falling back to CPU rendering.
2019-02-13 15:41:04.246 WARNING: dzneuraymgr.cpp(307): Iray ERROR - module:category(IRAY:RENDER): 1.3 IRAY rend error: CUDA device 0 (GeForce GTX 1050 Ti): an illegal instruction was encountered (while initializing memory buffer)
2019-02-13 15:41:04.246 WARNING: dzneuraymgr.cpp(307): Iray ERROR - module:category(IRAY:RENDER): 1.3 IRAY rend error: All workers failed: aborting render
2019-02-13 15:41:04.246 WARNING: dzneuraymgr.cpp(307): Iray ERROR - module:category(IRAY:RENDER): 1.3 IRAY rend error: CUDA device 0 (GeForce GTX 1050 Ti): an illegal instruction was encountered (while de-allocating memory)
2019-02-13 15:41:04.246 WARNING: dzneuraymgr.cpp(307): Iray ERROR - module:category(IRAY:RENDER): 1.3 IRAY rend error: CUDA device 0 (GeForce GTX 1050 Ti): an illegal instruction was encountered (while de-allocating memory)
2019-02-13 15:41:04.246 WARNING: dzneuraymgr.cpp(307): Iray ERROR - module:category(IRAY:RENDER): 1.3 IRAY rend error: CUDA device 0 (GeForce GTX 1050 Ti): an illegal instruction was encountered (while de-allocating memory)
2019-02-13 15:41:04.247 WARNING: dzneuraymgr.cpp(307): Iray ERROR - module:category(IRAY:RENDER): 1.3 IRAY rend error: CUDA device 0 (GeForce GTX 1050 Ti): an illegal instruction was encountered (while de-allocating memory)
2019-02-13 15:41:04.247 WARNING: dzneuraymgr.cpp(307): Iray ERROR - module:category(IRAY:RENDER): 1.3 IRAY rend error: CUDA device 0 (GeForce GTX 1050 Ti): an illegal instruction was encountered (while de-allocating memory)
2019-02-13 15:41:04.247 WARNING: dzneuraymgr.cpp(307): Iray ERROR - module:category(IRAY:RENDER): 1.3 IRAY rend error: CUDA device 0 (GeForce GTX 1050 Ti): an illegal instruction was encountered (while de-allocating memory)
2019-02-13 15:41:04.247 WARNING: dzneuraymgr.cpp(307): Iray ERROR - module:category(IRAY:RENDER): 1.3 IRAY rend error: CUDA device 0 (GeForce GTX 1050 Ti): an illegal instruction was encountered (while de-allocating memory)
2019-02-13 15:41:04.247 WARNING: dzneuraymgr.cpp(307): Iray ERROR - module:category(IRAY:RENDER): 1.3 IRAY rend error: CUDA device 0 (GeForce GTX 1050 Ti): an illegal instruction was encountered (while de-allocating memory)
2019-02-13 15:41:04.247 WARNING: dzneuraymgr.cpp(307): Iray ERROR - module:category(IRAY:RENDER): 1.3 IRAY rend error: CUDA device 0 (GeForce GTX 1050 Ti): an illegal instruction was encountered (while de-allocating memory)
2019-02-13 15:41:04.248 WARNING: dzneuraymgr.cpp(307): Iray ERROR - module:category(IRAY:RENDER): 1.3 IRAY rend error: CUDA device 0 (GeForce GTX 1050 Ti): an illegal instruction was encountered (while de-allocating memory)
2019-02-13 15:41:04.248 WARNING: dzneuraymgr.cpp(307): Iray ERROR - module:category(IRAY:RENDER): 1.0 IRAY rend error: CUDA device 0 (GeForce GTX 1050 Ti): an illegal instruction was encountered (while de-allocating memory)
2019-02-13 15:41:04.248 WARNING: dzneuraymgr.cpp(307): Iray ERROR - module:category(IRAY:RENDER): 1.0 IRAY rend error: CUDA device 0 (GeForce GTX 1050 Ti): an illegal instruction was encountered (while de-allocating memory)
2019-02-13 15:41:04.248 WARNING: dzneuraymgr.cpp(307): Iray ERROR - module:category(IRAY:RENDER): 1.0 IRAY rend error: CUDA device 0 (GeForce GTX 1050 Ti): an illegal instruction was encountered (while de-allocating memory)
2019-02-13 15:41:04.248 Iray INFO - module:category(IRAY:RENDER): 1.0 IRAY rend info : CPU: using 8 cores for rendering
2019-02-13 15:41:04.248 Iray INFO - module:category(IRAY:RENDER): 1.0 IRAY rend info : Rendering with 1 device(s):
2019-02-13 15:41:04.248 Iray INFO - module:category(IRAY:RENDER): 1.0 IRAY rend info : CPU
2019-02-13 15:41:04.249 Iray INFO - module:category(IRAY:RENDER): 1.0 IRAY rend info : Rendering...
2019-02-13 15:41:04.249 Iray VERBOSE - module:category(IRAY:RENDER): 1.3 IRAY rend progr: CPU: Processing scene...
The patch notes for 418.91 says it crashes iray and optix