The GPU device instance has been suspended

Topaz Video AI Bugs and Issues
1

Crash
Resolve Error

1232132131

Log
2024-03-21 14:05:56 12272 CRITICAL: ONNX problem: Run: D:\a_work\1\s\onnxruntime\core\providers\dml\DmlExecutionProvider\src\ExecutionProvider.cpp(897)\onnxruntime.dll!00007FF9589BF8B9: (caller: 00007FF9589BFD04) Exception(2) tid(2ff0) 887A0005 The GPU device instance has been suspended. Use GetDeviceRemovedReason to determine the appropriate action.

2024-03-21 14:05:56 12272 CRITICAL: Model couldn’t be run for outputName
2024-03-21 14-05-56.983 Thread: 9960 Info OUT: 3 [“out”]
2024-03-21 14-05-56.983 Thread: 9960 Info OUT: 3

2024-03-21 14:05:56 12272 CRITICAL: Unable to run model with index 0 it had error: no backend available
2024-03-21 14-05-56.984 Thread: 9960 Info OUT: 3

2024-03-21 14:05:56 12272 CRITICAL: Caught exception in tile processing thread and stopped it msg: unable to run model with index 01
2024-03-21 14-06-00.765 Thread: 9960 Info EXITED: 3 -1073740791 1
2024-03-21 14-06-00.765 Thread: 9960 Info Going to delete path: “”
2024-03-21 14-06-00.765 Thread: 9960 Info Close and delete path “”
2024-03-21 14-06-00.765 Thread: 9960 Info Going to delete path: “F:/!Play/upscale/1_iris2.mp4”
2024-03-21 14-06-00.765 Thread: 9960 Info Close and delete path “F:/!Play/upscale/1_iris2.mp4”
2024-03-21 14-06-00.774 Thread: 9960 Info ~TProcess(): destroyed

System Profile
Windows 10, AMD Ryzen 7 5700G, 16GB RAM, Nvidia GeForce GTX 1660 Super

Model
IRIS, Proteus

Input
636 x 480, 1:01:1 PAR, 29.97 FPS

Output
1920 x 1080, 29.97 FPS

2

In the preferences panel, change the max memory % to 75% and try the process again. The 1660 Super is getting overwhelmed by the two models being applied to the video. Limiting the system will help the GPU keep up.

3

I only use a single model, not two. The crash happens for both models, Iris or Proteus.

4

Can you post the full logs?

5

2024-03-21-11-46-58-Main.tzlog (509.6 KB)