Video Enhance AI slower when PC is idle


I have a weird issue with VEAI. It runs slower when Im not using my workstation is idle at night, compared to when I actually work during the day.

I turned off power saving, screensaver, set power mode to performance, set performance mode in Nvidia drivers, turned off HDD sleeping after x minutes. What else could be the reason?

I saw others having same issue, just wanted to make a separate thread to track this issue.

Thank you!