I have never experienced this error. Obviously something has changed to cause my MacBook (which has not changed) to become unable to use my Topaz Video AI app.
The export begins fine, usually with upscale but pretty basic (recently un-altered “auto” settings) and then the screen flashes red and hangs and then throws the “out of memory” error. 32Gigs RAM, 8gig graphic is not enough??? It used to work fine.
Could you try the same export task but with Low Power Mode enabled in the app preferences? We’ve seen some reports of AMD Mac systems showing errors during processing recently.