Topaz Video AI Performance Alpha for Windows Nvidia & AMD GPUs

Hi All,

Here is an early version of app that should improve performance for both Nvidia and AMD GPUs. Please let me know if the performance is slower.

Download: Win

Low power mode has been removed for windows, this will allow more filters to be chained together and running multiple processes.

Known Issues:

  • Proteus Auto will not work, use Proteus with manual settings
  • Models cannot be run on CPU
  • Models cannot be run on intel GPU

Thank you for testing

PS: Since this is an alpha version, it will not interfere with Beta or Release versions on the machine.

5 Likes

Fist short test.

What the … … processed in 18 seconds (10 sec Preview) PAL to 1080p, 33,5 fps, Proteus.
fastest b4 this version was 30 sec.

35 fps Artemis low q.

Theia does not download (update below), Gaia (HQ) does not load and not download.

Gaia GC, 13.4 fps. —> after running this model Gaia (HQ) did download and work too, and Theia did too.

Themis + Proteus = error.
Themis + Artemis = error.
Stabilisation + Artemis = error.

end of short test.

Win 11, 7820X, Quadro RTX 5000.

The GPU and CPU are still ok, no overheat, both have still room for more performance, but the speed is nice.

On the GTX 1060 performance is consistent with last weeks alpha version (~2.4fps on a Proteus 720p to 1080p upscale).

gtx 1050 ti 6% slower in all tests as gpu usage is not at 100%.

My suggestion would be rather than remove the low power mode option completely, instead replace it with a “MAX Power Mode” (that is off by default) for those who just want to run a single filter at 100% gpu usage. Then make sure there is a prominent note by this option that turning it on could introduce instability when running some process combinations.

Might just link the boost to max processes. If it is set to 1, then the boost.

1 Like

Compared to the release version or previous alpha?

Hi Suraj, any idea on when you will integrate FFMpeg v6? There should be some performance to be found with that.

Just noticed the colour correction option. Is that working in this alpha? If so, what does it do?

compared the two, because for me 3.1.7 and 3.1.7.2 alpha has the same performance.
note: since version 3.1.2 videos in 720p had a performance drop of 4% compared to version 3.1.1 (other resolutions like 480p have had a performance increase since then). I believe it’s because of this change mentioned in the changelog "Significant performance improvement for GTX 16xx series GPUs compared to 3.x.x ".

So,

the AMD system with 3960X & Radeon Pro W6800 does Proteus in 19 - 24 sec (10 sec Preview) with 27 - 29 fps.

We did start at Jan 28 with 58 sec for proteus, so performance has been more than doubled since then. :+1: nice job. (but that speedup is only with small videos.)

After first test run export is faster (seems like somthing did get cached)

The 24 Core TR is still bored but thats ok, the intel 8 Core is almost maxed out but not overloaded.

Both systems can still be used while exporting with TVAI.



AMD Sys test: 24 core 3060X & W6800.


10 sec preview.


1080p denoise
Artemis Low → 3.1.7 = 46 sec
Artemis Low → 3.1.8.2 = 35 sec

1080p denoise - RTX 5000 & 7820X
Artemis Low → 3.1.7 = 31 sec
Artemis Low → 3.1.8.2 = 32 sec


1080p denoise
Proteus → 3.1.7 = 49 sec.
Proteus → 3.1.8.2 = 37 sec.


1080p → 4K
Proteus → 3.1.7 = 1 Min 18 sec.
Proteus → 3.1.8.2 = 1 Min 5 sec.


1080p → 4K
Artemis low → 3.1.7 = 1 Min 17 sec.
Artemis low → 3.1.8.2 = 1 Min

1080p → 4K - RTX 5000 & 7820X
Artemis low → 3.1.7 = 1 Min 5 sec.
Artemis low → 3.1.8.2 = 57 sec.


1080p → 4K
Theia → 3.1.7 = 1 min 38 sec.
Theia → 3.1.8.2 = 1 min 18 sec.


The bigger the video the lower the speedup.

2 Likes

Make sure memory setting is maxed out. I always use 1080p input for all my testing. The results in almost all cases are around 2x faster.

Should be in a couple of weeks. We generally update from ffmpeg main branch every month, so most of the 6.0 stuff should already be in there.

4 Likes

That is just for performance testing. It’s always on for color correction models and will not be an option during release.

I see the stabilization issue. Will look into it.

2 Likes

I did test at 50% and 100% and it didnt make any difference.

Do you test it with ui or without?

Whats the difference when we run the software?

With GUI, could be because of Low Power Mode vs no low power mode

Could the low power mode stick at some point and stay forever until i switch something in the reg?

With 360p → 720p (that destroyed D&D cartoon FTW!) I see quite an increase, from around ~34fps in latest v3.1.7 stable, to ~45fps in this alpha. That’s on RTX 3090, 100% memory set, on i9 7940X CPU (fairly old one) and 64GB of RAM. Preview parameters:

ffmpeg “-hide_banner” “-nostdin” “-y” “-nostats” “-t” “15” “-ss” “103.736” “-i” “W:/Video/Dungeons & Dragons Episode 19 The Last Illusion.mp4” “-flush_packets” “1” “-sws_flags” “spline+accurate_rnd+full_chroma_int” “-color_trc” “2” “-colorspace” “2” “-color_primaries” “2” “-filter_complex” “tvai_fi=model=chr-2:slowmo=1:rdt=0.01:fps=60:device=0:vram=1:instances=0,tvai_up=model=prob-3:scale=0:w=960:h=720:preblur=0.06:noise=0.14:details=0.33:halo=0.4:blur=0.23:compression=0.86:kcolor=1:device=0:vram=1:instances=0,scale=w=960:h=720:flags=lanczos:threads=0,split=2[out1][out2]” “-map” “[out1]” “-c:v” “tiff” “W:/Temp/436928168/temp/_tvai_249556639/%06d.tiff” “-map” “[out2]” “-c:v” “hevc_nvenc” “-profile:v” “main10” “-preset” “medium” “-pix_fmt” “p010le” “-b_ref_mode” “disabled” “-b:v” “0” “-map_metadata” “0” “-movflags” "use_metadata_tags+write_colr " “-map_metadata:s:v” “0:s:v” “-map_metadata:s:a” “0:s:a” “-map” “0:a” “-c:a” “copy” “-metadata” “videoai=Slowmo 100% and framerate changed to 60 using chr-2 ignoring duplicate frames. Enhanced using prob-3 with recover details at 33, dehalo at 40, reduce noise at 14, sharpen at 23, revert compression at 86, and anti-alias/deblur at 6. Changed resolution to 960x720” “W:/Temp/436928168/previews/Dungeons & Dragons Episode 19 The Last Illusion_3_chr2_prob3.mov”

However, the Chronos frames interpolation makes gray frames here:

2023-03-03

GIF doesn’t play all 60fps, but the gray frames are visible every time, where calculated image content otherwise would be. It’s Proteus manual, the “estimate” button, as expected, doesn’t work either, even after dropping the necessary model for Alpha. :slight_smile:
Since it’s a preview, the creation/finalization of the 15s preview video file is fairly slow (TIFF files after all, from a HDD), it “feels” slower, than in current stable v3.1.7.

I hope the gray frames aren’t the cause of the increased performance… :slight_smile:

Edit: They’re not - with Apollo model I see ~30 fps in v3.1.7 vs ~35fps, and Artemis with Apollo - ~30fps vs. ~37 fps in this Alpha. And no gray frames. :slight_smile:
Color Correction maybe takes 1 fps out of the performance, if anything, I’d say the hit is negligible.

Gray frames issue is only with both Chronos models, with and without Replace Duplicate Frames option.

1 Like