Topaz Video AI Beta v3.2.3.0.b

Hello everyone,

We have another beta for y’all’s testing.

Downloads
Windows
Mac (DMG) | Mac (PKG)

  • [ Experimental ] Newer checkpoint of Proteus V4 for more detailed textures
    (enable old versions from preferences to use Proteus V3)
  • Added preference option to enable old unsupported/legacy AI models
  • Improved speed of Apollo and Apollo Fast
  • Added 4X Slow Motion default preset using Apollo
  • Added text indicator for the final stage of video processing
  • Added new docs link to Preferences help icon
  • Added warning for image sequence export file overwrite
  • Fixed Apollo Fast working only with 4x slow-mo
  • Fixed preset apply issue affecting filter locks
  • Fixed preset dialog user flow bugs
  • Fixed image sequence exporting into parent directory
  • Fixed persistent temporary files on export
  • Fixed tab persistence in preferences dialog
  • Fixed Mac window maximize issue
  • Fixed dragging window issue
  • Fixed horizontal split view scroll bar issue
  • Misc updates

Known Issues

  • Looping resets the pan while previewing
  • Split view doesn’t work correctly for certain input/output resolutions
  • Proteus V4 does only 4x upscale. So performance will be slow for lower upscales

Thanks for testing

Please upload problem videos and logs here: Submit files

6 Likes

My god, these are coming out QUICK, as I just DL’d un/installed the previous one, booted it up, and bam, another beta! I’m so glad I invested my time and money on this product! :smiley:

EDIT: I’m guessing this is an isolated feature that we’re testing, and it won’t be permanently cut to only 4x so no worries here! :slight_smile:

Oh, wow, preferences for “legacy” models. Could it be - the return of Gaia HQ v6 soon? :slight_smile:
image

Artemis has quite a wide amount of choices now - thank you:

Proteus, too! :slight_smile:
image

Frame interpolation - whoa:
image

4 Likes

What!?

I’m amazed, thanks a lot to the team for bringing this in for the power users of this incredible prog!

2 Likes

Is there a way to have the “instances” variable set to 0 instead of 1? It’s causing processing failure on some models, which wasn’t happening in v3.2.1.

Topaz Video AI Beta v3.2.3.0.b
System Information
OS: Windows v10.2009
CPU: AMD Ryzen 7 2700X Eight-Core Processor 15.939 GB
GPU: NVIDIA GeForce GTX 1060 6GB 5.9014 GB
Processing Settings: device: 0 vram: 1 instances: 1
Input Resolution: 1280x720
Benchmark Results
Artemis 1X: 3.89 fps 2X: 2.70 fps 4X: ERR fps
Proteus 1X: 3.81 fps 2X: 2.65 fps 4X: ERR fps
Gaia 1X: ERR fps 2X: ERR fps 4X: ERR fps
4X Slowmo Apollo: 4.34 fps APFast: 18.07 fps Chronos: 2.35 fps CHFast: 3.80 fps

1 Like

I think there’s a bug. With “Enable Previous Model Versions” turned on, if I select Proteus v4, it switches to v3 and renders with v3.

Scratch that, any selected version of Proteus goes automatically to v3 upon preview.

For me, model selection works, I processed that destroyed D&D cartoon through the preview on all 4 of them, and, unsurprisingly, v3 is the fastest. All Proteus models downloaded correctly and got used. And it seems they’re converted to TensorRT format (in my user case and with exception of v4)! :slight_smile:
image

I’m noticing “starry” artefacts when Apollo Fast v1 model is being used, but that’s probably because it’s in beta. It usually shows on scene changes or more dynamic movement interpolation - which is great, I have to admit. It even (finally!) corrects the movement irregularities almost perfectly in that “Lalafell Reaper” video I’m testing VEAI’s motion interpolation on regularly.

The new Proteus v4 checkpoint, when set to high Revert Compression values, crushes blacks or makes darker colors go black. On lower values it’s less pronounced.

1 Like

The guys face seems to lose quite alot of its red tone.

Will fix this, currently it’s linked to max processor which won’t work for you.

1 Like

Looks like a bit of Botox too.

1 Like

Can confirm with this bug. Can only try V4 when that previous model selection tick box is unselected.

In relation to V4, obviously work in progress:

  • The slider bars still do next to nothing. They do have an effect but not much of one.
  • The noise reduction is extreme by default. Even at Manual with 0 noise reduction, the output is heavily noise reduced. Unfortunately it makes the output lose too much detail and as the slider is already at 0, you can’t adjust it.
  • There needs to be a slider bar for the new face enhancement. Faces in background are often better, but it also tries to sometimes enhance a face that is blurred intentionally. That is, when the camera is focused on a foreground person and the background is thematically blurred (not just bad quality) IE here the below image. You can see she is supposed to be blurred as background by the AI has tried to sharply enhance the face leading to a rather creepy result. Interestingly, in the further down image the character “in focus” has had far less focused enhancement done so actually looks (weirdly) more blurred than the background character.

4 Likes

Older Apollo models don’t load for me;/
image

That’s very cool for old models, but how add a model version on files TVEAI ? Because Artemis LQ 7 and 8 aren’t inside. How add ? Thanks

3 Likes

Here are four comparisons with Proteus v1,3,4 and Artemis LQ10 which renderings do you prefer?




2 Likes

Base on these screenshot,
The Artemis LQ10 give the best detail in hair & flower on the clothes.
Artemis LQ10 > Proteus v3 > Proteus v1 > Proteus v4

4 Likes

Artemis has generally speaking always retained more detail than Proteus. I still use V8 of Artemis for the bulk of upscaling for that reason, as V9 and later softened things too much.

Proteus has always been more of a glorified Avisynth script that allows for “more friendly” processing of common issues - wanting to sharpen a bit more, wanting to denoise a bit more etc - but lacking much of the AI that seems to be in the upscaling as no matter the countless hours I have spent with Proteus 1, 2 and 3, none can replicate the actual level of detail expected from upscaling with AI.

Note that the Proteus Auto settings for V1, 2 and 3 have always erred on the blurred side. Proteus doesn’t work unless you dial in the knobs as it were. I am not sure from the comparison images if it was just “Auto” for 1 and 3, but guaranteed the output of Auto on those models won’t hold a candle to Artemis - on virtually any version.

Its why I am excited for V4. The face reconstruction is the first actual AI progress I have seen in Proteus since it was first released. But even on V4 with sliders mostly broken, I have to set Detail to 100x Sharpness and Deblur much higher than you would put on V3 or V1 just to get any effect, which is better.

The below comparison Album has options for Proteus V4 Auto, Proteus V4 Manual, Original and Artemis LQ V8. Note that the Artemis one had more denoising done before feeding into the upscaler as it amplifies noise:

If the detail retention of Artemis can be added to Proteus, with a slider for Face Enhancement and fixing the slider bars so it doesn’t denoise out the wazoo, it may be a perfect amalgamation.

8 Likes

I think VEAI also tries to correct whatever kind of color tint compression artifacts can create. I like it. Though, let’s hope it’s not “hardcoded” into the models, so, in the future, it could be optional - more choice to have is (almost) never bad! :slight_smile:

I have to say, the quality of Proteus v4 is much better! Good work! With manual settings, that is.

However, the ‘Dehalo’ function is currently too exaggerated, even at a value of zero.

With more testing, I find that ‘Revert compression’ ‘Reduce noise’ and ‘Dehalo’ are set too high and even with settings of zero it’s too much sometimes, as it removes subtle details (such as hair or skin texture).