Topaz Video AI Alpha v4.1.0.0.a (Proteus v4)

Hello everyone,

We have an Alpha build to test the new Proteus v4 model.

4.1.0.0.a.model

Proteus v4

  • Better handles noise and compression artifacts
  • Works on interlaced and interlaced progressive videos as well
  • Reduces ghosting of the previous frame at scene changes
  • Improves faces better than Proteus v3
  • Better results on Auto
  • More temporal consistency

Share your feedback

In this new version, we aimed to expand the capability of the current Proteus by handling more severe cases (e.g. more noise, compression, etc) and more input video types (progressive, interlaced, and interlaced progressive). This version can also enhance human faces better than the Proteus v3. While the Iris model is dedicated to face enhancement, Proteus v4 would be the model to handle all face and non-face inputs equally well. Please test this new version and let us know your comments.

Submit Files :
– Send us a short few seconds of input video and the corresponding output
– Share the ffmpeg command or settings that you used
– Leave a short note on what was the issue (e.g. artifact) or what you want to improve
– Any comparison video/screenshot with any of our existing model


Thank you very much and Happy New Year!

11 Likes

i would say be careful with skin wrinkles, poors and beard/hair. sometimes the AI goes beserk and enhaces so much it looks like a bad acid trip. will leave just a video with previews too much of a hazzle to send raw video + processed video, etc.
its a preview so no need of “encoder settings” since its a preview. but i usually use H264 with constant 5 MBS/S and copy audio.
EDIT: i must add its STUPIDLY slow. i have a 16 threads 12th gen I7 + a nvidia RTX 4050 graphics card and the video is processed at 3.4 FPS check whatever is broken on beta and retail since its useless in this state. if i want to process a tv show of 45 minutes it takes about 4 hours or more to export it.

Please do NOT dimm down the brightness of unprocessed views. I can barely see anything on them! :frowning:

With identical settings faces with Proteus v4 look washed out with low details compared to iris. Also hair looks better with Iris:

The preview windows are confused. I select the left preview showing Iris but on the settings panel it says Proteus and vice versa. :eyes:

The auto crop function does not auto crop perfectly sometimes leaving small black bars on the top and bottom:

Input and output frame do not match:

The application denies to save my preset when another preset with the same name already exists. I could just select the preset with the same name by loosing my current settings now. or be forced to save to a new name …

The application is missing the “keep one preview” option so after a short time I count dozens of preivew files. The application is also missing a live preview during processing so as a temporary workaround I open the temp folder to view the file in progress. How do I find the file in progress between all the preview files? I wait until Windows made a preview thumbnail of any single file. Because of its inability to make a thumbnail of the file in progress that one shows different. File found!

I wanted to just do a stabilisation but then it drops always an error.

Here are the log files:
logsForSupport.zip (1.2 MB)

Not always when a preview was generated it shows up automatically. Often I have to select it from the preview list manually.

After generating around 15 previews new previews were still generated but not shown and not to be found in the previews list.

When I drag the zoomed in window on the right and move the mouse by holding the mouse button to the left window and when I release the mouse button then I suddenly unexpected switch to the left window.

I can not find the “keep one preview only” option anymore.
I can not stop the preview during generating.

7 Likes


I sill prefer Iris over Proteus v4. Even Iris LQ provides a more natural result. Protetus still loses too much details in the skin

edit: uploaded 2s file. Babylon 5 series, Blu-Ray is quite grainy unfortunately (good for testing!). Tried Iris LQ vs. Proteus v4, 2x enhancement, no other setting was changed.

8 Likes

Change log from previous version?

amazing proteus v4! better than before, it retains more details and there is no more tingling :wink:
Happy New Year everyone :wink:

2 Likes

i can suggest to try manual settings on proteus? then to the values add +10 (for example fix compression 25 take it to 35 etc) the results will be quite sharper. in fact my complaint is that poors and skin wrinkles go too hard into enhacement and looks like an acid trip (wrinkles that seems to move like alive snails over the face frame by frame for example)

1 Like

excuse me, but in the previews the babylon 5 guy in proteous looks natural and in iris LQ seems to have a skin disease. maybe is the grain beeing upscaled in some form over the skin itself but it looks like he has a liver disease and his face is all covered with old men spots (and the guy was not that old for what i remember)

I’ll take the skin detail over the smooth, fuzzy plastic look any day, but that’s just me.

2 Likes

none of the two is a good result. now if i have to choose doll skin VS liver skin disease i prefer doll skin.
proteus would need to stop over smoothing the skin VS iris to mix the video grain over the images (instead of removing it)

I kicked the tires on Proteus v4 (4X) on some known problem shots with other models.

  1. I didn’t see “marching ants” / swimmy textures that old versions of Iris would produce.
  2. I didn’t see the black hole issue that plagues Proteus v3 via my go-to test case.
  3. I didn’t see the uncanny deblurring of background characters that Iris v1 & v2 often do; Proteus v4 seems to respect cinematography as well as Proteus v3 does.

So it seems pretty reliable at first glance. It doesn’t produce the hyper sharp edges & textures of Proteus v3, but I guess that makes it better for general use, cuz Proteus v3 can be pretty yolo in its enhancement. But for hands-on enhancement, I don’t prefer it over Iris v2 and Proteus v3 because the potential for resolution is lower.

EDIT: I am seeing one issue that carries over from Proteus v3. The image is shifted a few pixels up and left. You can see it if you dump same-frame screenshots from other models and compare them. Proteus has an offset.

5 Likes

I’m getting watermarks in my output, even though I’m logged-in with a license. Can you publish a version that doesn’t have watermarks for paid account holders like me?

1 Like

Proteus v4 is amazing
However, when automatically processing high-quality videos, dehalo will be added.

The actual face is about 1/10th of the entire frame, I zoomed in to document the difference. When watching the movie, it’s looks more natural to me, Proteus looks more “plasticky”. And you might be correct about the grain, there is a lot of it.

If I can make Proteus to work to my satisfaction (I will try to tweak some parameters), I would prefer it as it’s much faster on my Mac (Until Topaz fixes Iris speed on Apple Silicon).

I can also try to denoise first, then 2nd pass with something…

Thanks for the comments!

1 Like

Proteus v4
The pattern on the clothes is not good

1 Like

Can we get a model too where it doesn’t oversharpen unreadable small text? I’d rather keep the text unsharp then have it aliasing.

1 Like

sorry but i see NYX model selected. try selecting proteus? and if the clothes patterns goes really hard i would suggest to lower the sharpening effects.

1 Like

Hello

Proteus v4 is selecting in second pass

its not visible on the settings of the screenshot, and anyways maybe mixing proteus+NYX caused the clothes over sharpened?

1 Like

Nyx oversharpens like crazy from what I’ve seen.

1 Like