Topaz Video AI Alpha 4.1.0.3.a (Aion Frame Interpolation, Iris LQ v2, Proteus v4)

Hello everyone,

Today we have a new Alpha build to test three new models.

Topaz Video AI 4.1.0.3.a
( please redownload if you downloaded 4.1.0.2.a )

Aion v1 - a new Frame Interpolation model for large media

  • More accurate motion estimation for high-resolution inputs.
  • Reduced artifacting and ghosting when compared with Apollo and Chronos.
  • True 16x slow motion without duplicate frames.
  • More temporal consistency.
  • macOS only for this first alpha release.

Iris LQ v2

  • Improvements in skin and hair detail.
  • More reliable for non-face inputs.
  • Improves temporal consistency ( reduces marching ant artifacts ).
  • Reduced color distortion.
  • Reduces ghosting of the previous frame at scene changes ( same as Proteus v4 ).

Proteus v4 ( Same training point as 4.1.0.0.a )

  • Better handles noise and compression artifacts.
  • Works on interlaced and interlaced progressive videos as well.
  • Reduces ghosting of the previous frame at scene changes.
  • Improves faces better than Proteus v3.
  • Better results on Auto.
  • More temporal consistency.

Iris speed up

  • Iris 2x models are now 2x faster on Apple Silicon Mac.

Share your feedback

With three new models in alpha testing, our team would like to collect as many samples as possible to improve model quality further.

Submit Files via Dropbox:

– Send us a short few seconds of input video and the corresponding output.
– Share the ffmpeg command or settings that you used.
– Leave a short note on the issue (e.g. artifact type) or what you’d like to see improved.
– Any comparison videos/screenshots with any of our existing models.

9 Likes

Is Proteus V4 the same model as the previous alpha build, or do you want us to test it again as a new model?

Yes, Proteus v4 is the same version as the 4.1.0.0.a version (post updated)

3 Likes

I tried irisLQv2 with proteurV4 on a low-resolution video and the result is brilliant.

I did a test with IrisLQV2 by itself, and with Artemis as a second enchancement. Adding Artemis made it report an fps about 50% faster. Going to let it run a bit and see if it really is faster or if the numbers are just wrong.

Edit: the numbers are wrong. The alpha is importing a file with a 29.97 fps framerate and reporting the input as 59.94 fps.

Wow, sounds great :+1:
Have to test this tomorrow.

Running Iris 2x on M1 Max 1080p video (Babylon 5 again!) @ 4ps. I have all 5 seasons to enhance, still undecided between Iris v2 vs. Proteus v4, but I think I will like Iris more…

I always shrink the application window to the smallest size possible. For couriosity in this alpha the preview button and the time line are cut off at the right. I havent noticed this before.

Please do NOT dimm down the brightness for unprocessed views. I can barely see anything!

Sometimes the processed preview is not shown automatically for an unknown reason so that I have to select it from the preview list manually to make it show up. I also would expect both previews to be generated when I click onto the preview button. Overall the new preview list looks confusing to me. I would prefer one single preview: the one that is currently shown. For both views. If I generate a new preview, delete the old one.

2 Likes

Following up my earlier post, I imported a wmv file and the alpha incorrectly read the 29.97 fps as 59.94. I converted the wmv to an mp4 and the alpha read it correctly.

And adding Artemis as a second enhancement to an Iris enhancement actually did increase the framerate by nearly 50%. Any chance that can be made to happen with Proteus? :grinning:

macOS only for this first alpha release.<<<
My English is not good. Does that mean win is not available yet? I can’t find the option :o

Is aion the same multi scaled Apollo model as before?

Also are there any plans to allow us run the models with no tiling. Considering some of us probably do fit the vram requirements of running models without tiling, it probably would improve temporal consistency for some models :thinking:

The input and output frame do not match:

The application forbids me to save a preset to an existing name:

Two old bugs re-appeared where the zoom level resets and the view switches to the left window when the mouse reaches the left edge of the preview window. Tip: do not work on new versions by using outdated/obsolete versions. :neutral_face:

1 Like

Just Interpolating from 23.976 to 25 Frames just does nothing.
logsForSupport.zip (278.3 KB)

Letting it run for 30 Minutes and the Filelength in the Temp Folder is still 0

For what are these other old folders held in the Temp folder from previously done tasks ?!

On TVAI 4.0.9 it´s working and a usable Temp file was created:

OK, Iris 2x is about 2 times faster now yes - that’s good.

BUT: It’s still not quite at the speed it could be / formerly was; and overall performance is still quite uneven on Apple Silicon.

What happened to Iris 4x upscale being dramatically slow now? And the speed gain is only there for Iris LQ and not for IrisLQ V2?
Also there are still quite big fluctuations in speed between having RAM set to 10% or 100% where 10% is much faster for SD upscales but slower for HD upscaling.

This is V4.0.8:

And here the 4.1.0.3.a with Iris 2x much faster but also 4x much slower:

P.S.: The benchmark in this alpha doesn’t run through but stops at the Apollo benches.

1 Like

Another thing:
While Iris LQ V2 does look good at first glance for MQ material when doing 2x upscales (and there slightly better than V1) it’s still highly unnatural when doing 4x upscales :-/


Left 4x, right 2x. Look at those artificial lines the 4x model introduces on the forehead or at the right eye. Also, looking at e.g. the border of the left cheek the face seems somewhat as if it was “pasted” into the background with the 4x model.
Just the logo and text are MUCH better with 4x.

EDIT:
Due to the forum compression the above image doesn’t show the downsides of Iris x4 very good, so here is the image on IMGUR:

(You should right click the image and open it in a new tab/window full screen)

Is it only me that Aion v1 doesn’t load into the program?
WHERE'S THE NEW MODEL

I downloaded all the models, by the way…

I guess you oversaw this:

1 Like

Yes, I’m also waiting for the premiere of the Aion v1 model for Windows OS. I hope it will be included in the next alpha build. :slight_smile: There is progress on the Iris LQ2 model, but I still mainly use the Protheus v4 model in 2nd pass mode.

It’s great you’re giving some more love to motion interpolation.

Are you also planning on giving Themis another pass? It creates a ton of artifacts in my videos, particularly around fine details like hair.

So far Aion is a bit better than Apollo v8 for me. Good work!

@tony.topazlabs Just so you know the dropbox link doesn’t work

Great Thank you! Looking forward to testing