Topaz Video AI Alpha 4.1.0.3.a (Aion Frame Interpolation, Iris LQ v2, Proteus v4)

Hello everyone,

Today we have a new Alpha build to test three new models.

Topaz Video AI 4.1.0.3.a
( please redownload if you downloaded 4.1.0.2.a )

Aion v1 - a new Frame Interpolation model for large media

  • More accurate motion estimation for high-resolution inputs.
  • Reduced artifacting and ghosting when compared with Apollo and Chronos.
  • True 16x slow motion without duplicate frames.
  • More temporal consistency.
  • macOS only for this first alpha release.

Iris LQ v2

  • Improvements in skin and hair detail.
  • More reliable for non-face inputs.
  • Improves temporal consistency ( reduces marching ant artifacts ).
  • Reduced color distortion.
  • Reduces ghosting of the previous frame at scene changes ( same as Proteus v4 ).

Proteus v4 ( Same training point as 4.1.0.0.a )

  • Better handles noise and compression artifacts.
  • Works on interlaced and interlaced progressive videos as well.
  • Reduces ghosting of the previous frame at scene changes.
  • Improves faces better than Proteus v3.
  • Better results on Auto.
  • More temporal consistency.

Iris speed up

  • Iris 2x models are now 2x faster on Apple Silicon Mac.

Share your feedback

With three new models in alpha testing, our team would like to collect as many samples as possible to improve model quality further.

Submit Files via Dropbox:

– Send us a short few seconds of input video and the corresponding output.
– Share the ffmpeg command or settings that you used.
– Leave a short note on the issue (e.g. artifact type) or what you’d like to see improved.
– Any comparison videos/screenshots with any of our existing models.

9 Likes

Is Proteus V4 the same model as the previous alpha build, or do you want us to test it again as a new model?

Yes, Proteus v4 is the same version as the 4.1.0.0.a version (post updated)

3 Likes

I tried irisLQv2 with proteurV4 on a low-resolution video and the result is brilliant.

I did a test with IrisLQV2 by itself, and with Artemis as a second enchancement. Adding Artemis made it report an fps about 50% faster. Going to let it run a bit and see if it really is faster or if the numbers are just wrong.

Edit: the numbers are wrong. The alpha is importing a file with a 29.97 fps framerate and reporting the input as 59.94 fps.

Wow, sounds great :+1:
Have to test this tomorrow.

Running Iris 2x on M1 Max 1080p video (Babylon 5 again!) @ 4ps. I have all 5 seasons to enhance, still undecided between Iris v2 vs. Proteus v4, but I think I will like Iris more…

Following up my earlier post, I imported a wmv file and the alpha incorrectly read the 29.97 fps as 59.94. I converted the wmv to an mp4 and the alpha read it correctly.

And adding Artemis as a second enhancement to an Iris enhancement actually did increase the framerate by nearly 50%. Any chance that can be made to happen with Proteus? :grinning:

macOS only for this first alpha release.<<<
My English is not good. Does that mean win is not available yet? I can’t find the option :o

Is aion the same multi scaled Apollo model as before?

Also are there any plans to allow us run the models with no tiling. Considering some of us probably do fit the vram requirements of running models without tiling, it probably would improve temporal consistency for some models :thinking:

Just Interpolating from 23.976 to 25 Frames just does nothing.
logsForSupport.zip (278.3 KB)

Letting it run for 30 Minutes and the Filelength in the Temp Folder is still 0

For what are these other old folders held in the Temp folder from previously done tasks ?!

On TVAI 4.0.9 it´s working and a usable Temp file was created:

OK, Iris 2x is about 2 times faster now yes - that’s good.

BUT: It’s still not quite at the speed it could be / formerly was; and overall performance is still quite uneven on Apple Silicon.

What happened to Iris 4x upscale being dramatically slow now? And the speed gain is only there for Iris LQ and not for IrisLQ V2?
Also there are still quite big fluctuations in speed between having RAM set to 10% or 100% where 10% is much faster for SD upscales but slower for HD upscaling.

This is V4.0.8:

And here the 4.1.0.3.a with Iris 2x much faster but also 4x much slower:

P.S.: The benchmark in this alpha doesn’t run through but stops at the Apollo benches.

1 Like

Another thing:
While Iris LQ V2 does look good at first glance for MQ material when doing 2x upscales (and there slightly better than V1) it’s still highly unnatural when doing 4x upscales :-/


Left 4x, right 2x. Look at those artificial lines the 4x model introduces on the forehead or at the right eye. Also, looking at e.g. the border of the left cheek the face seems somewhat as if it was “pasted” into the background with the 4x model.
Just the logo and text are MUCH better with 4x.

EDIT:
Due to the forum compression the above image doesn’t show the downsides of Iris x4 very good, so here is the image on IMGUR:

(You should right click the image and open it in a new tab/window full screen)

Is it only me that Aion v1 doesn’t load into the program?
WHERE'S THE NEW MODEL

I downloaded all the models, by the way…

I guess you oversaw this:

1 Like

Yes, I’m also waiting for the premiere of the Aion v1 model for Windows OS. I hope it will be included in the next alpha build. :slight_smile: There is progress on the Iris LQ2 model, but I still mainly use the Protheus v4 model in 2nd pass mode.

It’s great you’re giving some more love to motion interpolation.

Are you also planning on giving Themis another pass? It creates a ton of artifacts in my videos, particularly around fine details like hair.

So far Aion is a bit better than Apollo v8 for me. Good work!

@tony.topazlabs Just so you know the dropbox link doesn’t work

Great Thank you! Looking forward to testing

Trying to compare Iris MQ and Proteus v4 on x2. My source file is 1080p, 44min in length

  1. Proteus v4 was faster to execute, ~5+fps vs. ~4fps for Iris MQ on Mac Studio M1 Max.
  2. Output size 8.1GB for Proteus, 10.7 GB for Iris MQ (output is H265 high Quality Level)
  3. I still find Proteus a little softer on skin details, but it’s only noticeable when comparing frames. Casual viewing experience is almost similar

I am attaching 4 pair
Babylon 5 - 3x01 - Matters of Honor screenshots.zip (30.2 MB)
frames you can download and compare

I am now thinking the extra time and space taken by Iris MQ might not be worth the effort. I would of course welcome your feedback!

Thanks

I’m not seeing very much difference in faces that are large on screen, so I thought I’d see what happens with faces that are much smaller.

1920x1080 x 2. Proteus is about 20% faster. Iris seems to do better on both the face and the background, but whether anyone would notice from a normal viewing distance is questionable.