Topaz Video AI Beta v4.1.0.0.b - v4.1.0.5b

Topaz Video AI Video AI Beta
1

Hello everyone,

We have a new beta available for testing.

4.1.0.5.b

Changelog from 4.1.0.2.b

  • Fixed crashes on input closed during processing.
  • Fixed crashes on in/out moving when no input selected.
  • Fixed crashes (related to macOS only).
  • Fixed resolution error showing as a generic error message.

4.1.0.2.b

Changelog from 4.1.0.0.b

Model Updates

Aion frame interpolation model (previously Apollo SR)

  • More accurate with high resolution inputs.
  • Resolves some of the tiling artifacts seen in previous models.
  • True 16x slow motion without duplicate frames.

Other Updates

  • Auto-parameter estimation moved to GPU for non-AVX2 CPUs
  • Fixed window delay on macOS.
  • Fixed crashing on closing input while processing.
  • Fixed crashing on "Remove group" and "Remove preview" (right click menu related crashing.)
  • Fixed JSON related crashing.

4.1.0.0.b

Changelog from 4.0.9

Model Updates

  • Proteus v4
    • Better handles noise and compression artifacts.
    • Works on interlaced and interlaced progressive videos as well.
    • Reduces ghosting of the previous frame at scene changes.
    • Improves faces better than Proteus v3.
    • Better results on Auto.
    • More temporal consistency.
  • Iris LQ v2
    • Improvements in skin and hair detail.
    • More reliable for non-face inputs.
    • Improves temporal consistency (reduces 'marching ant' artifacts).
    • Reduced color distortion.
    • Reduces ghosting of the previous frame at scene changes (same as Proteus v4).
  • Nyx v3
    • Improvements to overall processing speed -- estimated 80% improvement over Nyx v2.
    • Reduced oversharpening and texture artifacts compared to Nyx v2.
    • Added Sharpen slider for v3 specifically.

    Full changelog

  • AVX2 requirement removed and replaced with a warning about possible errors.
  • In a future update, auto-parameter estimation will be moved to the GPU to handle cases where Video AI is running on an incompatible CPU.

    image

  • Rebuilt EXR + DPX support in-app
    • EXR and DPX inputs will now be correctly downsampled to 16-bit TIFF for processing, and exported at 32-bit linear color.
    • This function requires a large amount of available disk space on the drive selected for exports.
    • Support for ACES and other color formats is still underway, and our team is actively seeking different use cases for EXR and DPX to further improve compatibility.
  • Added focus fix feature to enhancement.

    • image

    • Improve missed focus in videos with the new "focus fix" mode for the Enhancement filter.
    • This feature changes the way models affect input videos by downscaling inputs before upscaling.
    • Two different modes can be used to control the strength of this effect:
      • Standard mode first downscales input media to 50% and then upscales to 2x.
      • Strong mode first downscales input media to 25% and then upscales to 4x.

    image
    image1920×748 65.9 KB

  • Added Full Disk Access prompt to resolve disk access errors on macOS.
  • Improved some UI elements in filters panel.
  • Fixed incorrect frame interpolation related bugs when applying presets.
  • Fixed bug where SAR information was not retained across inputs.
  • Fixed bug where switching between Relative to Auto and Auto modes would not reset sliders.
  • Fixed bug where Nyx is resetting "Recover Original Detail" to 0.
  • Fixed window display related errors.
  • Fixed fullscreen UI issues.
  • Fixed bug where the app would hold a filesystem lock on input videos after app close.
  • Fixed bug where audio codec getting reset during trim change.
  • Fixed bug with metadata loss on MKV exports.
  • Fixed bug where Export Error Resolver tries to resolve preview related errors.

Known Issues

  • Batch processing selection can overwrite FPS output.
  • EXR/DPX Exports may lose input frame number.
  • Inconsistent “Preview X frames” enable status.
  • Rotation w/ previews will intermittently be over-rotated.
  • Looping previews has a stutter.
  • Live preview can have frame de-sync.
15 Likes
2

Well cool. Going to install this on the old AVX1-only system and see what happens.

3

First issue: On the AVX1-only system, the beta doesn’t see any GPUs. The only AI processor options offered are Auto and CPU.

Uninstalling and reinstalling GPU drivers seems to have corrected it.

Not an issue on the newer AVX2 system.

4

Imports a .wmv file and reports fps @ 2x what it really is.

5

I must be missing something. If Focus Fix is supposed to sharpen focus, definitely not seeing that. If anything, the result is less focused.

Untitled-1
Untitled-11563×513 375 KB

1 Like
6

Downloading the models via the Model Manager is incredible slow, and it is not du to my internet connection. In theory i should get up to 30 mbyte/sec. Here are some comparisons. None of the models are great on low quality videos yet:

Iris V2 LQ
Iris V2 LQ1920×1114 146 KB

Iris V2 MQ
Iris V2 MQ1920×1114 163 KB

proteus V3
proteus V31920×1114 156 KB

Proteus V4
Proteus V41920×1114 154 KB

Artemis V10
Artemis V101920×1114 155 KB

Gaia HQ
Gaia HQ1920×1114 149 KB

7
  • This feature changes the way models affect input videos by downscaling inputs before upscaling.
8

This Filter gives an extremely “Quality Degration” :frowning:

9

@gene-8240

To my understanding, this will only work when the video is big in res 1080p =/+

Because if you have already small details, with the filter, you will make them smaller until the AI cant tell anymore what it is.

I don’t know, something is different, has the internal precision improved? Higher color depth?

I have a video here, DV interlaced, not enhanced with TVAI for a long time (it’s a test video I managed to get hold of).

And I haven’t seen it this good in this software before.

With Iris LQ V1, V2 the picture is rather blurred, washed out, without details.

10

Please do NOT dimm down the brighness for unprocessed views, I can barely see anything!

image
image1920×1113 100 KB

4 Likes
11

Yes please.

Its hard to see what the problem is and what the video needs.

12

Hi, in my case focus fix standard (over proteus v4) did a good job with a 1080p bad focused and high iso video. But I need to make another pass to scale it (arthemis). It would be necessary to enable second pass enhacement to make all in one interaction with the app: when focus is selected second pass cannot be enabled.

Captura de pantalla 2024-01-10 a las 15.02.20
Captura de pantalla 2024-01-10 a las 15.02.201920×560 78.4 KB

Focus fix strong returns a highly pixelated video.

1 Like
13

How does this look with the new nyx?

14

Not bad, but not so clean background, with a few subtle artifacs because is necessary to force sharpening to deal with the focusing problem:

nyxv3
nyxv31612×1222 109 KB

1 Like
15

how does it look with the new Nyx compared to Nyx v1?
did you try running this also with Nyx v1?

16

I just installed the beta and i am missing the close-button, window big/short and so on.

Some buttons missing
Some buttons missing3840×2160 198 KB

17

Macbook Pro M1: the app crashes whenever I remove a preview (which is now called ‘remove group’ for some reason
)

image
image1226×514 60.3 KB

18

Probably because if you do multiple previews with the same settings they’re grouped and you can’t remove them individually.

19

Testing on M1 Max. I noticed the new option “start in comparison mode”
 disabled it to see what would happen
 Dragged and dropped a video, it starts playing it immediately !!! I was not expecting this behavior
 was that intentional?

Edit: had autoplay preview enabled:-) I was thinking preview in the context of an export, but when enabled, it will start playing the source video immediately. No worries.

20

Is Nyx v3 currently only supports “x1” (original scale) or it is a UI mistake?
that is what I am getting in the UI


image