Topaz Video AI Beta 3.4.1.0.b - 3.4.1.2.b

Hello everyone,

We have another beta available for your testing.

3.4.1.2.b

Changelog from 3.4.1.2.b:

  • Fixed Nyx parameters for Mac – (delete the file “nap-v1-beta1-fp16-ml.tz” and the directory “coreMLCache” from your models directory)
  • Improved seeking and trimming
  • Improved image sequence import/export settings

3.4.1.1.b

Changelog from 3.4.1.0.b:

  • Fixed Nyx parameters for Windows
  • Fixed Nyx usage for second pass enhancement
  • Improved Nyx color shift issues

3.4.1.0.b

Changelog from 3.4.0.0.b:

  • Fixed Second Pass Enhancement Issues
  • Added Second Pass Enhancement Preset Support
  • Improved frame number accuracy
  • Fixed image sequence import issues

Nyx Beta:

  • A new model for denoising high-quality video.
  • The focus of the model is on footage from high-quality cameras captured in less-than-ideal conditions.

Known Issues:

  • Nyx may have issues on Mac
  • Nyx “Auto” may not perform well on all videos; we recommend using manual parameters for now
  • Nyx will not work as the second enhancement filter
  • Videos with mismatched metadata and streams will display incorrect duration
  • Frame number preview length may shorten on app restart
  • Crop to Fill / Letterbox / Pillarbox preset values may not migrate correctly
7 Likes

On Windows:

For manual settings on Nyx, pressing estimate button does not work, it says ‘estimating’ but then the estimated values do not change.

Reported a similar issue on Alpha 3.4.0.0.a which was quickly resolved in Alpha v3.4.0.1.a by @suraj

Excited to try this new model once this is resolved.

When Iris is selected, regardless of being set to manual or auto, the “Recover Original Detail” option is missing.
iris_missing-recoverdetails

2 Likes

Also I think this has been brought up at least once before, but it would be nice to have an option to set the output video’s colorspace. A lot of SD videos are BT.601 but the output is always BT.709 and while minor there is a color shift for a number of colors.

Since FFMPEG can handle various colorspaces, IMHO it would/should be easy to have an additional option on the side panel with “Input colorspace” and “Output colorspace”.

11 Likes

As with Iris, nyx has a large amount of color alteration.
In particular, the green color has changed drastically, from R,G,B:0,255,0 to R,G,B:0,244,0.

gcg-5 is re-presented as a comparison.
Even if this image has been altered, the alteration is only about R,G,B:0,253,0, so the color alteration would not be noticeable in a general image.

If the source video is old video, such as VHS, the colors may have been discolored originally, and the discoloration caused by AI may be offset in the experience by noise removal and improved sense of resolution.
However, color correction should be done in the color grading, and unexpected discoloration caused by AI would interfere with the color grading.
Noise removal, resolution enhancement, etc. should be performed while reproducing the original tints as much as possible.

FFMPEG testsrc
colororg015

FFMPEG testsrc with nyx-1
colornyx1015

FFMPEG testsrc with GCG-5 4x

3 Likes

NYX looks very promising!

The NYX preview wont stop processing. It goes through the entire selected preview range, but then keeps going if the video is longer than the selected preview range (as if “export” is chosen, not “preview”).

Trimming the video to let’s say 2 seconds and then doing a 2 second preview honours the 2 second window. If the file is untrimmed however, the preview will attempt to process the remainder of the file that’s left outside of the selected preview range.

2 Likes

Actually, all models keep working beyond the selected preview range and just process the entire remainder of the file.

This is also the first version where for me the frame in the preview is mismatched from the original frame if previewed while the file is still processing (and all preview files are “still processing” unless you wait for the entire clip to be finished before previewing)

1 Like

Please consider a checkbox to “remove / replace old files if found” at the beginning of the installation so that once the initial dialog is accepted, there is no further user intervention required for the program to finish installing

1 Like

The Preview Rendering got stuck, when I use Nyx with my Video.
Logging says:

2023-08-18 16-09-36.972 Thread: 21980 Info Warning: Calculated Frames are higher than total frame count.
2023-08-18 16-09-36.972 Thread: 21980 Info OUT: 3  frame=  1937  fps=  9.96693

Input: 720x576p 25fps
Output: 1350x1080p 50fps
Motion Deblur: Yes
Frame Interpolation: Apollo V8
Enhancement: Progressive - Nyx
File: MP4 - H264 High dynamic @ medium quality

Iris is still unusable on MacOS Sonoma Beta…

I don’t see any difference or change in video quality with the new nyx model. Is it me or you guys too? I don’t see any change. I tried on a 1080 video and I don’t see any difference. odd…

1 Like

Hi Everyone,

We have released another version of this beta.

3.4.1.1.b

Changelog from 3.4.1.0.b:

  • Fixed Nyx Parameters for Windows
  • Fixed Nyx usage for second pass enhancement
  • Improved Nyx color shift issues

Some of the color shift issues for Nyx will still be present, but we hope for this to be noticeably reduced. Also, previously the automatic parameter estimation for Nyx may not de-noise as much as desired. This may have caused a very minimal difference between the input and output. This should be corrected in 3.4.1.1.b as well.

4 Likes

Same. I’d prefer if they had a model made strictly for DVD MPEG-2 compression, so scenes like these:

which can happen during fast motion or in-between clean frames due to the DVD company not caring enough about the product to give the episodes enough space per disc, could be cleaned up more.

1 Like

MacOS Ventura
Can’t run Nyx model as it claims to “Run out of memory”.
It shows that it is out of memory a second after I click “Preview”.
It tells me this even with no filters.
My Mac has 16GB memory, with everything else closed, max memory usage in preferences is set to 100, and only one process.

logsForSupport.tar.gz (38.9 KB)

I had to reboot Windows after installing the new version before I saw the changes!

1 Like

the source and destination (preview) image do not match. there is also a minor color change still (proteus). and the preview gets stuck as usual.

Thank you for reporting this

1 Like

Are you on v3.4.1.1b? I cannot reproduce this issue locally.

Known issue, not something we can resolve on our end.

Same for me, thanks for posting logs!