Topaz Video AI Beta v3.3.0.1.b

Hello everyone,

We have another beta available for your testing. This will be released on Tuesday along with the Iris model, so please let us know of any issues you may have.

Downloads:

Changelog from 3.3.0.0.b:

  • Proteus v3 works as expected
  • Theia models work as expected
  • Recover original detail disabled for interlaced videos
  • Recover original detail slider works correctly for proteus v3
  • Rolled back NVEnc to v12.0.16
  • Older enhancement presets work correctly
  • Video should load correctly if default preset is set in preferences
  • If recover original detail is changed then upscaling no longer resets to 20
  • Misc updates

Known Issues:

  • HEVC Main 10 Nvidia GPU encoded videos not playable on VLC 3.x, Use VLC 4.0 from the nightly builds
  • Videos with mismatched metadata and streams will display incorrect duration
  • Frame number preview length may shorten on app restart

Recover Original Detail

  • Purpose of this slider is to retain details from original source if the model’s output is overly smoothed
  • It adds the source texture details to the model’s output to bring back the original details
  • Lower value might make the output overly smooth and a higher value will also bring in source noise, compression artifacts, etc.
  • Be careful when adding source noise as this might also show up on output if recover original detail is used
  • Please look at the tooltip and let us know if the functionality of the slider is understandable from the name and the tooltip

Enhancement model - Iris

  • Primary aim of the model is to improve human faces
  • This model is also designed to enhance low- to medium-quality video, particularly, with noise and compression artifacts. The model tends to lose details on high-quality videos
  • This model is trained to work on all three categories - progressive, interlaced, interlaced progressive - but the main target is progressive videos
  • Since the model has significant differences from the Proteus model in terms of aim, scope, and performance, we have decided to give it a completely new name
  • Please test the model and give us your opinion.

Thank you for testing


Please upload problem videos and logs here: Submit Files .

9 Likes

Thanks for the update, I can’t test until late tonight but will posts my findings re: Nvidia HEVC / VLC issue.

1 Like

The Main10 issue you reported is still not fixed. Seems like something in FFmpeg Master branch broke it.

3 Likes

I’m sad about this
 I’ve done some tests on interlaced video with Iris model + original detail recovery
 and got very good results.
I hope this problem will be fixed with the next releases.

2 Likes

Some users reported line artifacts when using interlaced footage, if this is not an issue it can be enabled for release.

The preview seems to run fine except that the input and output frame are different frames, but this scene with a TV footage within a movie looks funny, doesn’t it? Maybe I should try to increase the “recovor original details” a bit. :smiley:

3 Likes

Most likely they put exaggerated scan lines on the ‘TV footage’ to make it look like TV, in this case video AI is just enhancing them even more, I wouldn’t expect different results.

2 Likes

The scanlines are totally okay for me. It is the missing of the scanlines in the face of the tv moderator that makes me laugh. :smiley:

3 Likes

Ahh yes must be due to the special handling of faces in Iris.

Still unable to get any preview frames when doing actual exports
The temp file is 0 byte throughout the whole process and I only got the first 2 minutes when the whole video was done processing

Crashed after 8 hours of processing on 3.3.0.0.b. Good news is I got the logs (uploaded). I can also see the .tmp file remaines at size=0.

Stream mapping:
Stream #0:0 → #0:0 (copy)
Stream #0:1 → #0:1 (copy)
frame= 0 fps=0.0 q=-1.0 size= 0kB time=00:00:00.00 bitrate=N/A speed=N/A
2023-06-12 20-05-02.362 Thread: 0x1e9055500 Info OUT: 3 e[48;5;0me[38;5;213m[mp4 @ 0x11fe06d60] e[0me[48;5;0me[38;5;226mDropping invalid packet from start of the stream
e[0m
2023-06-12 20-05-02.428 Thread: 0x1e9055500 Info OUT: 3 e[48;5;0me[38;5;213m[aost#0:1/copy @ 0x11fe08240] e[0me[48;5;0me[38;5;196mError submitting a packet to the muxer: Invalid argument
e[0me[48;5;0me[38;5;213m[out#0/mp4 @ 0x600000a243c0] e[0me[48;5;0me[38;5;196mError muxing a packet
e[0m
2023-06-12 20-05-02.469 Thread: 0x1e9055500 Info OUT: 3 e[48;5;0me[38;5;213m[out#0/mp4 @ 0x600000a243c0] e[0mvideo:126264kB audio:789kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown
frame= 925 fps=0.0 q=-1.0 Lsize= 126270kB time=00:00:18.36 bitrate=56314.6kbits/s speed= 107x

2023-06-12 20-05-02.470 Thread: 0x1e9055500 Info OUT: 3 Conversion failed!

At present the ghosting/blending issue with Iris still remains.

2 Likes

As much as I love Iris, there is too much dehalo, even when it’s set to zero in manual settings. This seems to be more problematic with some videos, and less so with others.

6 Likes

It seems to be all NVENC output that won’t play on VLC - both the built in Nvidia H265 output profiles, as well as the H264 one, and the custom H265 one I have been using ever since custom encoders were enabled - all produce output unplayable on VLC.

With the H264 one the first 2 or 3 seconds of video never plays or looks corrupted. With H265 You see maybe 2 or 3 random frames, while the audio continues to play.

I tried the nightly build of VLC 4 and it wasn’t a stellar result, the video barely played but was laggy, looked corrupted and audio was not synced, so not really a solution.

If this can’t be fixed in time for the big release tomorrow then hopefully it can by next week as VLC is my go-to media player and there’s no point in producing output that may or not play in the future.

I think @gregory.maddra aka Bloxgate the ffmpeg build master may need to put eyes on this as well :grin:

Thanks

1 Like

Now it happened again: The preview went either stuck completely or was heavily delayed. When I stop and restart the processing it not necessarily happens at the same frame.

All previous reported issues from the last Beta still present. The morphing of the images still makes this unusable for anything than strict testing.

On a side note, this is the first time I now have to sideload multiple versions of Topaz V3. However, even with copying and relocating the model folder, the separately loaded version of V3 won’t process anything and just errors out requesting contact with support. Can you explain how I side load now with these newer versions? Currently I have to just constantly uninstall and reinstall the older version to actually use it.

icons and arrows fixed:-)
Screenshot 2023-06-13 at 10.49.53 AM

Artemis LQ v.10 still looks so good that I would love to see it as an own Artemis mode with an own name in a final release again. Maybe named “Artemis refined details”. :slight_smile:

Anyway by using the mentioned mode I ran into the black box issue again which I suffer from for so long now occasionally. I put source file and log files to the drop box. GPU was set to default power use when it happened.