Topaz Video AI Beta v3.3.0.0.b

Iris Model test:

On low quality source the faces are broken and e.g. the hair is “moving” all time (Link to my enhanced version):

I’m also under the impression that “recover original detail” does not work on Proteus v3.

Also, if used with Iris, setting a higher value overly smoothes the image for me, low value produces a sharper and more detailed output.

Theia Detail as well as Fidelity refuse to run. Loads the model, then aborts with a non-descriptive red X error. RTX 3090, Windows 10, AMD 5950x.

Installation on macOS Sonoma, icons and arrow are inverted. Not sure if this behavior is due to the new O/S. Still, install works as expected!
Screenshot 2023-06-10 at 12.00.09 PM

Was going to test this, but my beta license has expired. Can someone renew it ? :slight_smile:

@nipun.nath @suraj

From previous Beta v3.2.10.b:

Updates NVENC (NVIDIA encoder) - this requires at least driver 531

Can one of the devs please elaborate on exactly what this updated/changed? I’m convinced it has broken playback of NVENC_HEVC output on VLC.

I really hope you address this before pushing out a broken release on Tuesday.

Faces look great, especially with the recover original details tool

However text seems to have a green tint and doesn’t resolve well.

More Green Tint examples


2 Likes

I’ve discovered that you need to do the Recover Detail early in the process. I discovered that attempting to re-process video that has already been resized and in ‘finished’ form will only exaggerate lines; especially facial wrinkles.

So, I am going to attempt to use this functionality in the early stages of enhancement. Between Denoise, Recover detail and a small size increase, 1.5 x- 2x will give TVAI the actual ‘room’ to do the enhancement.

I found a setting that outputs a blacked-out preview image:

It was doing previws just fine until I set output to ProRes 422. (FYI: I using an Nvidia 4090/24)

I did a standard preview, but here are the FFMPEG instructions that got this result:

"ffmpeg “-hide_banner” “-t” “15” “-ss” “1039.413” “-i” “D:/Videos/JerimiahJohnson/Jeremiah Johnson.theatrical.mp4” “-flush_packets” “1” “-sws_flags” “spline+accurate_rnd+full_chroma_int” “-color_trc” “1” “-colorspace” “1” “-color_primaries” “1” “-filter_complex” “tvai_up=model=prob-3:scale=0:w=1440:h=616:preblur=0:noise=0.27:details=0.13:halo=0.16:blur=0.15:compression=0.1:estimate=20:blend=0.25:device=0:vram=1:instances=0,scale=w=1440:h=616:flags=lanczos:threads=0,scale=out_color_matrix=bt709,split=2[out1][out2]” “-map” “[out1]” “-c:v” “tiff” “D:\Topaz Temp/527309198/temp/_tvai_357754293/%06d.tiff” “-map” “[out2]” “-c:v” “prores_ks” “-profile:v” “3” “-vendor” “apl0” “-quant_mat” “hq” “-bits_per_mb” “1350” “-pix_fmt” “yuv422p10le” “-map_metadata” “0” “-movflags” “use_metadata_tags+write_colr " “-an” “-metadata” “videoai=Enhanced using prob-3 auto with recover details at 13; dehalo at 16; reduce noise at 27; sharpen at 15; revert compression at 10; anti-alias/deblur at 0. and recover original detail at 25. Changed resolution to 1440x616” “D:\Topaz Temp/527309198/previews/Jeremiah Johnson.theatrical_4_prob3.mov””

Tried various settings with this version and the previous Beta and I can’t get “Export” to start processing. I looked at the Main logfile and near the bottom it lists some warnings and errors in the licensing section, but I have a current paid license.
I double-checked my folder preferences and all folders are correct and available, but the logfile lists the following warnings at the bottom of the text:

2023-06-10 11-04-20.241 Thread: 39760 Warning Unable to open empty filepath
2023-06-10 11-04-20.243 Thread: 36508 Warning qrc:/filters/TTrim.qml:28: Error: Cannot assign [undefined] to double
2023-06-10 11-04-20.243 Thread: 39760 Warning Unable to open empty filepath
2023-06-10 11-04-20.244 Thread: 36508 Warning qrc:/filters/TTrim.qml:28: Error: Cannot assign [undefined] to double
2023-06-10 11-04-20.352 Thread: 36508 Info ~TProcess(): destroyed

Glitch: Sliders lock after previewing , but the values can be keyed in as numeric text.

“Recover Original Detail” is a life saver;preview while exporting still lacking-other than that,nice step forward…thanks guys.

2 Likes

Observation: While doing a 200% upsizing using Iris v1 vs. Proteus with approximately the same relative settings, results in a steady image using Proteus. Switching to Iris v1 made some improvements but the output preview showed many parts of the picture distorting and appearing to move.

2 Likes

Uploaded a log file, could not process a file on macOS Sonoma. I was on a NAS and suspect the file name couldn’t be used (102 Dr. Strangechild.mp4). Copied and renamed the file to 102.mp4 in my Downloads folder, processing OK now

I did some more testing, and its hard to post here though someone above already did - all tests so far are showing that morphing characteristic between frames. Playback on slowed down footage makes it look like their faces and bodies are crawling with insects as its constantly moving position.

I re-downloaded previous beta and issue is gone, so I think I will stick with that one for the moment.

In a quick test I ran, Iris has improved a bit in some of the areas it had trouble with (small faces and over enhancing some features). Good progress!

Although, I didn’t extensively test it. So there may still be various issues.

Can any of y’all beta testers on Windows with Nvidia GPUs please test the following:

Using this Beta, process any clip, select output using H265 Nvidia (Main or Main10, doesn’t matter) and then play the exported file with VLC and tell me if you have playback issues.

Thanks!

1 Like

I’ve the same issue with VLC media player… and this is strange, since with VLC I have never had such problems: basically the video gets stuck in certain frames, while the audio track plays normally.

1 Like

Thanks for confirming! I have the exact same issue.

They broke something with HEVC_NVENC in the last Beta, and it’s still broken in this one.

Hopefully they fix it before Tuesday’s release!

1 Like

Since installing this Beta it’s not recognizing any Presets?