Video Enhance AI v1.6.1

Topaz Video AI Releases
211

I have this same issue when converting from 1080p to 4k using Gaia-HQ or Gaia-CG.

[Album] Topaz VEAI - Horizontal Line Issue with Gaia-HQ/CG

Notice the horizontal line across the bridge of his nose. The image below this line has considerably more grain than above it. The line goes all the way across the frame, and persists from frame to frame.

212

Yes itā€™s bad to have that line in almost all the video. Is there a fix?
Thank you!

213

Is it best to use the denoise setting to clean a video up before upscaling? Or does it not positively, or negatively, effect the end result in any meaningful way?

214

For this to sell well in the forensic community (private and law enforcement), the software will need:

  1. Lossless saving
  2. A pause/resume processing button so the computer can be interrupted for urgent tasks.

It would be helpful to have a preview button that shows what the current frame will look like after processing (by only processing the current frame using a few previous and following frames). In this way, the user can quickly choose the best settings for their needs.

2 Likes
215

Hi, Iā€™ve written a Python script to provide 2 features

  1. Basic pause/resume capability
  2. Increased stability by using VEAIā€™s image sequence output format instead of .mp4 output
    (I suspect VEAIā€™s troubles with .mp4 output mode is simply due to the finickiness of ffmpeg)

Because of the bug? I described in my last post (quality worse when VEAI is launched from command line), the usage model is a bit unconventionalā€¦

  • The script is designed to be run in the background while VEAI is outputing the sequence of images.
  • The script works in batches, creating intermediate video files with each batch, deleting the images after the video has been created. This reduces the disk space footprint.
  • When the last batch has been completed, the intermediate video files are concatenated into the final video file.

Screenshot:

[Album] imgur.com

Also, while we are on this topic, it would be great if .webp (lossless) output format support could be added to VEAI. .png file sizes are simply atrocious.

The script has been tested on Windows cmd and WSL.
PRs are welcome.

4 Likes
216

Wepb format takes more computing time than png and this could eventually slow down the process and also the process of converting back to a video file. What would be nice is high bitdepth PNG output because uncompressed 16 bits TIFF is just monstrously insane in file size. I went one time with a 600GB+ folder for a 10 minutes long video. Ouch.
You can think 16 bits output is overkill but if you want to postprocess color correction/grading it can make a huge difference by having done a master video file using ProsRes/Cineform/DNxHR 4:4:4 12 bits or even lossless codecs that support high bitdepth like MagicYUV.

1 Like
217

Has anyone tried speeding up the VEAI with this method?:

Task Manager ā†’ Details ā†’ right click on softwareā€™s exe and select higher priority

Would love to hear the results, as my trial has expired. Currently my setup is way too slow. No reason to purchase the software.

218

@osol sadly that method doesnā€™t speed up the process, I tried but It doesnā€™t make changes.

Does anyone know how to get rid of the horizontal lines created from Gaia HQ in processed videos?

219

Iā€™ve never experienced horizontal lines and GAIA-HQ is my main model. Maybe it comes from the source. Have you checked the source and take a close look at where these lines appears ?

220

I havenā€™t either. Itā€™s unclear to me from the posts Iā€™ve read. Is it:

  1. Only happens when scaling to 4K,

  2. Only happens when scaling a certain resolution to 4K (720p to 4K, 1080P to 4K, etc.)

  3. Only happens when scaling using GPU, but not CPU or CPU/OpenVINO

People who have the issue need to test this and report back, as developers are going to have to be able to reproduce the problem if thereā€™s going to be any chance of fixing it.

221

Yes, It happens when upscaling from sd to 4k and the source doesnā€™t have that line. Also itā€™s not only one line but theyā€™re 2, dividing the image into 3 equal portions.
So I assume itā€™s an issue of Gaia HQ right?

222

This is Video Enhance AI v1.6.1 on RTX 3080:

Annotation%202020-10-16%20184516
Annotation%202020-10-16%201845162046Ɨ1492 562 KB

The initial run took over 30 min. to start! and after it starts the result output is scrambled and unusable!
The RTX 3000 series had been released for around a month now, is there any plan to make this work soon? Iā€™m getting pretty promising time per frame though, itā€™s about 2x faster than RTX 2080 Ti!

223

Read this thread ā€¦

224

I do play with the color space after I upscale so everything looks a little cleaner, usually just shifting the color space to 709 in vegas or after effects works for me.

225

Is there an update or an ETA to when the Mac version will have GPU support for the Gaia models? Itā€™s my favorite of the models, but itā€™s a bummer that it has to use the CPU instead of the Vega48 I have in my iMac.

226

ARE YOU KOREAN?
ķ•œźµ­ģøģ“ģ„øģš”?

227

The VEAI Mac alpha version (for testers only) now has GPU support for Gaia, where it is actually faster than the other models. It should be released in the not too distant future. Also, Gaia quality has been improved.

228

lol no, Iā€™m Taiwanese

229

i neeeed thissss

230

Any results produced by this software should not and can not be used as a forensic evidence. Neural networks basically ā€œimagineā€ plausible video output based on the videos they were trained on. So resulting output highly depends on used model, training dataset, and parameters. Using this to hold someone accountable, especially in police, is impossible. This is not a CSI movie.