Video Enhance AI v2.3.0

I overdid it to enhance the problem so it can be seen easily.

If I am not mistaken, Imo has once proposed to use Dehalo v1 as a first step and them Artemis MQ as a second one. So try to upscale to 720p using Dehalo first , then AMQ to 1080p. BUT I do not know if it produces better output.

I ask if in the future you think to add a model for pixel arts video. Actually the only one that work better is theia Fidelity, but don’t produce a very good result. Thank you !

How about Gaia CG?

I have tested all models different times with some low res pixel arts movies (320x200). The only one that produce a bit acceptable result is theia Fidelity but frankly is not like I as expected, there is too much aliasing and the anti-alising filter don’t work. For all other type of videos the result are EXCELLENT !!! hope in the future will be a new model optimized for pixel arts.

1 Like

An important FYI regarding the next version of VEAI (2.4.0):

Models are no longer loaded from JSON’s… loading is hard coded into the application. This means setting parameters in JSONs (keep color, progressive mode for Dione) is no longer going to work, but more importantly, that loading different versions of models from JSON’s is no longer going to work.

There are some different model versions available from within the application. (I don’t have a comprehensive list yet.) But all of them are not… including Gaia CG v6 and Artemis LQ v8.

So if these things are important to you, I strongly advise you keep 2.3.0 installed and install 2.4.0 by renaming folders, or by using a SymLink or Portable method.

Again, this is how things stand now with the beta… they may change on final release, but Topaz seems determined that this is how things are going to be moving forward.

1 Like

are there plans for a pause button in the next version(s)?
i really like how this Software is getting improved further and further, but i’m constantly missing this feature since a long time.
The encoding times at higher resolutions are that high, that i can’t use my computer for gpu heavy things for many hours, which means i can’t use my pc spontaneously and flexible.
a pause button would solve this problem.

3 Likes

^^ This. When a conversion can take days, a Pause button is really needed. (Which is to say, don’t just hit the brakes, but keep processing the current cache, so all current buffers are getting emptied, then Pause, so VRAM and GPU can temporarily be used for other tasks).

3 Likes

Suspend where it would write everything to disk where it is at so it could pick up where it left off would be even better than pause. That would allow you to reboot your PC, use other applications, etc. then come back to it. Even better would be the ability to start other jobs and come back to one you started earlier and start it where it left off.

3 Likes

And another shutdown button would also be necessary

there may be other or even better solutions for it.
The pause button is just, what i know from every other tool when it comes to rendering videos in any form. and here, where the rendering times are way higher, there is no such option…yet.

it really would help a lot since i very often don’t hit the start button, when i know, that VEAI won’t be able to finish the job until the gpu will be used for something else

I’ll tell you what I’d pay extra for… some way to recover many hours of rendering that get nuked. Don’t understand why there is no utility to examine the large nuked file and pick up at the frame it nuked on and save hours of time. I just lost 12 hours on a 60 minute upscale.

It just seems to me that some utility could be created to recover the work, it must be all there just missing some sort of metadata.

I’m saving audio as well so no, I don’t want to do save 70 or 80k frames and try to put them together in video software.

I edit Video in Vegas pro and it’s one of the most buggy software i ever had : There is NO pause button. if the software crash during the process (which is happen a LOT), everything must be redone.
doing rendering of region of the video and after assemble them in one is not rare. sometimes it’s the only solution to do it.

I sometimes do 3D composing / animation (Lightwave, since 1992 or 93) , all versions : there is NO pause button but there is a possibility to render and save frame by frame. Nobody anyway render a 3D video directly in a video file, it take too much times and in this software, only way to have quality is to use Avi uncompressed.

I work with Music software all days, and some projects can be big. I never saw a pause button.

Rendering a video frame by frame is not a big deal compared to loose 12 hours of rendering.

There are free software out there which will make batch frames import into a video in a very easy way, and will import the audio track as well. I understand that a pause button would be important and necessary, but maybe there is a technical limit to it. unless devs answer to this question, what i know for now, if you want to stop loosing 12 hours of upscale (which is the time needed for me to do 3 or 4000 frames or less) , there is no other solution, it’s not like there was no workaround.

While I don’t normally do long rescaling sessions, 3-5 hours mostly, on the occasion I do I break the project into shorter pieces. Say 15000 or 30000 frames each or whatever makes since but always even amounts. So you start like at 0 and go to 14999. The next would be 15000 to 29999 and so on. This way if I did have a crash I only had a small chuck that I lost and knew exactly where to start from to continue.

As far as pause while it would be good to have I use the same process as my chunk method for a pause(stop) and restart. I stop the process as close to a what I call a major frame as possible say 148800 or 13400. An even hundred frame. While I rarely get right on the number it makes it easier for me. I can then verify the frame count using another piece of software. I use potplayer since I can also look at the video for inspection and get the total frame count of the video. Now I know where to restart from, one frame more than potplayer reported.

This works well enough for my videos but I only do simple rescaling at 200 percent , using MP4 output at a CRF of 0. I use Avidemux to extract and save the original audio stream. I also use Avidemux to join(append in avidemux) the video chunks and Staxrip for my final cleanup ,downscale or up and copy the original audio into the final video.

This method has saved me a number of times especially in the early versions of VEAI. Life was a lot less stable back then. I can’t remember the last time I had VEAI crash or my computer for that matter.

2 Likes

this is the right way to do things.

Why not render to PNG and apply lossy compression later? If the render fails just continue from the last frame rendered.

I was using Adobe Premiere, which I paid for, but complicated and lots of work. Looked at the free version of DaVinci Resolve 17, which does everything I needed to do in Adobe, but much easier and it’s free. Only the very high end features are locked out, which I would never use anyway. I can’t believe they give it away, but they do!

access denied when trying the link :stuck_out_tongue:

bit out of subject, but never liked resolve, and use vegas pro since too much time and as a musician, vegas pro is done like a digital audio workstation so more easier for people like me, that’s why there is so much musicians using it despite his issues (too much of them for such a product at this price).

resolve is ā€œgivenā€, because their business model to earn money is not people like you. so they can allow to give their software, they earn their money with someone else and it make big free ads to them to mae people bying the pro version, because their customers are broadcast, tv, cinema studio etc…
a bit like Hitfilm express but in the professional field.

anyway in vegas pro, adding pictures and making a video is very easy. ā€œimport Mediaā€ load first picture, and it automatically detect it’s a image sequence and make automatically the project to the right resolution. you have to set a proper framerate, add the audio you want, and render. it take 1mn to do. if the audio is a dts file, best is to add it with something like MKvtoolnix, or convert the DTS to AAC 5.1 stream, as i’m not sure it can import DTS file directly (never tried it).

I agree on that. Not to mention that DaVinci supports a lot of external PlugIns. For example: I always had problems using Neat Video with Adobe, never any problems with DaVinci.