Video Enhance AI v2.0.0

Grain is good for old movies. Make them look more realistic I agree. However, thumbdown for grain on modern movies. All the way down to 0 for me most of the time since it’s pointless and a waste of time. For me, 4K UHD is the way to go every single time. It’s like…a necessity for my own life.
I like Artemis than Gaia since it’s faster and more natural than Gaia. But for medium or high compression movies, I had to use Gaia for sharpness boost. Still, it depends on people’s taste. Because the software is not mature yet, I can’t say which is good and bad. Hopefully the developers can find a way to boost Gaia HQ, at least 15%. I love its sharpness boost, but I also hate the time I had to spend for Gaia HQ which is just a bit better than Artemis. I pick Artemis to save time, and save electricity. Hundreds of movies man, Gaia HQ is not what I want to work with a 2 hour movie. 480p to 1080p is way too easy for me with 0.12s/frame. But anything to 4K costs 0.43s/frame with Artemis, 0.67s/frame with Gaia. Since most of my movies are already blu-ray, Artemis is a better choice between time and quality. Sharpen a blu-ray movie is useless for my eyes lol.

1 Like

well, i must add that i watch my movies/series on an 4K 82" QLED from a 2m (6foot) distance.
That’s what i call home cinema :wink:

Time and 4K rendering is a challenge, especially on a mid-range gpu.
Even with my RTX3090 i have to clean/upscale those 2h blockbusters overnight.
1h movie = 7h to 9h rendering (depending on the used AI model)

And as VEAI is not using the full potential of the new nvidia 30x0 series yet, i am running 2 or 3 VEAI instances at the same time. That saves at least 1/3 of the needed time and uses the GPU to its max.

1 VEAI instance… = 20-40% GPU load
2 VEAI instances = 50-70% GPU load
3 VEAI instances = 70-95% GPU load

video1 video2 video3 (one by one)
3h + 3h + 3h = 9h all

3 parallel instances increase the rendering time for every instance by ~50% (4h-5h)
BUT its only 5h for ALL 3 videos now, so i save 4h

I must confess, i never have chosen the AI model by time but only by “quality”.
Electricity is definitely a point while upscaling. Especially here, as we have the worlds highest prices for electricity in GerMoney. But i got my own 8KW photovoltaic on the house, so i dont care about that anymore. Others definitely have to keep an eye on their bills.

1 Like

Can we expect that VEAI will eventually support Apple’s M-series architecture and the Metal API? Since Apple are moving their entire desktop/laptop product line to ARM, it would seem that this move is inevitable.

Currently running VEAI on a maxed-out M1 Mac mini and although it’s rather slow (about a 50:1 ratio using Artemis V11) the results are astonishing. For my use case, I can just leave the render running overnight so I’m not too concerned but it would certainly be nice if VEAI could take better advantage of the new silicon.

1 Like

Hmm, I shall check. So you wrote about cleaning 480p files. So to clarify:

  1. Denoising/deblocking for full HD - I use Artemis MQ, HQ is not far behind, LQ introduces strange nose deformation - you recommend Gaia HQ or Gaia CG/Artemis AA, I shall check it.
  2. Upscaling poor 480p content - ALQ and AMQ destroys substrates, ALQ ntroduces strange nose deformation - what do you recommend?
1 Like

Full HD to 4K you recommend Artemis HQ? I believe Gaia HQ gives a little better sharpness, but is much slower. I have not compared “natural look” between them.

1 Like

in my experience when upscaling 1080 to 4K:

if the source footage is already very high quality with little-to-no noise and/or compression – Gaia HQ retains the most quality and fidelity while adding a little more detail. Artemis HQ will do an equally good job as well although it will completely remove noise and give that plasticky look, and it will smooth out colors while retaining texture and detail. this can be great for smoothing out skin tone, but it also changes the overall look of things so it’s not as high fidelity as Gaia HQ.

so basically when going from 1080 to 4K – Gaia HQ will keep whatever detail is already there while enhancing it or adding more wherever it’s needed. Artemis HQ will alter the detail that’s already there and replace it with what it thinks is better.

3 Likes

For poor 480p, it’s hard to get more detail, but cleaning it is what you can only do. So use Gaia CG or Artemis AA, then use Gaia HQ for like 10-20 second scene. See if you like it. If not, then nothing you can do. If okay then it will be a bit better.

1 Like

It depends on your source. But for good source like bluray I mostly use, I only go for Artemis to avoid oversharp and motion flickering. Also sharpen things that don’t need to be sharp is just a waste of time. They’re not even visible anymore. It’s time consuming for Gaia, and I only use it for medium compression movies and below.

I’m about to buy Nvidia A100 for VEAI. But for saving, I think I have to wait for Quadro lineup. If I can get one on hand, time is nothing to me anymore since I can run multiple instances at once. But still, the gap between Gaia HQ and Artemis HQ is too close and small which I can’t tell if I rename the file. A lot of people say Gaia HQ is better, I agree. No doubt. But with less details added, I don’t think it’s worth my time to use Gaia.

Cut the clip from the original video including audio BEFORE using VEAI. Then it’s a matter of literal seconds to add the audio back in. You’re making it FAR more difficult than it is.

I can confirm that the Theia models work very well with anime.

I just investigated Artemis HQ again to verify what you said about color smooth out. And surprisingly, it doesn’t seem like that. I believe the problem is the color/gamma change of the preview. However, the output videos are pretty good with no gamma error like the one in the preview. Gaia HQ is pretty good, but if your source is not good enough, sometimes, it introduces you more artifacts that I’m pretty sure it can cause motion flickering. So I tried Gaia HQ and Artemis today, they are almost identical. But I prefer less artifacts than more details (Artemis > Gaia). It’s also not worth having double in rendering time. Therefore, Artemis HQ v11 is what I choose for blu-ray movies the most. Since Artemis chooses to reduce AA and slightly sharpen the edges, Gaia HQ in contrast does less in AA (what? why?).
But the problem that I’m having in 2.0.0 is the compression CRF. It seems weird when the output should be the same for 1 video. I use CRF 16 all the time on a 6gb 25m movie. First run, it gives me 38gb output (really?). Second run again, now it gives me 13gb (which is the size I need). Only Artemis models do this. Gaia HQ is fine. I think it is a bug.

Are you saying AHQ is faster that GHQ? When I use it I get half the speed of GHQ upscaling 540p>4K. I assumed as it was doing way more smoothing than GHQ so it made sense, but how are you getting the reverse?

Using AHQ in general is like going back to pre ver. 1.70. Am I missing files or something?

Artemis preview will give you higher gamma. Gaia preview has lower gamma. This is just the preview that does not affect the output at all. Higher gamma makes you feel that the video has less details, but that’s not true. Lower gamma will highlight more details. But as I compared 2 outputs, no major differences anyway. I believe it’s happened since version 1.8.0.

Feature request: Would love to have the ability to side by side compare frames from the different AI methods.

2 Likes

Sharpen AI V3.0

Sorry if this the wrong area but not sopending lots of time hunting blogs

Using IOS High Sierra program upgrades OK but then is slow and finally crashes. Does the same as aPlug in. Now having to uninstall and return to V2.

Disappointing

SteveL

Yeah, it’s the wrong area. Good luck on your blog hunt.

1 Like

Here… Sharpen AI v3.0 - #12 by topaz-127219

Many thanks
Carlito and apologies again for posting in the wrong place

Regards

SteveL

1 Like

Thank you. So GAIA HQ is the best to retain original detail and upscale. I have done only a few comparisons and it seemed GAIA produced better output without artefacts. In the case of Artemis HQ the model introduced some artefacts. But I have very limited experience with Full HD upscaling so shall check a few more clips, for instance recorded using tripod. The drawback of GAIA is speed, one has to have really very fast workstation. By the way, have you compared GAIA or Artemis HQ with what a 4K TV set can do? I wonder if there is clear difference.