VEAI Models + Performance Guide

Read new method for upscaling with less to none artifacts here.

Is Gaia CQ a typo? Do you mean Gaia CG or Gaia HQ for the 480p ā†’ 4k upscaling method?

Yea, sorry, Gaia CG.

Thank you for this detailed guide! I was just going to ask if something like this existed.

Hope you find it useful. Thanks.

Is it planned to update your performance guide for Protus v1 & v2?

1 Like

Because each video is unique. It would be hard for me to tell other users how to use it correctly because not everyoneā€™s taste is the same. The model is just for people who want to customize the sliders. But for me, I still use Artemis and Gaia for now because those models satisfy me a lot already. Because Proteus is about customization, it depends on users themselves.

1 Like

No, NVENC is no good in any form, used for anything, at any time. It makes unnecessarily huge files in all cases. Itā€™s simple pointless to use.

Iā€™m new to VEAI, bought 2.4 about a month ago in order to upscale downloaded old Mediathek films and some private videos taken with my Olympus MFT cameras in order to fit my monitor (50 FPS, 2560x1440).
The Material downloaded is not interlaced. Therefore I tried AI models: Artemis LQ,MQ, Gaia, Proteus, and Theia.
My PC configuration is: AMD Ryzen 5PRO4650G (6 Cores, 12 Threads), 32GB RAM, SSD, NVIDIA GTX 1650, which works fine consuming only 100 to 130 Watt/hour.
I experience around 1 sec/frame processing time with Artemis and Proteus. That is ok, charging the CPU at ~8%, and GPU at ~95% (at 2,2GB GPU memory,
<72Ā°Celsius).
45 minutes film lenght takes about 40 hours processing (awfull, but tolerable for me because running in background while doing other Photoshop etc. work).
With Gaia an Theia I found no difference to original upscaling without VEAI models.
With Artemis I got awfull flat faces without structure.
For the moment I use Proteus with my own settings. That seems to deliver the best compromise with only marginal artifacts in faces.
What should I do for getting better results?

I bet your PC specs is just slow, so itā€™s kinda normal actually. You might want to upgrade if you really want to speed up VEAI.
Theia is not good imo. And Gaia is only for noisy footages, and it worksā€¦ okay. I mainly use Artemis all the time because itā€™s better. Depends on your video, but if artifacts are presented, then you can try Artemis Aliased and Moire.

Thank you for your feedback.
Speed is not the primary issue but quality.
I tried Artemis Aliased and Moire but was not satisfied.
I found out that Artemis Dehalo (with Grain at 2 and 2) seems to be the solution for this material (faces not completly flat, not as sharp as Proteus customized but without artefacts).
Now I experiment to process 2 videos in parallel (CPU load 3%, GPU load 95% GPU memory 2,7 of 4GB). Processing time alternates 1 to 2.4 sec/frame, what I consider tolerable for background processing, enough capacity for regular foreground applications.

Not sure if this is the right place, but I did a lot of testing over the last couple of weeks. Since I still canā€™t post any pictures, youā€™ll have to take my word for it :wink:

Artemis HQ v12

  • IMO the best AHQ thus far (together with AHQ v10), ever so slightly less sharp compared to v11, but with a lot less mosquito noise (talking lips) and overall very pleasant characteristics, probably my new favourite model

Artemis MQ v13

  • unfortunately, this oneā€™s gotten worse since v12!
    It re-introduces weird artefacts in out-of-focus areas, almost like in the good olā€™ days. AMQ v12 is much, much more pleasant to work with!

Artemis LQ v13

  • much better than ALQ v12 (unlike AMQ v13 -vs- AMQ v12).
    Very fine and smooth and still good surface detail, very well-behaved in out-of-focus areas.

One caveat, though: The low-end Artemis models seem to have a tendency to sample-and-hold movement patterns for a few too many subsequent frames. This makes people ā€˜grimacingā€™ while talking and moving their heads at the same time. Itā€™s particularly bad if the video source is of low quality and very soft (unsharp) or blocky.

Artemis LQ v13 is still afflicted with this ā€˜holding patternā€™ and weird grimacing.

Gaia CG v6

  • sharper than v5, but it produces a weird, grid-like overlay. As if the video was shot through fabric. Gaia-CG-1.0.1 is still the king of the hill (v1.5.0 ā€¦ v1.6.1).

Gaia HQ v6

  • I am having a hard time telling the differences between v5 and v6, they look much the same.
1 Like

Iā€™m pretty sure Topaz abandoned Gaia models already because the v5 hit their limit of perfection already. Any changes will just make it worse. All models have artifacts, but Artemis HQ v11 and MQ v12 are what Iā€™m using the most. Gaia HQ v5 is pretty good for DVD sources, but just donā€™t zoom in for the artifacts because itā€™s not worth it or visible at any viewing distance. Artemis + noise is the best bet for almost no artifacts. Gaia + little noise will also do the same, but not as good as with Artemis. Gaia CG should stay at v5 because it is for what it is, but still need more sharpness in overall.

1 Like

What about Proteus v1 or v2? Any comparisons?

I think this model is not for comparison because the result is vary. But I can say Proteus v1 is better. Proteus v2 has more artifacts.

Thank you. I have been playing with my clips and Proteus v1 have been introducing some strange artefacts on small stones etc.

It really depends on the footage, bitrate, texture, noiseā€¦

I know, I am thinking of my types of clips.

You could be on to something here.
Fun fact:
I found a copy of VEAI v1.2.0 the other day and tried it out.

5 models: Gaia-HQ(v1.the.original), Gaia-CG(v1.the.original // not to be confused with Gaia-CG-1.0.1 // VEAI v1.5.0 ā€¦ v1.6.1 //), Artemis-HQ, -MQ, -LQ

Gaia-CG(v1.2.0) and todayā€™s Gaia-CG(v6) are virtually indistinguishable, they produce exactly the same smooth sharpness and texture (grid-like artefacts).
When I compared the same video frame with both models, I couldnā€™t tell them apart.

Artemis-MQ(v1.2.0) used to be groundbreaking in the early days with very efficient noise reduction, but is relatively crude by todayā€™s standard. Modern filters like AMQv12 or even ALQv8 do a much better job.
Still, it was the best Artemis model by a long shot.

I have been playing around with Theia settings in the past and found I couldnā€™t muster the patience. Iā€™d rather test a couple of fixed models on a given source. Itā€™s a trial of patience.

Perhaps next month. I have the models here, but fine-tuning 6 parameters sounds like a nightmareā€¦ My early tests with VEAI v2.3.0 (Proteus v1) didnā€™t look very promising (default settings). There are always parameters I never asked for and other parameters that are sorely missingā€¦