Upscaling with better detail using Proteus in TVAI v3.x

This is a discussion of a technique for getting optimum detail rescaling using Proteus. Your participation, and suggestions are welcome.

4 Likes

Hi, can you demonstrate ā€˜recover details’ by posting comparison images? I like dehalo for getting rid of over-sharpened artifacts, but I see that it softens surface details, rather than enhancing them. Would like to see your examples.

Did you get 3.1.0.2b. And do you have a 30 series card. If so did you get the 30 series install? If not did you accidentally get the 30 series install for a non 30 series card

ah weird

It’s all very electric and dangerous…
:nerd_face:

1 Like

I was hoping to get some advice on workflow to bring DSLR safari footage 720p or 1080p up to 4k. I like proteus relative to auto to boost details and dehalo, adding grain helps as well but I do all this in one go. Also adding low value stabilisation with reduce jittery motions AND Rolling shutter Correction tends to find more details due to interframe detection. What you guys use?

Obviously this depends on the source footage but I was having an issue where the source (1080p) had a lot of noise/grain and proteus was destroying details on faces (wrinkles, freckles etc.) to remove it. I found the best way was to first do a 1x pass of Artemis HQ to get rid of a lot of the noise but preserve the details, and then run that through the 2x Proteus with some fine tuned manual settings. This resulted in Proteus being able to remove the rest of the noise and enhance the detail instead of removing it.

1 Like

Nice topic. Please share your workflow :slight_smile:

Nice idea.

Thank you for posting this. It’s a good demonstration and I see what you mean. My material is more people focused rather than landscapes and architecture, so in my case, I find none of the Artemis models retain the detail I would like, dehalo included. Things like hair, clothing, skin.

I do use the older Artemis 6, 7, or 8 models sometimes (in VEAI 2.x) and those do a better job on some types of footage, but they don’t clean as well.

1 Like

Do all the sliders of Theia work for you?

Okay but do they do anything? Only Reduce Noise applies sharpening for me. The others don’t do anything.

Not trying to hijack from Proteus, just I’ve been waiting for Theia to work again so I can see how well it works in combination with Proteus.

I dont understand why is Theia still kept in Video AI, I havent found a single case in which Theia did anything to any of my videos

1 Like

Stay away from Theia, and your problem is gone (btw no problem with Theia on my PC)

I just run my tests with this new version, but it has been broken for awhile now. This version did nothing to fix it. For example, do a clip with Sharpen set at 100 and then with it at 0 and they will come out the exact same. All sliders used to do something in the Early access versions, and maybe up to 3.0.2. Now only Reduce Noise does what the Sharpen slider should do.

I’m starting to agree with you. They disabled Apollo over less than this.

2 Likes

If your installation exhibits more than one or two problems like this, it may be useful to do a clean uninstall and then reinstall. If the problems persist, you should definitely report the problem via DropBox.

Also, an inquiry into whether others are having the same problem in the main discussion for release the corresponding release of v3.x.x will be helpful for getting it fixed.

Just now (I know most know this for a long time) realized that quality of previews is dependent on the export settings for the codecs and bitrate. I was having issues with banding in flat areas and was working my ass off to fix it with proteus relative to auto, all I had to do is switch to ProRes to see the clean preview of the settings…

2 Likes

Also I’m pretty sure the preview percentage does not take into account screen scaling. I have my 4k monitor set to 125% and 100% in VAI is definitely bigger than it’s supposed to be

2 Likes

Interesting. I believe TVAI displays 100% at a 1 to 1 pixel basis. This means that at 100% the image will always be the size, regardless of whether TVAI is running in full screen mode or partial

It may be necessary to do a sanity check by resetting the Windows system magnification to 100% and then check the GPU driver for any magnification/alignment settings to default. - Finally make certain your monitor isn’t set to do any kind of rescaling on its own.

If everything is now set to default, your system should be capable of displaying a video in a (simple) video player, such as Windows Media Player maximized to full screen.

Using the Media Player, open an FHD (1920x1080) video.
Set the media player to play the video at 100%. This should take up the exact number of pixels to display FHD. Now change the media player to play back at 200%.

If these both show correctly, close Media Player, open TVAI and try displaying the same video on it at 100% and/or 200%. - If things are working correctly, the video image should be the same size.

Side note: If your Windows Display settings are set to magnify fonts, etc. that should not effect the resolution of an image on the screen. If the Display Resolution is set to ā€œrecommendedā€ which should correspond to you monitor’s default resolution, there should be no problem.

TVAI will display an accurate representation of the work you’re doing. However, If you want to know how it’s really going to look, you need to set TVAI to use an external playback app.

(Strongly suggest that the external player you choose has its ā€˜video enhancements’ turned off.)

1 Like