In this new version, we aimed to expand the capability of the current Proteus by handling more severe cases (e.g. more noise, compression, etc) and more input video types (progressive, interlaced, and interlaced progressive). This version can also enhance human faces better than the Proteus v3. While the Iris model is dedicated to face enhancement, Proteus v4 would be the model to handle all face and non-face inputs equally well. Please test this new version and let us know your comments.
Changelog from Proteus v3
Handles more noise and compression
Improves faces
Works on interlaced and interlaced progressive videos as well
Better results on Auto
More details and temporal consistency
Send us your feedback
Please let us know what areas you suggest to improve
Submit Files :
– Send us a short few seconds of input video and the corresponding output
– Share the ffmpeg command or settings that you used
– Leave a short note on what was the issue (e.g. artifact) or what you want to improve
– Any comparison video/screenshot with any of our existing model
Please also share what you like about this model so that we do not compromise that aspect of the model in the next checkpoint
Great! Now we just need the “preserve text” functionality from TPAI to help with watermarks on video from getting over-processed with the likes of Proteus, that does really well with many other things.
My initial observation of Proteus v4 is that dehaloing/denoising seems to be extremely strong (even if manually set to zero), and can remove significant detail.
Edit: The strength of the dehaloing seems to be the overriding feature.
At last! A model to replace the old Proteus v3!
This model seems to do a better job in details than Iris - although Iris seems to do better in some ways.
Here is a comparison of the original vs Proteus v4.
Proteus v4 seems to do a better job on the bird than Iris, but it also adds a texture that wasn’t there to the leaves. While Iris makes leaves look more like they’re supposed to.
I initially tried 480p to 1080p, on a low to mid quality source (somewhat oversharpened VHS transfer). The dehaloing removed a bit too much detail and made the output a bit soft, even with high sharpening and debluring. Probably better off with Iris v2 or Proteus v3 on that.
I’ve since tried 540p to 1080p, on a better quality source. The dehaloing is less intrusive and the output seems free of artifacts, but not something that couldn’t be achieved with Proteus v3.
At the moment I’m not seeing a reason to use this model over another. When I’ve tested more I’ll try to put some images together that show this.
Tests in FFMPEG’s testsrc.
Color borders distortion is reduced when compared to Proteus v3, Iris, etc.
For example, it is easy to see the difference in distortion between light blue and purple, and yellow and yellow-green.
I will test how the effect will be seen in the real video.
I made a complete model download via the download manager but even then it was loading a model before I got a preview!
When I adjust my enhancement settings the zoom level of the preview and original is reset.
The generated preview is only shown automatically the first maybe three previews. The next previews are not shown before I actively select them from the list (same behaviour reported to the recent beta). Switching to a different model sometimes solves the issue temporary (maybe for another three previews?).
When I move the view point via mouse and the mouse reaches the left edge of the preview the preview resets the zoom level (reported before in different beta versions).
I can sort the exports in different orders but not the Previews, for example to show the latest preview on the top!
things and faces in the background are sometimes replaced, faces by sharp zombie like faces. sometimes only the eyes:
thank you for this proteus v4 model, it seems to work miracles on my sd sequences and even my go pro sequences, or old sd clips. it preserves all the details and improves the face much better than iris in my opinion. I will continue to test it
After further testing I still prefer Iris LQ for difficult material as it has less artificial “details” and also much less “crawling ants”.
And less plastic/oil paint look (with the right settings).
Wish there was a way to increase temporal stability regarding noise. I still see “shimmering” with stationary objects. That and compression artifacts, even when set to 100 are still an issue with Proteus v4.
