We pseudo-created a new Starlight model (not)

we had an issue on the work today. wanted to proccess a video and starlight mini erased many details on the one hand and starlight precise created too many details and make faces looked wrinkled and some weird unwanted grain on walls was added there too. so load it on nyx and it was a little better. but still the ultimate solution would be something between this and starlight mini. so we had that little crazy idea to “make” it that kinda worked. load on a premiere sequence starlight mini bottom, starlight precise (with nyx) on top and reduced the opacity to precise! anticipated result achiveved! yes it’s a very time consuming solution but the best we could come up as of now!

thought someone could be helped with this proccess

welcome to the level 2 of restoration :slight_smile: wait till you layer 4 or 5 versions, each one responsible for particular luminance or color ranges :monkey_face: let alone mask based compositing of fore/background details. it’s a rabbit hole.

I do this with images.

Layer 3 Models on top of each other.

If you count all other AI models, i use seven AI Models in five apps. :face_with_spiral_eyes:

Oh no, now I have to use the overlay method again—I did it in the past when we didn’t have diffusion models. Time consumption killed me, please don’t give such ideas :wink: Honestly, I always hoped Topaz would eventually move in that direction—using a layered upscaling approach, because that’s exactly where the real gains are.

it’s pretty much unavoidable for some types of footage, e.g. where you have real life + cartoon or cgi combined in the same image (remember roger rabbit). i run 1 pipeline for the real life parts and 1 pipeline for the cgi elements, putting them together in the end with resolve’s potent masking tools. i’d guess it’s a long way until we have some truly universal restoration models at our disposal.

IMHO, Starlight Precise goes a little too far if your original is halfway decent. Try Starlight Sharp - it will clean up the original a bit better than Mini and not emphasize small details/patterns as much as Precise. I upscale old SD TV episodes with Sharp to upscale to 1080, followed by a Proteus run that reduces any remaining noise and corrects for aliasing while upscaling to 4k.

Starlight Mini followed by Nyx is what I did before we got Sharp.

It was my way of dealing with the softness too:

SL mini first, then Proteus Natural to 1080p from SL and Rhea to 1080p from SL too.

Overlay Rhea over Proteus with Rhea opacity of 65%, add Unsharp mask and noise to Proteus layer.