Starlight in Topaz Video 1.0.2: Eye glasses disappear and reappear

[hi8upscale]

Topaz Video 1.0.2 on Win11 with RTX5080:

Source is an old digital camcorder video, 1280 x 720 px, deinterlaced, 50fps. Using the local Starlight model (aka “Starlight Mini”) to upscale 2x and 3x (UHD).

Example scene 1: A person with eyeglasses is walking towards the camera. The head/face is smaller at the beginning and larger at the end of the scene.

Issue: As the person walks toward the camera, the glasses disappear and reappear several times. Unfortunatelly, this is not temporal coherent.

Example scene 2: Some people are sitting around a table talking. Some of them are wearing glasses.

Issue: When people wearing glasses turn their heads slightly toward other people at the table, the glasses disappear and reappear.

How many frames before and after the current frame does Starlight analyze to improve the faces? Is there a trick to avoid such inconsistencies? For example, is 25 fps better suited than 50 fps for temporal consistency with Starlight?

[urix.lookin]

@hi8upscale

is 25 fps better suited than 50 fps for temporal consistency with Starlight?

It is indeed. Starlight has a limited number of frames to analyze.

25 FPS means this time frame is doubled.

[kyle.topazlabs]

This can happen at times depending on how the model is seeing the face and glasses. If it does not see the frame of the glasses consistently, it can interpret and remove them as it focuses on the facial details.

The research team is working on further development for all of the models in areas like this.