Face Recovery for VEAI?

Do you guys think face recovery will be added to VEAI? The new face recovery option in Gigapixel AI is miles better than face enhancement. Adding this into the models in VEAI would really improve the quality of upscaled videos.

5 Likes

According to Developer, :grinning:

If you want Face Enhancement for VEAI, you can Vote here. :smiling_face_with_three_hearts:

7 Likes

I would love Face Recovery for video, but I would assume that face detection is a difficult problem. With individual pictures, you only feed it pictures that have faces in it that you want enhanced. With video, some frames don’t have faces or the face isn’t the main thing on the screen (it’s not large and centered).

Having played around with Deep Fake software, you get bizarre results when the face detection is a little off as it would try to paste a face on something that is not a face. So even if you correctly detect faces 99% of the time, 1% of your frames with “bad faces” on it makes the video clip really jarring, so you need to do a lot of manual work to fix those frames.

1 Like

I’m just thinking out loud here. It would be annoying, but as an option maybe they could let you put a square box around the faces you want to enhance. That way you wouldn’t get false positives. But you’d have to do that for the entire video, which would be a pain. Ideally, the ai will get smarter and smarter so that it is able to detect faces properly.

1 Like

I’m just trying out the new face recovery feature and it’s great! But when I convert a series of images from a video, it is not constant between the frames and it would be great to see it in VEAI. It just occurred to me that you could use the individual generated frames to train DeepFake and use it for fluid videos as a workaround?
I’m not sure but I think DeepFake has then other artefact problems?

EDIT: or maybe I can try cronos-model and blend the frames together?

Just want to take this opportunity to say VEAI is in the habit of ruining faces (and human skin altogether). Often faces/skin get the ‘goldfish skin’ treatment: a plastic-y, shiny, pink-ish surface, with the occasional blue in it (veins?).

Seems the ‘I’ in VEAI is not yet nearly as intelligent as portrayed. While it’s overall responsible for an excellent result, human skin often ruins the job.

2 Likes

I’d like to add my plus one for requesting face recovery in VEAI.

1 Like