Best set of model to upscale videos containing human face

[lhkjacky (Jacky)]

@rhs4shr

Are there any known AI tools that do that already

There are several AI tools have built in face enhancement AI model for video,
Such as, AVCLabs Video Enhancer AI , HitPaw Video Enhancer, CodeFormer Video Enhancement, etc.

However, (last time I tried) they only treat each frame as seperate image. Therefore the result can vary significantly depends on source. If the subject is looking straight toward the camera with little movement, the result is pretty good. But if lots of motion blur & subject movement, the result is horrible.

If you want VEAI / VAI to include face enhancement model, please “Vote” here.

Face Reconstruction (Refinement) for small faces

It would be great VEAI included some kind of face reconstruction for face detail. When VEAI detect faces in scene, it should use a specific AI model to upscale the face. Human is very sensitive to human face, currently VEAI upscale footage without restore face detail and it often create monster faces and ruin the footage completely.