Add a AI model for motion blur removal

SD footage, especially one done with old DV cameras often has excessive motion blur in comparison to current HD and UHD cameras.
This can become a bottleneck when it comes to enhancing the quality because while still scenes appear sharp things becomes excessively blurry on movements.

Topaz already has an algorithm inside Sharpen AI that fixes excessive motion blur on still photos and I would suggest to adapt it to VEAI.
This could be a seperate model, or more convenient a slider on other models that controls the amount of motion blur removal prior to upscaling.
Incorporating it into the Chronos models would also be a good fit because higher frame rates usually mean higher shutter speeds.

1 Like

Revisiting this one to cast my vote and add an example of what can be done. I have run into this problem with a lot of footage. Sometimes I have something where I filmed at 30 fps (1/30 seconds per frame) but the shutter was clearly set to something like 1/60 seconds. This has always been a standard recommendation for “natural” looking footage, because it leaves some motion blur in each frame when a subject moves, like waving their hands around or swinging a baseball bat. Looks great in the original footage, but when you want to slow things down 15 or 20 years later (as with FlowFrames or Topaz Chronos/Apollo) the interpolator just interpolates the blur and it looks very unnatural.

Even worse with camera shake.

I recently found this paper for a tool called CDVD-TSP (GitHub here, with link to their paper: GitHub - csbhr/CDVD-TSP: The repository is an official implementation of our CVPR2020 paper : Cascaded Deep Video Deblurring Using Temporal Sharpness Prior). This uses information from nearby frames to identify sharp versions of blurred features in order to maintain maximum sharpness and clarity in video clips.

I was able to get their model running and with their pretrained model I get pretty good results on certain pieces of footage (some are too far gone though). Their training seemed to focus on hand-held footage, so it is great for that type of camera shake, but it’s bad if you have footage of, say, a baseball game where you had the camera on a tripod and all the blurring is due to subject motion. It seems to do nothing in this case.

1 Like

Ask if you could become a betatester.

Thats what @nipun.nath is looking for.