Now that I’ve been using Starlight-mini to restore old 8mm films, I’m running into limitations of Chronos & Apollo. 16FPS doesn’t look good with the beautifully upscaled video, so I do a framerate conversion to 30 or 60 fps. Problem is, with significant movement Chronos & Apollo both have real problems. You end up with strange warping and crossfading that doesn’t look anything like motion.
I realize it’s a very different problem space, but the power of Starlight-mini gets me wondering if something as dramatically powerful as that could work on framerate conversions such that even significantly different sequential frames could be interpolated without so many artifacts.
You can see that the fake videos generated by the diffusion model are getting smoother and smoother, optimistically it is expected that the diffusion based model will also give better frame interpolation result, it just seems to require more resources to develop but not many people are focusing on this.
That was fun to test, but it’s just RIFF 4.6 with less options and not as good as Apollo in my tests.
I’m pretty sure RIFE 4.13 exists and it’s still not as good as Apollo.
