Chronos should be able to detect scene changes and not try to interpolate them, it often leads to weird results if Chronos trys to interpolate between two frames that have no features in common.
You would think this would be simple to fix. Someone correct me if Iām wrong, but doesnāt VEAI already use an algorithm to detect scene changes in the upscaling models?
Currently Chronos only works semi-properly at 2x, 4x, 8x frame rate increases. By āsemi-properlyā it replaces a frame with a blended frame at every scene change. This is not typically visible at 48 or more FPS.
FPS changes that are not 2x, 4x, 8x are completely broken. Many extra frames are inserted and interpolation fails for every frame I checked- every interpolated frame is a blend. This happens when changing from 23.976, 24, or 25 to 50 or 60FPS.
Changing from 23.976 to 25 FPS seems to be ok though. No blended or extra frames.
On Apollo it would lead to even more erroneous results. Iām surprised so few people talk about transition detection, but itās important for proper interpolation, specifying the boundaries of interpolation without human intervention.
Iām surprised this is still an issue - I believe other free programs have this capability, youād think a premium piece of software would cover this use case.
the bug still happen in 2024
This is happening in a bad way to me. I was seeing 4-6 frame transitions upscaling and interpolating with Chronos Fast and GAIA. If I just interpolate 23.976 to 30 FPS without upscale it seems to only interpolated a single frame every couple of scene changes which usually isnāt notice, but the 4-6 frames was just awful. My source is a little blurry because it is a 1979 movie with some low light scenes, but it happens in pretty much every movie. Is this still being worked on?
Unfortunately I donāt think so. They are satisfied with the way it works. if you want you can edit the transition frames manually in a video editor to make the scene change smoother, or change the way it flows.
Apparently it actually is being worked on but it seems no significant progress has been made yet regarding scene change detection improvement.
This was said to me not long ago, when talking about multiple in and out points:
Did not saw your accurate returns
When used on documentaries, RIFE give me > results that Chronos/Apollo/Aion
Those last 3 have tend to generate horrible intra frames where as RIFE not but is slitghly more choppy
The āDuplicate Frames āReplaceāā has a huge impact. If you have it checked, it makes the motion worse in all ways. Since itās checked by default, I have to ask if you left it on?
Indeed
I left it off in both RIFE / TVAI, but if āonā TVAI gives worst result (on my side)
I also tried 23.976 ā 120 fps ā 60 fps : Fail
I resolved the worst of it by doing the frame rate change in itās own step. Then I go back and upscale. There is something funky though. I am seeing the Proteus upscale change my frame rate with frame interpolation off. This definitely shouldnāt happen. Itās frustrating because I getting the frame rate a perfect constant 30 FPS and then I run the upscale and end up with some weird variable 28.621 fps file because it dropped a bunch of frames. No idea what is going on.
Been an issue since v5.4 was released. Proteus and Artemis (as far as i know) drop frames for no reason. If you arenāt using Rhea XL or SDR to HDR models, download v5.3.6 for now. Except for Rhea XL and SDR to HDR it has the same models, but you wonāt face any issues with dropped frames.
You can download it here Topaz Video AI 5.3.5 - 5.3.6
Thanks, kinda cold water on renewal I did a few months ago.