Topaz Video AI Beta v3.3.4.0.b

OK, I’ve been using RIFE 4.6 in lieu of using TVAI’s severely bugged interpolation model for my videos that cannot be interpolated by TVAI due to a severe frame duplication bug as it ADDS duplicate frames when you input videos with non-standard frame rates, that have either been initially set or as a result of removing duplicate frames from your video, before processing with TVAI…

So I am forced to rely on RIFE 4.6 to accomplish the task of including an interpolation pipeline with videos restored via TVAI, and I’m here to tell ya…

RIFE 4.6 absolutely SUCKS in comparison to TVAI, hands down!

As TVAI actually generates new images to transition between key frames, much like what is done with animation interpolation, similar to RIFE as that model also generate new images, but it only interpolates animated components of the video, while treating some non-moving parts as a singular component to be duplicated.

RIFE would only generate moving parts between frames while duplicating parts of the figure if it doesn’t move significantly across the animation, so it will default to duplicating parts when it can get away with it, as it only interpolates active moving components.

Visualise a shadow puppet, where the limbs move and are articulated, while the main body of the puppet does not articulate.

Whereas TVAI interpolates the entire subject, not just the specifically moving components…

This is, however, my layman’s explanation, as I’m not a developer, so I’m only going by comparing frames from interpolated video results.

1 Like

Hmm interesting. Hope they fix the interpolation models really soon as Im getting dupes when going 15fps x4 to 60
For my projects I’m still using DAIN in DAIN-App (not in Flowframes for example) DAIN has better motion estimation I guess but slightly more artifacts and distortions than RIFE. But RIFE creates stuttering in certain scenario’s and for my footage it’s very noticable.

Try DAIN :wink:

1 Like

Ahh, forgot about DAIN, yeah I’ll give it a go, thanks for the suggestion!

1 Like

GMFSS Fortuna Union for any anime :wink:

1 Like

Hmm, I don’t do anime that much, however, I’m pretty sure, and/or hopeful that it is specific with its interpolation, as precise and accurate key frames are an animation’s bread and butter, so I’m hoping for some positive results with live action videos!

I encountered a downside with this, you cannot input your frame choices as it only interpolates at 2x=60 frames, I often interpolate certain videos to 10x=240 frames, however, the real-time display of the resulting interpolated video looks INCREDIBLE, hopefully, it will retain frame accuracy when I re-interpolate the resulting interpolated video, so I’m hoping I can get 240+ frames by using this method…

And, HOLY F****, I see no artefacts, and even the moving limbs/hands have been interpolated, and aren’t blurred out of existence, looks like Flowframes is out of my pipeline!

I also found out the reason I detest RIFE so much, as it’s based on optical flow, an incredibly sh**** interpolation model, god do I despise optical flow with its wretched artefacts and cheap half-assed interpolation techniques!

I got carried away, and forgot to thank you profusely for suggesting this incredible bit of software, looks like I’m getting the Patreon version ASAP, THANK YOU SO MUCH FOR THIS!

EDIT: And holy sh** is it FAST! CAIN>RIFE

2 Likes

I thought you’d like that one. :clap:

1 Like

Yeah, the only real issue for me is that I have to re-do a sh**-tonne of vids! :laughing:

But seriously, Topaz should definitely take note, plus it’s good to have competition as it fuels innovation, and keeps companies on their toes, so they won’t rot on their laurels!

NOTE: I was not suggesting that Topaz is rotting on their laurels, I was just speaking about companies in general…

EDIT: While using CAIN, I still notice that while it is much better than RIFE, it still does not hold a candle to TVAI… So please, fix the duplication bug as TVAI is the best interpolation program out there!

What brand was the GPU that died?

Maybe good luck that it died then. I’m very happy with my Zotac Trinity OC 4090. Zero coil whine.

This topic was automatically closed after 60 minutes. New replies are no longer allowed.