I have tested the same thing on every version of topaz video ai i could get hands on. it does not work in any single version.
Problem - you have a video which is panning on a subject, subject is going sideways and camera is turning to follow it… instead of stabilizing the video, topaz video ai introduces a very strong judder. i believe it is trying to stabilize the background while making the subject jump around.
i will provide a sample file - try to run it with stabilization applied and see what happens.
hopefully one day you can fix this since this problem was present for years
Hm, I just tried it with the latest Studio release. Stabilization indeed does nothing - because what should it stabilize? Stabilization aims to remove camera shake which I don’t see. Your video pretty much already looks stable.
Applying stabilization breaks the video… it destabilizez it… i never tried with studio, but i did try with video ai 3, 4, 5, 6 and 7… all with same results
I didn’t say it’s a desired effect. I’m just trying to understand why you want to apply stabilization in the first place when the video was seemingly taken with a panning head. For smoothness you’d need a higher framerate.
Like I said it’s the same with cameras and tripods, some stabilization systems try to correct non-existent motion what then leads to jittery images. Lack of movement or vibrations can be misinterpreted as shake and then unnecessary corrections are applied.
In my test with the Studio release I didn’t notice any effect on the video. The AI releases are no longer in development anyway, so there won’t be functional updates.
the video can be smoother and more pleasant to watch. run it in premiere with warp stabilization and it makes it much smoother. but topaz can run in command line, big difference when you have 100 small clips to process
therefore i would like to see an app that can run in command line and can actually get same stabilization effect
Looking at this video the AI models are not seeing much in the way of unstable footage for it to address. Essentially the model does not see the clip as needing stabilization and then in the rapid movement as the rider rounds through the turn it is trying to lock onto the details in the background and stabilize those instead of the rider since the horizon is stable.
i dont think we need explanations, stabilization is broken and video is not smooth to start with. run it through adobe premiere and it makes it way smoother. run it through topaz and it breaks the video.
that is an obvious flaw/bug. i dont need anyone to tell me why this happens. i need it not to happen and video to become smoother not jerkier…
The way our stabilization model processes the video is very different than warp stabilizer, this is why they have different outcomes when being applied to the same video source.
Our model when applied is not going to smooth out the video as it is looking to lock details down and prevent them from moving in a manner that it reads as unstable. When trying to pan with the rider it is trying to read the background details and lock onto those.
This is a case where the source file is not going to work with how the model performs its task and I would recommend using a different tool or option. The models do have their limits on what they can achieve based on their training.
