Remove Jittery Motions create frequency artefacts

The “Remove Jittery Motions” in the “Stabilization” module has big trouble with certain kinds of motion creating crisscrossing horizontal and vertical lines. This renders this function useless for many types of video where this function would be very useful.

One of the areas where this function shines is in correcting athmosferic heat disturbances, where it manages to correct some of the undesired frame-to-frame movement. Especially when using telephoto lenses and magnification under those kind of conditions.

Look where the reindeer is kicking the snow. These artefacts are consistent through all videos/frames where there is fast moving objects/details.

I have tried this extensively, with different kinds of videos, and with very various settings. The horizontal and vertical grid pattern anomaly is exclusively linked to the “Remove Jittery Motions” function. All other settings, frame interpolation and other enhancements only seems to enhance this issue, rather than create it. The actual system profile doesn’t have anything to do with the issue, only the algorithmically features of the function itself. Frame by frame, video by video, it appears whenever there are fast moving details/objects.

As I understand this is that the “Remove Jittery Motions” function try to stabilize the pixels in each frame horizontally and vertically at a certain distance from the detail. When there is movement in the scene that is not consistant with the previous and next frame (movement too fast) it introduce these artefacts, completely destroying the benefits of this function. It’s always fast moving objects that cause this, while slower moving objects are rendered and corrected just fine.

My suggestion to solve this problem is that there is a test that detect this pattern of horizontal/vertical lines (not present in the original frame) and turn off processing on those affected pixels where the artefacts appear. When there are areas with fast movement, this function isn’t needed at all, and can be turned off locally. I think that an approach like this might solve this problem and make this function shine in all it’s glory. It is in fact a very good feature that solve problems that can’t be solved in any other tools this easily, if you only could get rid of those artefacts.

2 Likes

Thanks for this detailed report! Our dev team will look into this artifacting and see what can be done to improve the quality of results from the Remove Jittery Motions filter setting.

For now, running a single pass of the Remove Jittery Motions filter instead of two should reduce the size and frequency of this pattern on output videos.

1 Like

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.