TVEAI 3 has huge problems, its future

lhkjacky · November 17, 2022, 12:14pm

Developer has explained that why they need to develop a new VAI 3.0 in the post below.

Most of the problems in VEAI stem from the fact that it treats video as a series of constant rate images. All the current models run on these assumptions and as a result have issues processing variable frame rate videos, frame repeats, scene changes etc. This also hampers development of future models like stabilization, scene detection etc. that require multiple passes over the video.

To address these concerns and allow seamless additions of new features, we have decided to rewrite VEAI as a new application with a whole different architecture and way of doing things. Starting today and over the next few weeks we will be sharing various alpha and beta releases of VEAI 3.0 in this category.

VEAI will consist of two independent parts: the GUI and the backend FFmpeg filters. The GUI will merely call the FFmpeg backend and spawn separate processes. This will finally allow VEAI to utilize the newer RTX 30 series GPUs to their full extent. Currently users have to use multiple instances of VEAI to optimally use the GPUs.