8K 360&VR processing

Topaz Video AI General
1

Hello Topaz Team & Community,

First off, thanks for creating such outstanding software! I’ve been using Topaz extensively for the past year on older film footage and 4K videos, and I haven’t found any comparable alternatives—truly impressive.

Recently, I’ve started working with newer cameras like the X4 and claf VISINSE, which output 8K footage, and I’ve noticed a significant drop in processing efficiency. To illustrate, a 10-second clip in 4K typically takes about 4-5 minutes to enhance using the Proteus model at 60fps. However, the same clip in 8K is taking approximately 2-3 hours.

I understand that processing 8K footage involves significantly more data (approximately four times that of 4K), but this jump in processing time seems unexpectedly high. I’m currently using an RTX 3080, and I wonder if this performance gap is primarily hardware-related (perhaps memory constraints) or if optimizing 8K footage would benefit from specific AI models.

I’d greatly appreciate hearing from others in the community regarding their experiences and solutions when handling 8K video with Topaz.

PS: Additionally, I’m happy to start discussions on special considerations for processing 360 and 180 VR videos, particularly related to stabilization features, if there’s broader community interest.

PPS: I could not search in forum for “8k” as the search system needs more characters to start search. Guess this way many of 4K and 8K searches did nod resolve.

Best
Sergej

2

While Video AI is able to import and process 360° videos, our models are not primarily trained on equirectangular footage and we cannot guarantee 100% compatibility when used with VR video inputs.

For the same reason, we also cannot guarantee that 3D SBS inputs will preserve their 3D alignment when processed. Several users have reported excellent results when using Video AI for 360° and 3D video, but we do not consider these videos an “officially” supported use case just yet. You will likely need to re-inject 360° metadata into the output file after processing. This tool will re-write new 360° metadata on the upscaled video.

In regards to handling 8k footage, yes there is a lot more data which will require longer processing times but this also requires more resources and a RTX 3080 is going to struggle as will many cards.

The team is actively working on optimizing the models and the app for use with many different GPU cards and to work with larger video resolution files as the industry shifts to higher definition.

This will be something that will be on the list to continue to push towards.

1 Like