Hi All,
Totally new user. I’ve preordered Video AI v4 and I’m just wondering if anybody is using it to upscale their videos from the Insta360 OneX2 and what your workflow is?
Are there any videos or instructions on this?
Many thanks.
You can upscale both 360 videos and flat videos in TVAI. For flat videos it’s relatively simple, import the video, try out some different AI modes, pick the one you like the most, and export it.
For 360 videos, it can be a little more difficult. 360 videos are just saved as a “flat” video (making them easy to edit). And when you watch them, they open up in a 360 video player which basically takes your video and projects it onto a sphere.
Due to how the videos are saved, there are “seams” (E.G. There is a seam where the left side of the flat video meets the right side of the flat video on the sphere). If your camera is good, you won’t be able to see those seams.
But this is an issue for TVAI. To my knowledge, TVAI doesn’t know that the video should be projected onto a sphere and wrapped around. So when it applies enhancement, it ignores that fact which can result in the seams becoming more visible (because different enhancements are applied to each side of the seam). Note: I personally haven’t done this, so I don’t know how drastic this will be, and it will depend on which model you’re using with which footage.
As a user, you need to deal with this issue. And I have an idea on how.
Make your video repeat so there is no longer a “left side” and a “right side” with unique information. They should have the same information.
To do this, open your 360 video in flat mode in a video editor, place a copy of the video on the right, and another copy on the left. Then trim the left and right side so you only have a “little bit extra” on each side compared to the original. Then export it.
Enhance that video with TVAI, then take it back into a video editor, trim the extra bits off (probably blend the extra bits in on each side), then export it as a 360 video again. This should hopefully reduce the visible seam that may come from applying enhancements to a normal 360 video.
You could also try reducing issues at the top and bottom of the video as well using a similar technique, but I don’t know how well that will work.
1 Like
Actually the video is probably just losing it’s “spatial media” information. I run Linux so I don’t know about the “360 viewers” people use on Windows but you can watch 360 videos in VLC if they are injected with spatial media metadata. Google has an open source tool to do this, I don’t use it often but it always seems to work fine.
