Topaz Video AI Beta v4.0.0.0.b

Hello everyone,

We have a new beta available for testing. This beta is the new timeline + A/B comparison + favorites update!

The beta overhauls how you typically interact with Topaz Video AI. Instead of the typical input, output view that you are used to, now, you will have two views that models can be applied to. With these views you can build and compare different combinations of models to find out which model configuration works best for your original input. You can see more information on how to use this beta below!

4.0.0.0.b

Changelog from 3.5.3

  • Zoomable timeline.
  • Mark in/out instead of dedicated trim mode.
  • AB comparisons view: apply different filters to different views to compare them.
  • Favorites: Save a state of viewing to come back to later.

Known Issues:

  • Rotation causes app to crash.
  • Differing FPS values between views will cause playback issues.
  • Creating many previews during preview processing may cause black screen on player views.
  • Closing initial input causes app to crash.
  • Some preview/input transitions require a seek before it will update the player view.
  • Intermittent zoom related problems.
  • Panning related issues for right view.
  • Favorites may sometimes lose previews it once had, and then may intermittently bring them back.
  • Using “left” arrow key to seek back into a preview will not show the preview, just the input, despite being in the preview range.
  • Sometimes a view that is “original” will generate a preview.
  • Seeking in and out of previews fast will result in a very slow response.
  • Sometimes views will pause on entrance.
  • Long decimals in FPS value for favorites information.
  • Seeking/PlayNext/PlayPrev in slow motion area will not work as expected on the player.

Information about the beta

The main goal of the change is to allow you to make the best decision about what model configurations to use. To accomplish this, we think it’s best for the user to be able to apply different models and see the results side by side.

For example, you can apply Proteus to your A view and Artemis to the B view to see which one has the result you prefer. At any time, you can revert to the original input to compare with the original. This is different from before where you must apply one model configuration at a time and always be comparing to the original.

Details about how to use
The first difference is you must select which view to focus. If you click the left view, A will be highlighted. If you select the right view, B will be highlighted.

When you have a view highlighted, the models/filters you add to the view will be specific for that view. So if you want to see how “Recover Original Detail” works you could give view A & B Enhancement, then give them different “Recover Original Detail” values.

When you have made the changes to the filters you want to see, you can click “Process Next …” to see these two different combinations of filters applied to the input.

When you do this, a progress bar will be applied to the timeline. This is the area of the video where you chose to see the filters be applied. You can watch this section to see how the input has changed. At any time, you may right click a view and click “Reset to Original.”

When you have a combination of filters that you really like (lets assume it’s the filters applied in view A) you may click the A view and click export.

We think this is the best way to be able to find the best mix of models to get the best results possible. Let us know what you think about the new previewing workflow established with this beta.

8 Likes

we would say the first version of veai that existed, it is completely broken, the preview does not work, the frame is shifted, it is slow, and it crashes the software in 5 seconds of use. I have never had so many bugs with vai

1 Like

here same , crash in 1 minute

in fact as soon as the preview ends and I play the video, it crashes at that moment. sometimes when comparing A and B, after a while the screen goes black, and there is no more display either. it doesn’t matter, I just tested 3.5.3, it is faster than all the others that have been available until now even if the models are the same :slight_smile:

1 Like

3.5.4 hasn’t been released to the public or beta testers. As such we do not know what changed in 3.5.4 meaning it’s less likely we’ll test the things that changed in that version, and thus will be less likely to provide useful feedback on those features.

1 Like

First time running 4.0.0b on my Windows computer I get error messages about missing DLL files.
Second time running it, TVAI setups the environment and it works.

Note: The first time I ran TVAI 4.0 was by ticking the “Launch TVAI” option in the installer. The second time was just by using the desktop shortcut.


The labels explaining which AI model is being used for the preview doesn’t give useful information in some cases. E.G. All the enhancement models (Proteus, Iris, Nyx, Gaia, Theia, Artemis) are just called “Enhancement: (Manual)” or “Enhancement: (Auto)”.


The split previewing method is grayed out and can’t be selected in the main GUI. It can be selected in the Preferences.


The Split previewing mode, and Single previewing mode, don’t seem to expose options to change the A and B previews.


In the split previewing mode, the slider in the middle can’t be moved. I can be argued that moving the video offers the same functionality as moving the slider, but it actually makes it harder to see the differences.


The split preview line is much wider in 4.0 compared to 3.5.3.


There doesn’t appear to be support for “queing” previews. For example, if I want to compare Proteus to Iris in multiple videos in 3.5.3, I would:

  1. Select video 1.
  2. Choose Proteus and select preview.
  3. Choose Iris and select preview.
  4. Select video 2.
  5. Choose Proteus and preview.
  6. Choose Iris and preview.
  7. etc
  8. Once a few videos had finished processing, I would compare them.

This work flow doesn’t seem to be supported. Because when I select video 2 and change any setting, the generating of preview for video 1 stops.


There is no longer an option to select Show in Explorer when making previews.
This feature is very useful due to:

  1. the inconsistent behavior of the TVAI preview.
  2. It allows us to compare the videos in the software we like. For example, I like to check my previews in a fullscreen video player. Because the quality when watching the video normally is more important than a part of the video, a zoomed in version of the video, or a zoomed out version of the video (And with TVAI, I have to pick between one of these trade offs, but if I get to pick the my video player, I get more flexability).

I know I can select Show Preview Command and find the temp path there. But that’s annoying and unintuitive for the average user.


Is the Only Keep One Preview preference supported with this new preview system? It doesn’t seem like it.


There doesn’t appear to be an option to unfavourite something after favouriting it.


I experienced this issue.


Hi 20rushtonj, Thanks for your valuable feedback :grinning: Thats very helpful! Would you be open to have a meeting with me, I would love to show you the possible solutions to solve those issues, and gather your feedback~.

I would be open to having a meeting at some point. But it seems you’re inviting me to a Zoom call. I don’t have a microphone or camera connected to my computer and thus won’t be able to participate through “normal” methods.


I might be interpreting this wrong, but it seems you (and/or Topaz Labs) have some solutions planned for some of the problems I mentioned. Wouldn’t it be useful to post these possible solutions to this thread and/or a separate design thread so you can get feedback from the whole community rather than individuals like me?

It took me a while to understand how to use A and B previews, favorits etc. But now it works as intended. Great job done Topaz devs!

1 Like

I confirm that the operation of the A and B preview is not very clear… without a tutorial it is difficult to understand, and definitely still needs to be visually optimized! :sweat_smile:

2 Likes

Here’s a few other complaints:


When generating previews, there is no longer a “remaining processing time”, “total time to process”, “processing fps”, or “current status” (E.G. Downloading model) indicator like in 3.X.X. Have things like fps is important for gauging the processing speed for your selected video and model and is useful in making judgments on which AI model you should use for processing the full clip (not just the preview).


As a user, if I’m comparing two models in the new preview system, it’s because I’m looking for the best AI model for my project. So I might compare Proteus Auto to Proteus Manual with specific settings, decide I like Proteus Manual more and favourite it, then move onto comparing Iris Auto to Iris Manual with specific settings. Decide I like Iris Manual more and favourite it, then I want to compare my favourited Proteus Manual to my favourited Iris Manual. I can’t.

If I select the A side and click on my favourited Proteus Manual, then select the B side and click on my favourited Iris Manual, the UI responds as if Proteus Manual favourite was removed from the A side. But it hasn’t. Actually, to get it to work I have to deal with the issue mentioned below.


Along with the issue mentioned above, I can’t easily use my favourited previews in creating new comparisons.

Let’s say I favourite an Apollo setup. If select side A then click on my favourited Apollo setup, it will load Apollo into side A. If I then select Side B, I can adjust settings (E.G. Select Chronos), but then the “Process Next X Seconds” option is greyed out and doesn’t work.

To get it to work, I have to change the settings on the A side (the side with my favourited preview), or change where the start of the playhead is.


The favourites system doesn’t seem to offer much useful information. When I favourite a video, a little “favourited” thing will appear in lower part of the screen and it says:

Favorite 11:00pm
1920x1080 @ 27.97002997002997fps

That isn’t useful information. I want to know what settings that favourite was using (Iris? Proteus? Apollo? etc).

The long fps value is this issue:

1 Like

I think the interface is totally unintuitive and I needed some time to understand what’s shown where. And I’m usually not one that is having problems with computers on multiple systems.

To be frank, I do hate the current interface and think it needs a major overhaul to be generally useable.
The state it is now it will very likely be a support desaster with a multitude of user questions/complaints.

2 Likes

1)“process next” is not clickable after generating 1 preview
2)preview when the video is an iphone portrait mode video (metadata rotated) is broken

Yes! It’s far from being user friendly

Just updated to Video AI Beta 4.0.0 and again I can not add a link to the taskbar in windows 11 . I can add it to the start up but not task bar.

First video enhancement 2x with Iris 2 completed on Mac Studio M1 Max. no issue until I hit command-W to close the video and start a new one, got a SW crash.

Not sure what the live preview does at this stage, all I see in the right window is “Not processed”.

Edit: from the log file, looks like it’s trying to delete a file with no filename:
2023-10-11 14-06-00.162 Thread: 0x1dbf8dec0 Info ~TProcess(): destroyed
2023-10-11 14-36-14.871 Thread: 0x1dbf8dec0 Info Going to delete path: “”
2023-10-11 14-36-14.871 Thread: 0x1dbf8dec0 Info Close and delete path “”

You have to push “Process next 120f” button, than 120frames get processed and previewed

when are we expected to have the Nyx v2 for testing that is planned being part of v4?

No idea how you did it … but the performance on RDNA3 is great.

Topaz Video AI Beta  v4.0.0.0.b
System Information
OS: Windows v11.22
CPU: AMD Ryzen 9 5950X 16-Core Processor              63.923 GB
GPU: AMD Radeon RX 7900 XTX  23.94 GB
Processing Settings
device: 0 vram: 1 instances: 1
Input Resolution: 1920x1080
Benchmark Results
Artemis		1X: 	23.94 fps 	2X: 	09.28 fps 	4X: 	02.28 fps 	
Iris		1X: 	23.96 fps 	2X: 	12.45 fps 	4X: 	02.89 fps 	
Proteus		1X: 	20.80 fps 	2X: 	08.40 fps 	4X: 	02.33 fps 	
Gaia		1X: 	11.44 fps 	2X: 	07.51 fps 	4X: 	02.99 fps 	
Nyx		1X: 	09.63 fps 	
4X Slowmo		Apollo: 	22.42 fps 	APFast: 	51.79 fps 	Chronos: 	16.60 fps 	CHFast: 	25.61 fps 	

Topaz Video AI  v3.5.2
System Information
OS: Windows v11.22
CPU: AMD Ryzen 9 5950X 16-Core Processor              63.923 GB
GPU: AMD Radeon RX 7900 XTX  23.94 GB
Processing Settings
device: 0 vram: 1 instances: 0
Input Resolution: 1920x1080
Benchmark Results
Artemis		1X: 	16.76 fps 	2X: 	07.16 fps 	4X: 	02.23 fps 	
Iris		1X: 	20.75 fps 	2X: 	08.95 fps 	4X: 	02.75 fps 	
Proteus		1X: 	14.79 fps 	2X: 	06.78 fps 	4X: 	02.18 fps 	
Gaia		1X: 	10.13 fps 	2X: 	06.45 fps 	4X: 	02.82 fps 	
Nyx		1X: 	09.10 fps 	
4X Slowmo		Apollo: 	23.84 fps 	APFast: 	46.84 fps 	Chronos: 	13.04 fps 	CHFast: 	20.91 fps 	

1 Like

Linux build? :slight_smile: