Topaz Video AI Beta v4.0.0.2.b

Topaz Video AI Video AI Beta
1

Hello everyone,

We have a new beta available for testing. This beta is the improved AB comparison update!

The beta overhauls how you typically interact with Topaz Video AI. Instead of the typical input, output view that you are used to, now, you will have two views that models can be applied to. With these views you can build and compare different combinations of models to find out which model configuration works best for your original input. You can see more information on how to use this beta below!

4.0.0.2.b

Changelog from 4.0.0.1.b

  • Large playback improvements + speed ups.
  • Increased responsiveness of player during large loads.
  • Added “Export” back.
  • Zoom related improvements.
  • Trim related improvements.
  • Various other bug related improvements!

Known Issues:

  • Differing FPS values between views will cause playback issues.
  • Favorites system is in a developmental state.
  • Using “left” arrow key to seek back into a preview will not show the preview, just the input, despite being in the preview range.
  • Seeking in and out of previews fast will result in a very slow response.
  • Seeking/PlayNext/PlayPrev in slow motion area will not work as expected on the player.
  • All things frame interpolation are in a development state.

Information about the beta

The main goal of the change is to allow you to make the best decision about what model configurations to use. To accomplish this, we think it’s best for the user to be able to apply different models and see the results side by side.

For example, you can apply Proteus to your A view and Artemis to the B view to see which one has the result you prefer. At any time, you can revert to the original input to compare with the original. This is different from before where you must apply one model configuration at a time and always be comparing to the original.

Details about how to use
The first difference is you must select which view to focus. If you click the left view, A will be highlighted. If you select the right view, B will be highlighted.

When you have a view highlighted, the models/filters you add to the view will be specific for that view. So if you want to see how “Recover Original Detail” works you could give view A & B Enhancement, then give them different “Recover Original Detail” values.

When you have made the changes to the filters you want to see, you can click “Process Next …” to see these two different combinations of filters applied to the input.

When you do this, a progress bar will be applied to the timeline. This is the area of the video where you chose to see the filters be applied. You can watch this section to see how the input has changed. At any time, you may right click a view and click “Reset to Original.”

When you have a combination of filters that you really like (lets assume it’s the filters applied in view A) you may click the A view and click export.

We think this is the best way to be able to find the best mix of models to get the best results possible. Let us know what you think about the new previewing workflow established with this beta.

7 Likes
2

This is working well for me in that it makes a binary tree optimization pretty easy.

I have a wedding video from 30 years ago - digital video cam, interlaced - that I put through deinterlacing on VAI 4002b. First run was Dione DV vs. Iris LQ. Iris LQ was clearly better, so I then ran it against the remaining Dione models and exported my choice (Iris LQ).

The interface helps me quickly explore A/B differences and pick the better for further work. Well done.

1 Like
3

Testing on M1 Max on Sonoma. Using asitop, I have noticed Iris v2 uses the GPU when enhancing 2x but ANE when enhancing 4x… any specific reason? wonder which one would be faster…

1 Like
4

I am very unhappy with the “Replace Duplicate Frames” option. It seems only to replace duplicate frames but not triple frames or quadruple frames or even more, so that at the end it is often still stuttering. :frowning:

5

“double click to view export” still don’t work

EDIT:
it does not work while processing, but that is what I want to see
it only works after processing has finished, but that is useless because I can view the processed file in the output.
v4.0.0.2.b has still a long way to get improved before TOPAZ should publish v4.0

AND:
I recommend TOPAZ to produce a good tutorial to explain and demonstrate how to use sliders and settings in UI.

1 Like
6

Split preview is greyed out and can’t be selected in the main UI. It can be selected in preferences.

If you enable the Split preview mode in the UI, then import a video, it will use the Split preview mode. But you can’t drag the middle bar in split mode.

While in Split or Single preview mode, there doesn’t appear to be a way to select preview 1 to adjust it’s settings.

The little bar below the previews doesn’t tell me which enhancment filter I’m using. E.G. If I select Gaia, it just says “Enhancement (Auto)”. If I select Iris it says “Enhancement (Auto)”

When generating a preview, there isn’t much useful information (FPS, time spent processing, time left, etc are all missing).

When playing the preview, once you reach the end of the preview period, the preview will switch back to the original video and just keep on playing. Ideally it should pause, or loop back to the beginning.

In Side by Side preview mode, sometimes the Save Settings button doesn’t work properly.

  1. On Side 1 setup Gaia
  2. On Side 2 setup Iris.
  3. Click on Side 1.
  4. Click “Save Settings” on Side 2. The settings from Side 1 will be saved.

There doesn’t appear to be an ability to unfavourite settings after saving them.

You can save the same settings and clip multple times. Just generate the preview, then click on “Save settings” a bunch of times. The settings will be saved for each time you click.

Cropping doesn’t work in the preview system. E.G. You crop a video, then process the next 5 seconds, and the video generated from that isn’t cropped.

Sometimes the preview doesn’t show. I don’t know what caused this.

Example of the issue I experienced.

  1. On Side 1 I select Gaia.
  2. On Side 2 I select Iris.
  3. I select Process Next 5 seconds
  4. I waited for all the processing to finished.
  5. I watch the preview. Side 1 was Gaia, but Side 2 was the original video.
  6. I watched the preview again, same issue.
  7. I watched the preview again, same issue.
  8. I watched the preview again, same issue.
  9. I watched the preview again, Side 2 is now Iris.
  10. I watched the preview again, Side 2 was the original video again.

Reset to original does not reset the preview to original in some cases. (Probably related to issue above)

Example of issue I experienced.

  1. On Side 1 I selected Gaia.
  2. On Side 2 I selected Iris.
  3. Process next 5 seconds.
  4. Watched the preview and made sure both were correct.
  5. Right click on Side 2 and select Reset to Original.
  6. Side 2s settings are “Original”, The preview bar says it’s original, but the video playing is Iris.

There doesn’t appear to be support to que up work. (E.G. Compare Proteus Auto to Proteus Manual, and while that’s happening, que up Iris Auto compared to Iris Manual).

I’mm not sure that the Only Keep One Preview option works.

Other issues?
I can’t be bothered at this point.

3 Likes
7

A lot of this information is inaccurate because the sides are now called “1” and “2” not “A” and “B”.

8

Also, is there a possibility for TVAI 4.0 to be delayed until it’s in a more stable state with feature parity with 3.5.3?

I’m doubtful Topaz Labs can get TVAI 4.0 into a good state by October the 17th without putting a lot of pressure on their developers (which I don’t want to happen).

2 Likes
9
  1. macOS 13.6 — Save dialog unable to use arrow keys in title field as it moves the player head
  2. can you display the fps/spf and the time when processing a preview
1 Like
10

I have reported #1 to Apple, this has been happening since Sonoma, the same happens with other apps, e.g. AVIdemux has the same issue with the save dialog. Hopefully Topaz can find a workaround and/or also report this to Apple so they fix that behavior in the O/S. Thanks for reporting in this forum!

11

Theia model messed up the video:

image
image1920Ă—1087 103 KB

12

Install had no errors and went without a hitch.

Adding to the things 20rushtonj said here are the additional I have.

#1. When I go to process a preview, there still is nothing in the exports window.
#2. There is still no way to stop processing once started. Closing the app DOES close out FFMPEG on the backend now.
#3. When playing a processed preview, the first run works without issue, but after it loops both A & B switch to original video and B shows Not Processed.

I really like the zoom timeline feature and it is working great. The playback is still nice and smooth as is the scrolling on the timeline. Super progress on a lot of these things being reported. Are you going to be adding the ability to add more panels (C & D & E etc)? What would you think about having a dynamic timeline show up to scroll through processed previews? It would be nice to be able to scroll forward and backwards on a processed video (or multiples) and zoom in on it to look at frame by frame and the like.
I am still not sure what In and Out are for, so 100% agree with others to have a how-to video for the features and how to use them.

Topaz Video AI Beta  v4.0.0.2.b
System Information
OS: Windows v10.22
CPU: Intel(R) Core(TM) i7-6700K CPU @ 4.00GHz  31.87 GB
GPU: NVIDIA GeForce RTX 3060  11.845 GB
GPU: NVIDIA GeForce RTX 3060  11.845 GB
Processing Settings
device: 0 vram: 0.9 instances: 1
Input Resolution: 1920x1080
Benchmark Results
Artemis		1X: 	10.03 fps 	2X: 	07.29 fps 	4X: 	02.12 fps 	
Iris		1X: 	09.94 fps 	2X: 	05.92 fps 	4X: 	01.91 fps 	
Proteus		1X: 	09.96 fps 	2X: 	07.13 fps 	4X: 	02.12 fps 	
Gaia		1X: 	03.20 fps 	2X: 	02.19 fps 	4X: 	01.48 fps 	
Nyx		1X: 	04.04 fps 	
4X Slowmo		Apollo: 	12.82 fps 	APFast: 	43.38 fps 	Chronos: 	07.62 fps 	CHFast: 	12.43 fps

Once again this is my slower pc, issues show up much more prominent on this box.

13

@luke.roche Will VideoAI Retain HDR Meta Data in Prorez ?

2 Likes
14

I think it’s going to be released on the 17th no matter what. Topaz doesn’t let release dates slide. Release then patch and fix.

1 Like
15

But he’s correct: In a state even only remotely near the current Betas this IMO is nothing that you can really release (at least not without damaging your reputation).

This really is a very very early Beta stage those 4.0 versions are in and it’s only two days until release date… :-/

16

Still a hot mess when it comes to frame interpolation. Creates first 2-4 frame dupes on every video…

17

This v4.0.0.2.b still is more an early alpha prototype than ready for final release

18

In marks the start of the video, Out marks the end of the video.

This is for when you want to trim a video and export it (E.G. Want to remove the first 30 seconds of a video? Go to the 30 second mark and press In then process your video)

1 Like
19

Thanks! Makes perfect sense.

20
  • Input and output frame do not match.
  • Double click “export” to vie export does nothing

image
image1920Ă—1087 145 KB