Topaz Video AI Linux Alpha v3.2.3.1.L

gregory.maddra · April 21, 2023, 10:02pm

Hello again everyone,

We have another update to the experimental Linux versions. We now have a functional, albeit incomplete, GUI experience available for y’all to test.

Topaz Video AI v3.2.3.1.L

Download
Ubuntu

Changes from v3.2.3.0.L

Fixed missing libQt6LabsSettings.so.6.3.2

Topaz Video AI Alpha v3.2.3.0.L

Changes from v3.2.0.4.a

Updated to v3.2.3.0.b beta
GUI support
Fixed TensorRT model selection process
Fixed VP9 encoder

Known Issues

TensorRT models are not available for most GPU+model combinations
A lot of stuff in the GUI is going to look incorrect/be scaled incorrectly
Proteus Auto may fail for TensorRT users. If this happens, place this file into /opt/TopazVideoAIALPHA/models/ before retrying
Encoder selection in the GUI is extremely limited.
Models folder may be wiped when updating
Log files may falsely report that AVX/AVX2 is unavailable

Other Notes

This version is not officially supported at this time; please keep issues with the Linux builds in this thread. Regular support requests for the Linux versions will likely be redirected to here.
The Linux version will be updated much less frequently than the regular Mac & Windows releases, anyone wanting the latest Video AI features are advised to continue using those versions.

System Requirements

Ubuntu 22.04 or compatible (GLIBC >= 2.35)
Proprietary NVIDIA drivers with CUDA version 11.8
For ONNX models, a Vulkan-compatible NVIDIA GPU meeting Video AI’s minimum requirements
For CPU models, a CPU supporting AVX2 instructions

Usage
A .desktop file will be automatically installed into /usr/share/applications/. The application may be started from the app launcher, the videoai-run script is no longer necessary.

Downloads
Ubuntu

menthurae · April 22, 2023, 6:56am

Not able to get this one to start… looking at the logs…

2023-04-22 16-49-35.643 Thread: 140218762304256 Warning qrc:/workflows/TBenchmarkDlg.qml:4:1: Cannot load library /opt/TopazVideoAIALPHA/bin/Qt/labs/settings/libqmlsettingsplugin.so: (libQt6LabsSettings.so.6: cannot open shared object file: No such file or directory)

Then I installed…

sudo apt install libqt6labssettings6

Then this error…

2023-04-22 16-51-39.036 Thread: 140071788014336 Warning qrc:/workflows/TBenchmarkDlg.qml:4:1: Cannot load library /opt/TopazVideoAIALPHA/bin/Qt/labs/setting
s/libqmlsettingsplugin.so: (/opt/TopazVideoAIALPHA/lib/libQt6Core.so.6: version `Qt_6.4' not found (required by /lib/x86_64-linux-gnu/libQt6LabsSettings.so.
6))

But…

libqt6core6 is already the newest version (6.4.2+dfsg-6).

Any ideas?

menthurae · April 23, 2023, 1:02am

I seem to be getting somewhere slowly by copying all of the latest libQt6 files from a Telegram installation and then deleting and re-linking the symbolic links - the errors are going away for each one I do… but there are so many that I haven’t completed this yet… Will update if I have any success.

This obviously doesn’t seem like the “right” way but I am unsure what else to do as it seems like some kind of version mis-match with the dependencies, at least on my installation…

menthurae · April 23, 2023, 11:00am

Moved over all the .so files and re-linked them and now the error I get is:

qt.qpa.plugin: Could not load the Qt platform plugin "xcb" in "" even though it was found.
This application failed to start because no Qt platform plugin could be initialized. Reinstalling the application may fix this problem.

Available platform plugins are: xcb.

Tried moving libqxcb.so from a few different places over the Topaz-shipped one and no dice… Gah.

Nuked the whole install and re-installed the supplied deb and back to this…

2023-04-23 20-58-54.446 Thread: 140112349604608 Info Setup logging for Topaz Video AI Alpha 3.2.3.0.L
2023-04-23 20-58-54.446 Thread: 140112349604608 Info ******************** START USER SETTINGS ********************
2023-04-23 20-58-54.446 Thread: 140112349604608 Info "loggingFolderPath" :  "/home/myusername/.local/share/Topaz Labs LLC/Topaz Video AI Alpha/logs/"
2023-04-23 20-58-54.446 Thread: 140112349604608 Info ********************* END USER SETTINGS *********************
2023-04-23 20-58-54.447 Thread: 140112349604608 Info QList("/opt/TopazVideoAIALPHA/bin", "qrc:/qt-project.org/imports")
2023-04-23 20-58-54.533 Thread: 140112349604608 Warning QQmlApplicationEngine failed to load component
2023-04-23 20-58-54.533 Thread: 140112349604608 Warning qrc:/main.qml:2:1: Type TMainApp unavailable
2023-04-23 20-58-54.533 Thread: 140112349604608 Warning qrc:/TMainApp.qml:174:5: Type AppDialogs unavailable
2023-04-23 20-58-54.533 Thread: 140112349604608 Warning qrc:/AppDialogs.qml:31:5: Type TBenchmarkDlg unavailable
2023-04-23 20-58-54.533 Thread: 140112349604608 Warning qrc:/workflows/TBenchmarkDlg.qml:4:1: Cannot load library /opt/TopazVideoAIALPHA/bin/Qt/labs/settings/libqmlsettingsplugin.so: (/opt/TopazVideoAIALPHA/lib/libQt6Core.so.6: version `Qt_6.4' not found (required by /lib/x86_64-linux-gnu/libQt6LabsSettings.so.6))

gregory.maddra · April 24, 2023, 2:14pm

Hi all, apologies about the dependency issue. We’ll have an updated package with the missing dependency available later today.

gregory.maddra · April 24, 2023, 4:15pm

Topaz Video AI Alpha v3.2.3.1.L

Download
Ubuntu

Changes from v3.2.3.0.L

Fixed missing libQt6LabsSettings.so.6.3.2

menthurae · April 25, 2023, 11:42am

Thanks for this. I’ve got it running now in (K)Ubuntu 23.04 with NVIDIA 525.105.17 Drivers.

I am able to get Frame Interpolation going with Chronos Fast - although it is very slow compared to Windows.

Additionally, I can’t get the Enhancement working with Proteus (V3) or Artemis, though Proteus (V2), Gaia and Theia seem to work (but again very slow compared to Windows).

All in all - THANK YOU - to the Topaz Team for doing this, it is a step in the right direction - the ability to run in Linux (and with a GUI!) is awesome. Hopefully in due course we see improvements in the refinement and the speed.

Here are the logs…

2023-04-25-21-11-57-Main-e.tzlog.zip (9.2 KB)

I note when running the ffmpeg command from CLI - I get this:

[AVFilterGraph @ 0x55db68c3b800] No such filter: 'tvai_up'
Error initializing complex filters.
Invalid argument

When I replace ffmpeg with videoai-run…

[NULL @ 0x55726c241680] Unable to find a suitable output format for 'using'
using: Invalid argument

Then if I remove the “metadata” section…

[swscaler @ 0x55fe98bacac0] [swscaler @ 0x55fe98ca3340] No accelerated colorspace conversion found from yuv420p to rgb48le.
/usr/local/bin/videoai-run: line 5: 30769 Segmentation fault      (core dumped) /opt/TopazVideoAIALPHA/bin/ffmpeg $@

phil.stopford · April 26, 2023, 2:17am

Lovely to see this progress. I’ll try on a Ubuntu-like box here shortly, but debtap under Arch (Endeavour) seems to work, except the application seems unable to remember activation status and also trying to open any file (using file requester or drag-drop) doesn’t appear to work:

2023-04-25 21-12-30.282 Thread: 139896077416128 Info Determining start and end 0 23862784
2023-04-25 21-12-30.283 Thread: 139896077416128 Info Determined start and end 0 23862784
2023-04-25 21-12-30.289 Thread: 139896077416128 Debug "/home/phil/Downloads/lettherebelight_201706reel1.mp4" loaded in 15  ms
2023-04-25 21-12-30.306 Thread: 139898489035328 Warning qrc:/ModelManager.qml:64: TypeError: Type error
2023-04-25 21-14-21.436 Thread: 139898489035328 Info Opening log folder: /home/phil/.local/share/Topaz Labs LLC/Topaz Video AI Alpha/logs/
2023-04-25 21-14-52.388 Thread: 139898489035328 Warning QQmlExpression: Expression qrc:/preferences/TProcessingPreferences.qml:69:13 depends on non-NOTIFYable properties:
2023-04-25 21-14-52.388 Thread: 139898489035328 Warning     TUtils::maxProcesses
2023-04-25 21-14-52.388 Thread: 139898489035328 Warning     TUtils::maxProcesses
2023-04-25 21-14-52.388 Thread: 139898489035328 Warning     TUtils::maxProcesses
default font 9 "Sans Serif"
default font 10 "qrc:/elements/Roboto-Regular.ttf"
2023-04-25 21-15-24.168 Thread: 139897706899136 Warning Unable to open empty filepath
2023-04-25 21-15-24.169 Thread: 139898489035328 Warning qrc:/filters/TTrim.qml:28: Error: Cannot assign [undefined] to double
2023-04-25 21-15-24.169 Thread: 139897706899136 Warning Unable to open empty filepath
2023-04-25 21-15-24.169 Thread: 139898489035328 Warning qrc:/filters/TTrim.qml:28: Error: Cannot assign [undefined] to double
2023-04-25 21-15-24.202 Thread: 139898489035328 Info ~TProcess(): destroyed
2023-04-25 21-15-24.206 Thread: 139898489035328 Info ~TProcess(): destroyed
2023-04-25 21-15-24.209 Thread: 139898489035328 Info ~TProcess(): destroyed
2023-04-25 21-15-24.239 Thread: 139898489035328 Info ~TProcess(): destroyed
2023-04-25 21-15-24.261 Thread: 139898489035328 Info Trying to close the file "/home/phil/Downloads/lettherebelight_201706reel1.mp4" true
2023-04-25 21-15-24.261 Thread: 139898489035328 Info Closing the file "/home/phil/Downloads/lettherebelight_201706reel1.mp4"

phil.stopford · April 26, 2023, 1:42pm

Couple of observations from Pop_OS:

You install to opt/TopazVideoAIALPHA/ but you are looking for 'opt/TopazVideoAIAlpha/ when loading libraries:

videoai-login
/usr/local/bin/videoai-login: line 5: /opt/TopazVideoAIAlpha/bin/login: No such file or directory

I set up a symlink to cover both names for testing.

The deb package does not seem to force CUDA installation (nvidia-cuda-toolkit) so the tool won’t start and no error/warning is presented on screen. I also used apt install --fix-broken to make things OK.
The GUI starts and logs in nicely. Unlike Arch, the GUI allowed me to load my test file and shows it just fine. However, it seems to get stuck trying to download models (e.g. Gaia) - it reports downloading, loading, and then goes back to downloading again.
Exporting to command line, I get the following:

Input #0, mov,mp4,m4a,3gp,3g2,mj2, from '/home/phil/Downloads/lettherebelight_201706reel1.mp4':
  Metadata:
    major_brand     : isom
    minor_version   : 512
    compatible_brands: isomiso2avc1mp41
    title           : Let There Be Light - https://archive.org/details/lettherebelight_201706
    encoder         : Lavf57.21.101
  Duration: 00:32:21.96, start: 0.000000, bitrate: 831 kb/s
  Stream #0:0[0x1](und): Video: h264 (Constrained Baseline) (avc1 / 0x31637661), yuv420p(progressive), 640x360, 699 kb/s, 24 fps, 24 tbr, 12288 tbn (default)
    Metadata:
      handler_name    : VideoHandler
      vendor_id       : [0][0][0][0]
  Stream #0:1[0x2](und): Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 127 kb/s (default)
    Metadata:
      handler_name    : SoundHandler
      vendor_id       : [0][0][0][0]
[AVFilterGraph @ 0x55c59d8adac0] No such filter: 'tvai_up'
Error initializing complex filters.
Filter not found

gregory.maddra · April 26, 2023, 2:27pm

Hi Phil,

Make sure you’re using ./ffmpeg and not ffmpeg and have started the terminal from in-app when running the command-line version, otherwise the system installation of FFmpeg without our filters may be used instead.

phil.stopford · April 26, 2023, 2:37pm

I now have the GUI working. The logs helped. libcudnn was missing (it’s not part of the toolkit). Installing that, the Pop_OS Linux build is running nicely.

I’d love to get this going on Arch/EndeavourOS. Will dig a little deeper there to understand what’s misfiring.

phil.stopford · April 27, 2023, 2:31pm

No joy so far with Arch - the licensing won’t take. The browser is pulled up and approves, but it looks like the application doesn’t store this. Pop_OS seems happy, and I can’t see anything in strace that hints at why the licensing may not be getting stored. Any hints as to where this might be getting placed so I can see if the expected file, whatever is created, in case permissions are an issue?

Trying, also on Arch, to load a file or drag-drop, results in:

Input #0, mov,mp4,m4a,3gp,3g2,mj2, from '/home/phil/Downloads/lettherebelight_201706reel1.mp4':
  Metadata:
    major_brand     : isom
    minor_version   : 512
    compatible_brands: isomiso2avc1mp41
    title           : Let There Be Light - https://archive.org/details/lettherebelight_201706
    encoder         : Lavf57.21.101
  Duration: 00:32:21.96, start: 0.000000, bitrate: 831 kb/s
  Stream #0:0[0x1](und): Video: h264 (Constrained Baseline) (avc1 / 0x31637661), yuv420p(progressive), 640x360, 699 kb/s, 24 fps, 24 tbr, 12288 tbn (default)
    Metadata:
      handler_name    : VideoHandler
      vendor_id       : [0][0][0][0]
  Stream #0:1[0x2](und): Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 127 kb/s (default)
    Metadata:
      handler_name    : SoundHandler
      vendor_id       : [0][0][0][0]
2023-04-27 09-29-17.404 Thread: 139636835874496 Info Determining start and end 0 23862784
2023-04-27 09-29-17.404 Thread: 139636835874496 Info Determined start and end 0 23862784
2023-04-27 09-29-17.414 Thread: 139636835874496 Debug "/home/phil/Downloads/lettherebelight_201706reel1.mp4" loaded in 29  ms
2023-04-27 09-29-17.414 Thread: 139639184497216 Warning qrc:/ModelManager.qml:64: TypeError: Type error
2023-04-27 09-29-34.026 Thread: 139639184497216 Debug Dropped files for loading 1
2023-04-27 09-29-34.027 Thread: 139639184497216 Debug Importing files 1
2023-04-27 09-29-34.027 Thread: 139639184497216 Debug Importing /home/phil/Downloads/lettherebelight_201706reel1.mp4 /home/phil/Downloads/lettherebelight_201706reel1.mp4
2023-04-27 09-29-34.033 Thread: 139636835874496 Debug "/home/phil/Downloads/lettherebelight_201706reel1.mp4" loaded in 6  ms
2023-04-27 09-29-34.034 Thread: 139639184497216 Warning qrc:/ModelManager.qml:64: TypeError: Type error
2023-04-27 09-29-43.643 Thread: 139639184497216 Info Opening log folder: /home/phil/.local/share/Topaz Labs LLC/Topaz Video AI Alpha/logs/

gregory.maddra · April 27, 2023, 3:25pm

License information is placed into /opt/TopazVideoAIALPHA/models/auth.tpz

phil.stopford · April 27, 2023, 3:33pm

Ahah. So that’s the reason. The models folder is owned by root:root, with rwx-rx-rx permissions. That might explain things. I’ll have to align the permissions and try again.

gregory.maddra · April 27, 2023, 3:35pm

Yes, I imagine whatever process you used to install on Arch might’ve discarded some of the permissions we set on folders/files in the package or some similar issue. I’d also make sure that all the executables in the /opt/.../bin/ folder are actually executable as well.

phil.stopford · April 27, 2023, 3:39pm

Originally I used debtap with the .deb provided. That mostly worked, although some dependency work was needed (the cuda nn library). Instead, now, I just used tar to create an archive and extracted on the target system with sudo, to restore permissions. That seems to have allowed the licensing to work and the tool also opens files without silently failing.

Nice work! Off to play. I’m so thrilled you are working hard on the Linux version - it’s really appreciated.

phil.stopford · April 27, 2023, 7:27pm

With some more poking I got closer. Arch puts CUDA under /opt/cuda, so the models were failing with libcufft issues. Adding /opt/cuda/lib and /opt/cuda/bin to LD_LIBRARY_PATH sorted that.

In re-testing now, though, I’m getting 403 errors in the log:

2023-04-27 14-24-34.521 Thread: 139885509421632 Info OUT: 2 2023-04-27 14-24-34,521 Thread: 140013325516800 Info RESULT for  https://veai-models.topazlabs.com /ghq-v5-gaia-fp16-448x576-1x-rt806-8517.tz  is  "403"
2023-04-27 14-24-34,521 Thread: 140013325516800 Critical Attempt 0 failed for https://veai-models.topazlabs.com /ghq-v5-gaia-fp16-448x576-1x-rt806-8517.tz

2023-04-27 14-24-34.688 Thread: 139885509421632 Info OUT: 2 2023-04-27 14-24-34,688 Thread: 140013325516800 Info RESULT for  https://veai-models.topazlabs.com /ghq-v5-gaia-fp16-448x576-1x-rt806-8517.tz  is  "403"
2023-04-27 14-24-34,688 Thread: 140013325516800 Critical Attempt 1 failed for https://veai-models.topazlabs.com /ghq-v5-gaia-fp16-448x576-1x-rt806-8517.tz

2023-04-27 14-24-34.846 Thread: 139885509421632 Info OUT: 2 2023-04-27 14-24-34,846 Thread: 140013325516800 Info RESULT for  https://veai-models.topazlabs.com /ghq-v5-gaia-fp16-448x576-1x-rt806-8517.tz  is  "403"
2023-04-27 14-24-34,846 Thread: 140013325516800 Critical Attempt 2 failed for https://veai-models.topazlabs.com /ghq-v5-gaia-fp16-448x576-1x-rt806-8517.tz

I am not certain whether my testing tripped something on the server side, or there’s some maintenance going on.

phil.stopford · April 28, 2023, 5:56pm

I’m still getting 403 errors this morning; I’m not sure what to make of that.

gregory.maddra · April 28, 2023, 6:59pm

You will receive 403 errors if TensorRT models are unavailable for your selected GPU + model combination. Currently most combinations do not have TensorRT support.

For these combinations the app should be falling back to ONNX, however that’s only been tested on Ubuntu, so I have no idea if something’s going wrong there because of Arch or if there’s an actual issue. I know you’ve mentioned trying this on PopOS, is the same issue present there with the same GPU?