[KNOWN ISSUE] Starlight Mini audio desync and drift

Known issue with longer form videos with Starlight models causing video track to be shortened, causing a audio sync issue overtime.

Workaround

There is currently no workaround. Some users have found that ensuring the input and output codec and containers match and avoiding using in/out trim points helps avoid this issue.

Status

The team is aware of the behavior on macOS 26 and is investigating. This post will be updated when support is added or a fix becomes available.

I have two seperate videos that I’ve tried different settings and all of them add audio lag.
The videos are ~65 mins each before setting the Marks.

I’m running the following:
Windows 11 Pro 24H2
OS build 26100.6584
Processor - 13th Gen Intel(R) Core™ i9-13900KS (3.20 GHz)
RAM - 48.0 GB
Video - NVIDIA GeForce RTX 5090

The video resolutions are 720x480 and I used the following command to capture them:
#00 Original Capture:
set FFMPEG=C:\Apps\VHS\ffmpeg\bin\ffmpeg
set OUTDIR=C:\Apps\VHS
set DEVICE_VIDEO=CY3014 USB, Analog 01 Capture
set DEVICE_AUDIO=CY3014 USB, Analog 01 WaveIn
set FILENAME=capture_%date:~10,4%%date:~4,2%%date:~7,2%_%time:~0,2%%time:~3,2%%time:~6,2%.mkv
set FILENAME=%FILENAME: =0%

“%FFMPEG%” ^
-rtbufsize 1G ^
-f dshow ^
-video_size 720x480 ^
-framerate 29.97 ^
-pixel_format yuv422p10le ^
-i video=“%DEVICE_VIDEO%”:audio=“%DEVICE_AUDIO%” ^
-c:v ffv1 -level 3 -g 1 -coder 1 -context 1 -slices 24 -slicecrc 1 ^
-color_range tv ^
-c:a pcm_s16le -ar 48000 -ac 2 ^
-t 01:05:00 ^
“%OUTDIR%%FILENAME%”

The audio is perfectly in sync in both videos before using both Starlights.
For Starlight Mini, I choose the following:
Enhancement - On
Output resolution - 2x Upscale
AI Model - Starlight
Model variant - Starlight

For Starlight Sharp, I choose the following:
Enhancement - On
Output resolution - Original size
AI Model - Starlight
Model variant - Starlight Sharp

The weird part is that I beta tested Topaz Video AI 7.2.0.2b and the audio was in sync for Startlight Mini. However, the quality of the converstion was not that great, which this version fixed.

Hi Ryan — we’ve discussed this via email, but I’m posting a quick summary here for anyone else who may run into the same issue.

Known issue with longer form videos with Starlight models causing video track to be shortened, causing a audio sync issue overtime.

Solution is to ensure the input and output codec and containers match and avoid using in/out trim points.

I am currently having the same problem. I have taken Marguax’s advice and made sure trim was never used and the same containers that currently exist with the video before encoding. Audio (which is non-existent after re-encode and needs to be re-injected into the final video) seems to be about 1 second off at the beginning of the video (23 minutes long), but by the end of the video, the audio is several seconds off. BTW… BRAVO on the SM Sharp! Video quality is outstanding on it! Much better than I expected!

Please remove this as a solution, this is not fixed. I even cut the video to 15mins and the audio is still off several seconds, same container, encoder, etc and did not use in/out.

You’re correct Carl, still does not work. I tried a 15min video and the sound is still off.

If your videos are variable frame rate the audio will get messed up after processing them with starlight. If you convert them to constant frame rate prior to starlight it will solve the problem.

Thanks, and good to know. I just confirmed, and my videos are CBR. So it’s something else causing this issue.

r_frame_rate=2997/100
avg_frame_rate=2997/100

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.