I just got an RTX 4070 ti today so i can now encode videos using the AV1 encoder. The problem I am having is that every single video I try using AV1 encoding on comes out a pixelated black boxy mess. I’m using it with Proteus 2x upscale and have tried an mp4 and mkv container with the same results. Does anyone know why this might be happening?
Edit/Update: I remember a few years ago I was having a problem like this and it was caused by having my GPU memory overclocked too much. I’m not overclocking this GPU at all though. I also tried lowering memory usage from 100% to 75% but that didn’t resolve it.
if you encode it in TVAI other then AV1, does the same video comes out OK?
If so, I would suspect that Topaz did not optimize their AV1. as a workaround I would say export in topaz as FFV1, then Handbrake it to AV1
Ran one of my test clips thro TVAI and it’s dreadful.
Encode direct to AV1 using TVAI = Size 44.0 mb VMAF 87.0252
Encode direct to AV1 using Davinci Resolve = Size 44.3 mb VMAF 95.0189
Encode direct to AV1 using Handbrake nvenc = Size 34.0 mb VMAF 94.5709
Encode direct to AV1 using Handbrake svt = Size 9.4 mb VMAF 92.4758
Encode direct to AV1 using ab-av1 / av1an svt = Size 11.4 mb VMAF 95.1734
Encode to FFV1 using TVAI > Davinci Resolve = Size 44.3 mb VMAF 95.5753
Encode to FFV1 using TVAI > Handrake nvenc = Size 26.9 mb VMAF 95.3076
Encode to FFV1 using TVAI > Handbrake svt = Size 7.4 mb VMAF 93.3394
Encode to FFV1 using TVAI > ab-av1 / av1an svt = Size 7.1 mb VMAF 95.0936
I generally output TVAI to 10 bit FFV1 then encode using my own settings from ab-av1 and av1an to get way smaller file sizes.
Anything above 95 in VMAF is more than acceptable and yes I do visually inspect the outputs for a human perspective.
Interesting , I never thought they could be such difference between encoding tools with the same codec and settings.
Every other encoder in TVAI works fine the video outputs look fine but AV1 seems to be completely broken.
What settings are you using for AV1 output ?
I’ve tried every setting, 8-bit, 10-bit, mkv, mp4, the output looks the same for all of them.
Hello,
Could we try running an AV1 encode with Handbrake? They recently added AV1 NVENC support and I’d like to check if there’s a specific issue with the command we are passing to NVENC for encoding.
1 Like
If you look at the results I posted it’s clear your settings need a lot of improvement.
I’ve posted results from Handbrake.
They have a github Commits · HandBrake/HandBrake · GitHub
maybe you guys / girls could actually read that rather than asking users here that don’t have that level of tech knowledge.
Your results don’t include the selected bitrate, CRF, or any encoding parameters.
All we really know from those results is that the VMAF is different between NVENC within TVAI, NVENC within HandBrake, and SVT-AV1/AV1AN, but we don’t know which rate control methods produced each result.
Here’s my own settings for the av1an settings I have control over
fd -I -e .ts -j 1 -x av1an --verbose --split-method av-scenechange -c ffmpeg --sc-pix-format=yuv420p --sc-method=fast --sc-downscale-height=240 -e svt-av1 -v ’ --crf 23 --preset 6 --tune 2 --film-grain-denoise 0 --enable-qm 1 --qm-min 0 --qm-max 8 --irefresh-type 1 --enable-overlays 1 --enable-stat-report 1 ’ -a ’ -c:a aac -b:a 128k’ -s ‘{.}.json’ -i ‘{}’ -o ‘{.}_SVT_23_6.mp4’
crf is determined by running ab-av1 prior to using these settings.
ab-av1 crf-search -i testfile_01.ts --preset 6 --svt tune=2
1 Like
Thanks, we’ll take a look at some options for NVENC but it is likely to still be less efficient since GPU-based encoders tend to be more limited in terms of advanced rate control methods.
For example, CRF control is not available in NVENC’s H264 and HEVC implementations, so we’re using CQP.
