So ive been holding off for awhile on reporting this, just seeing how the newer versions work but it seems like the nyx has been broken since v3.4.3.0b. Maybe one or 2 versions after that work well but this version is the last version I remember not having issues other than the annoying error you get when you try to export the footage without converting the audio.(as seen in the screenshots).
The newest versions exibit a orange peel like texture when trying to remove grain in low light footage. where as the other version 3.4.3.0b was almost perfect at removing the simple noise. so whatâs going on here? i think this has gone on long enough?
There are two things that stand out as potentially causing this issue.
- In TVAI 3.4.3.0b you are using Nyx v1. In TVAI 4.0.4 you are using Nyx v2. These are different models, and when I initially tested it, they produce quite different results.
- In TVAI 3.4.3.0b you are using âRelative to Autoâ settings while in TVAI 4.0.4 you are using full manual settings. So even if you were using the same model, you are using different settings on each.
If you would like to access Nyx v1 in TVAI 4.0.4, then follow these steps:
- Select from the top of TVAI
File -> Preferences - In the preferences window select
Advanced - Enable the option called
Enable Previous Model Versions - Select `Save and restart in the preferences window.
- Import your video, enable enhancement, select Nyx, then select
Nyx v1for your version.
1 Like
V1 NYX does indeed produce the better results when enabling it but what exactly is V2 doing better if not noise reduction? V1 was not perfect either, but compared to V2, v1 is much better.
I havenât observed that V2 is really doing anything better compared to v1. It just seems like a step back/downgrade from v1 performance.
And keep in mind this still image/screenshot I attached was an example of v3.4.3.0b nyx at PEAK performance. Meaning that video I used it on had the best results of any of the footage that I used it on. i was saying this is how I wish every video i tried it on turned out.
How did it go from being almost perfected to back to being far from perfect with v2 nyx and then adopted as the successor to v1 nyx? Youâre not suppose to be using V1 anymore correct? V2 is the future, right? Well thatâs a pretty noticeable downgrade in performance unless you know of a scenario where itâs working better on?
no wonder, the settings are fundamentally different in both screenshots and the quality is set to medium, but you expect high end output, which is not possible with the settings.
@20rushtonj @TPX
First of all, The problem has nothing to do with auto or relative to auto settings. It also has nothing to do with the quality of output settings, this was merely a preview but the 2nd version was set to prores. Iâve attached a screen with both versions using high quality and relative to auto.
@TPX I would also add that the video you showed a before and after that you seem to be getting good results in, has almost no noise profile and is seemingly in broad daylight.
The video Iâm using this on the other hand is taken under moonlight alone 1am in the desert. There much more noise in my footage.
Zoom into these screen shots full screen and tell me how Iâm wrong.
But never the less, V1 nyx still deals with it nicely, which begs the question again: What scenarios is V2 nyx doing better?
Hmmm, how was the input processed before?
Try 70/30/70 all other at default, and not relative to auto.
But why is the magnification in both images so different?
IMO Nyx 2 only works well enough with already HQ material. For lower quality very noisy sources youâd better use Nyx 1 or Iris or even Artemis (if the quality is very low).
You were right, my example video wasnât quite right.
But depending on the output, the quality settings make a big difference.
Compared to nyx 1, nyx 2 has more detail and is intended more for RAW noise output, it seems.
Since your video has already been de-noised by whatever, another model like Proteus or iris is more suitable here.
Nyx 1 (Extreme settings)
Nyx 2 (extreme settings)
Nyx 2 optimised - but i would use a more specialised software for such a kind of noise, bc TVAI has problems that are related to AI processing as such and the video would need some corrections afterwards, TVAI is made for processing already finalised videos, bc of this they made the plugins i think.
@jo.vo yes well Artemis definitely had itâs strong points and for a long time was beating nyx in the early beta versions but artemis is actually more for sub 4k maybe even sub 1080p sources. So it tends to create artifacts and over smooth 4k footage. It also does not remove noise as well as v1 nyx.
@TPX as far the 70, 30 70 for the first 3 settings on manual, the effect still persists. I will say that when you zoom out the footage it seems somewhat less noisy compared to normal, but the moment you look at it full screen you see the orange peel noise replacing the film grain type noise.
v2 does seem to produce lines that are 1 shade darker, creating a more defined texture or shape. but thatâs probably nothing adjusting the contrast couldnt fix.
So I guess jump to bump this question up,
I mean it seems like V1 nyx works better for low light noise reduction, and V2 I really havenât seen it in action much but maybe it does something in normal light conditions better.
But I mean normally when you have to enable a setting for the older models to show up that means theyâre no longer going to be updated or improved and possibly even removed completely. Which would be a big mistake cause V1 seems to work wayyyyy better.
So shouldnât the developers kinda come back to this? I mean this is a pretty prevalent issue in footage and reason for using the noise reduction. If low light ISO noise isnât nyx v2âs priority i dont know what is.
Iâve created a very detailed report in the bugs and issues section, about how Nyx2 is useless because it over-sharpens at every possible setting value. They marked it as âdeferredâ. So Iâm guessing that means, they passed it off to the AI model training team.
do you have the Link for your post?
Sure. Here you go.
1 Like
Yeah and as you can see in the screenshots, nyx v2 is adding a noise that isnt even there. Turning grain into a orange peel instead of smoothing it out and removing it.
I did notice it does seem make some of the tire tracks in the video seem sharper or more defined, but again, if you just add contrast to the video while editing youll get the same effect so I dont know what favor itâs really doing at the moment.
V1 is still great but it has room for improvement. I donât know if I should just be thankful for V1 or cry about v2âs step back.
