Potential fix of grid artifact for upscaling model

Hi,

We have a potential fix for the grid artifact for the upscaling filter. The fix will impact high fidelity model for Windows and intel Mac users, and all models for Apple silicon Mac users. Please try it out if you ever notice the issue. The build can be installed at the same time with the current released product, without replacing one another. For Apple silicon mac, we disabled the neural engine, as such it can noticeably slower than in the current product.

Please help let us know if the fix works or not. Posting a before (released product) and after (the below build) screenshot is welcomed. Thanks!

Mac: https://downloads.topazlabs.com/deploy/TopazPhotoAIBeta/2.0.5.betatilefix3/TopazPhotoAIBeta-2.0.5.betatilefix3.pkg
Windows: https://downloads.topazlabs.com/deploy/TopazPhotoAIBeta/2.0.5.betatilefix3/TopazPhotoAIBeta-2.0.5.betatilefix3.msi


Updated 10/18/2023

Windows:
https://downloads.topazlabs.com/deploy/TopazPhotoAIBeta/2.0.6.betatilefix4/TopazPhotoAIBeta-2.0.6.betatilefix4.msi
Mac:
https://downloads.topazlabs.com/deploy/TopazPhotoAIBeta/2.0.6.betatilefix4/TopazPhotoAIBeta-2.0.6.betatilefix4.pkg

5 Likes

Why a windows version?
I thought that grid artifact was nailed down specifically to Apple M1/M2 SOCs using the high fidelity model?

Anyways, I don’t get that tiling even without the fix (M2 Ultra here). I tried but couldn’t reproduce it. Is this limited to RAW or large files? Any way to reproduce it, maybe with a sample image provided?

Then I could test the fix.

Agreed. If someone who has this problem would post their full original image and the ‘after’, with system specs, we could test it and perhaps find out how prevalent the grid issue really is. Devs might then know better what and what platform to fix.

M1 Max 64GB; Mac OS: Sonoma 14.0 (23A344)

Original image was provided previously via drop box

Images below have the preview area enhanced in photoshop using camera raw

Tiles are still visible for Upscale/High Fidelity:

Tiles are almost invisible for

  • Sharpen/Sharpen 2

  • Remove Noise/Normal (there is still a visible trace, would be great to improve this)

Adobe Camera Raw settings for contrast enhancement:
(simply play with the exposure slider to adjust visibility of tiles)

1 Like

Just in case, here is the input image (download the original, not a resized version):

1 Like

OK, with this image the tiling/grids are clearly visible in TPAI 2.0.5 with the high fidelity filter. The strength of the tiling depends quite a bit on the Fix compression parameter.

But the “Low resolution” upscale model does work quite well on this (also not so high res) image:

Also, in the Beta with the fix, you have to be quite paranoid to still see those tiles with the high fidelity model:

P.S.: This version is running quite as fast as the one using Neural engine at least here with high GPU core count (M2 Ultra 24c CPU/60c GPU).
This could be a phenomenon known from TVAI where you actually can gain quite a lot of speed if you force the use of GPU instead of Neural engine.
So maybe include a switch for that? So that users with low GPU cores could use Neural engine and those with lot of GPU cores use GPU.

1 Like

This is not about being paranoid
I realize, that extreme contrast enhancement reveals the issue, but - such kind of image processing is not supposed to produce tiling artifact. Depending where in one’s workflow TPAI is used, image can further go through tonal adjustments downstream and in such case all flaws introduced upstream in TPAI will ruin the rest of the process.
So - this is NOT an optional kind of a fix, it is absolutely essential that such artifacts are not being created.

This also seems to be quite long standing bug. I just tested your photo with the old Gigapixel App and got tiles as well there using the HQ model:

The forum compresses the Gigapixel image so you nearly don’t see the tiles anymore - in the original it’s stronger.

1 Like

oh that’s right, in latest Gigapixel - / HQ - tiling is visible:


I find it interesting how the details change when you work with the sliders.

Depending on the photo, whether there is more or less noise, artificial or non-artificial noise, the software sometimes has more or less problems with displaying the tiles correctly.

Is there any update on the fix?

Hi,

We have an updated fix with some changes to further improve grid artifacts. Please check out:
Windows:
https://downloads.topazlabs.com/deploy/TopazPhotoAIBeta/2.0.6.betatilefix4/TopazPhotoAIBeta-2.0.6.betatilefix4.msi
Mac:
https://downloads.topazlabs.com/deploy/TopazPhotoAIBeta/2.0.6.betatilefix5/TopazPhotoAIBeta-2.0.6.betatilefix5.pkg

2 Likes

Thanks there is an improvement, although the tile pattern is still there, it is just much less prominent:

I feel that most of the remaining tile pattern is being contributed from Sharpen

Thanks. Good to know. Although not 100% invisible in extreme cases, we will ship this upscaler fix in the coming one or two release, since it will benefit users for most situations.


another artifact apeard.




Grids all over the place. (the forum compression did eat it up).



I will deinstall it an retry.

1 Like

reinstall did not work.

Will check stable too, maybe its the driver.

Let me know if that is also reproducible in release. That is probably not related to the fix since we only change the results in the overlap regions.
Thanks for testing!

Stable is ok.




Do you mind dropping the image? I need to test it locally to see what happened.

https://www.dropbox.com/request/zp9751F00kED1IdUlAoM