Awesome AI upscaler

[iG8R]

Just found a mind-blowing AI upscaler - https://huggingface.co/spaces/gokaygokay/AuraSR-v2.
It has even a pytorch version - https://github.com/lucidrains/gigagan-pytorch

Examples.
https://senkuro.com/manga/re-monster/chapters/119429828913939988/pages/4

Original image:

Colorized image without upscaling:

Upscaled with RealESRGAN_x4plus_anime_6B:

Upscaled with AuraSR-v2:

[BinitDOX]

Seems good for text and doesn't remove artifacts

ERS:

ASR:

I'll test it in a few hrs.

[iG8R]

Almost exactly like in the original image:

[BinitDOX]

ESRGAN (Current) (2 seconds):

GigaGAN x4 (AuraSR-v2) (40 seconds) (The space uses this):

GigaGAN x4 Overlapped (AuraSR-v2) (80 seconds):

The AuraSR is for generic use-case, so it's not only larger by x130 times than ESR, but also takes a long time for the upscale.
I don't recommend using it but if you want:
Download https://huggingface.co/fal/AuraSR-v2/blob/main/model.ckpt, rename it as GigaGAN.ckpt and save it in networks folder.
Then run app-stream.py python app-stream.py --no-ssl --upscaler_type=GigaGAN --upscaler_path=networks/GigaGAN.ckpt
Also compare the output with this: https://huggingface.co/spaces/gokaygokay/AuraSR-v2, since this space is not loading for me, and I modified the source code a bit.

PS:

[iG8R]

Thank you very much!

[iG8R]

BTW, https://mangadex.org/chapter/d72a3eb8-2b20-4c39-a46f-d282eb05e64f/2 doesn't get colorized.

[BinitDOX]

Oh, just 4s? Great! Must be my GPU then.

Fixed. Does the MC-FJ colorize this?

[iG8R]

Oh, MC-FJ also doesn't colorize it...

Is there a way to forcefully colorize an image, and also re-colorize it, when sometimes MC colorizes placeholders?

https://senkuro.com/manga/zettai-ni-damage-wo-ukenai-skill-wo-moratta-node-boukensha-toshite-musou-shitemiru/chapters/136754949798249996/pages/1

MangaColorizer-placeholder-colorization-Video_2024-08-02_23-16-13.webm

[iG8R]

Oh, just 4s? Great! Must be my GPU then.

Although, AuraSR-vs size is 2.29GB, but the amount of VRAM it uses is about 7.2GB.

[BinitDOX]

when sometimes MC colorizes placeholders?

Oh I forgot about caches. It caches the wrong image. Should work when caching is off. Will fix.

[iG8R]

However, without caching, the load on the system increases, as it has to colorize and upscale again.

[BinitDOX]

Fixed. (Needs some more testing though)

[iG8R]

Thanks a lot!
But, at the moment, when MC encounters placeholders, it starts processing the image, that has the placeholder first, eternally, as it can be seen from the server log and the image from page 7 as an example.

MangaColorizer-placeholder-colorizition-02-Video_2024-08-03_09-33-33.webm

[BinitDOX]

Weird, this shouldn't happen.

[BinitDOX]

Oh src can change anyways, previous bad fix reverted. Alternate temp fix pushed.

[iG8R]

Thank you so much!
Now there are no issues with placeholders, but the issue regarding the "Show Original" option occurred:

MangaColorizer-show-original-issue-Video_2024-08-03_18-12-47.mp4