Name: 4x 4x-PBRify_UpscalerSIR-M_V2
Author: Kim2091

PBRify_Remix is an easy way to upscale and generate PBR textures using existing low quality textures. The dataset consists of ethically sourced textures from websites like ambientCG and Polyhaven, which sets it apart from most other models.

It's intended for use with RTX Remix (hence the name) but it'll work for other things as well.

More models and other tools can be found here: https://github.com/Kim2091/PBRify_Remix

PBRify

This is part of a larger model set, PBRify_Remix. PBRify_Remix is an easy way to upscale and generate PBR textures using existing low quality textures. The dataset consists of ethically sourced textures from websites like ambientCG and Polyhaven, which sets it apart from most other models.

It's intended for use with RTX Remix (hence the name) but it'll work for other things as well.

Note: The height map model is best used after applying a "delighting" pipeline to your game textures. Currently PBRify_Remix does not have a method for this, so you need your own.

1x-PBRify_Height

This is part of a larger model set, PBRify_Remix. PBRify_Remix is an easy way to upscale and generate PBR textures using existing low quality textures. The dataset consists of ethically sourced textures from websites like ambientCG and Polyhaven, which sets it apart from most other models.

It's intended for use with RTX Remix (hence the name) but it'll work for other things as well.

1x-PBRify_NormalV3

1x-PBRify_RoughnessV2.pth

DeGif

Category: Art/Pixel Art
Purpose: Digital Art/People
Pretrained: Mainly for digital art, but can be used to upscale pixel art.

ArtStation1337 Dedither

ArtStation1337 Dedither v2

For photos/realistic images, but worth trying on other images that have reduced colors and dithering along with fine details. Trained using the ESRGAN-FS code (https://github.com/ManuelFritsche/real-world-sr/tree/master/esrgan-fs/codes) for better details compared to plain ESRGAN.

FSDedither

Fine-tuned 4xFSDedither to upscale images from the game Riven, but should be better in general, particularly on ordered dithering. I adjusted the dataset to have a better variety of dithering parameters, and turned up the HFEN and pixel loss to get better details and color restoration with less noise.

FSDedither Riven

Manga-style images with or without dithering - cartoons, maybe pixel art, etc

FSMangaV2

Category: Art/Pixel Art
Purpose: Pixel Art/Sprites

Upscales medium resolution Sprites, dithered or undithered, can also upscale manga/anime and gameboy camera images.

Fatality 1

Purpose: Anime PSP games, Fate Extra

This model was trained as a favor to Demon and the Fate Extra community. It leaves a nice grain on the images and upscales lines and details accurately without looking odd. This model works on most anime-style PSP games. Enjoy! It works best on content with dithering and quantization. NOTICE: I have included both NCNN and ONNX models to make upscaling easier if you rely on either of these. For NCNN, there's two versions. One is FP16 and the other is FP32. FP16 works best on RTX GPUs. Choose FP32 if in doubt about compatibility, or if FP16 doesn't work for you. To use ONNX, download chaiNNer and upscale through there with the ONNX nodes.

FatePlus-lite

Images from the Fate/Extra games. Works better on the newer ones.

Just a model I trained quickly to test traiNNer-redux and see what I could do with OTF. Works well enough

FatePlus Compact

Category: Alphas
Purpose: Alpha (4 channel)

FireAlpha

This model is intended to mainly handle PS2 compression and a mixture of Realistic and cartoonish textures, it's not meant to be used for very low resolution textures such as item icons.

GameAI 1.0

GameAI 2.0

Category: Foliage/Ground
Purpose: Upscales ground textures

Ground

Gamecube and Wii textures Dumps.

https://github.com/Venomalia/HDcube/tree/main/v2

HDCube2

Purpose: Gamecube and Wii textures.
Pretrained: 4x_HDcube2

It can be used for all image formats supported by Gamecube and Wii hardware and can remove its typical artifacts like CMPR Block Compression (DXT1 algorithm, also known as BC1), color palette errors, color reduction up to 8bit color depth and 1bit alpha depth.

HDCube3

A universal model, that is aimed at prerendered images, but handles realistic faces, manga, pixel art and dedithering as well. Trained using the patchgan discriminator, with cx loss, cutmixup and frequency separation, it produces good results with a slight grain due to patchgan, with some sharpening using cutmixup.

Lollypop

A 4x upscaler for BC1-compressed normal maps with a zeroed-out B channel. The output normals will also have a constant-zero B channel. Use external software or image editing plugins to properly normalize the generated normals and generate the Z component (if necessary). E.g. chaiNNer can do this with Normalize Normal Map node. Do not rely on this network producing unit vectors. 

**Dataset transformation:** \
The LR have been compressed with various BC1 compression settings (dithering, weighting) using Texconv version 2021.11.8.1. Since the contents of the B channel influence the R and G channels during compression, the LR were given a B channel that was either the Z component of the normal, a random constant color, or a random texture (usually the G channel of the associated albedo) before compression. The LR + B channel was then compressed and the resulting BC1-compressed DDS was converted back into a PNG and had its B channel zeroed out.

More information: https://github.com/RunDevelopment/ESRGAN-models/blob/main/normals/README.md

Normal RG0 BC1

A 4x upscaler for BC7-compressed normal maps with a zeroed-out B channel and no alpha. The input is required to have no alpha and constant-zero blue channel. BC7-compressed images with an alpha channel should be handled by the BC1 model instead. This is because BC7 achieves very different quality for images with and without an alpha channel. The output normals will also have a constant-zero B channel. The output normals will also have a constant-zero B channel. Use external software or image editing plugins to properly normalize the generated normals and generate the Z component (if necessary). E.g. chaiNNer can do this with Normalize Normal Map node. Do not rely on this network producing unit vectors. 

**Dataset transformation:** \
The LR have been compressed using Texconv version 2021.11.8.1. Since the contents of the B channel influence the R and G channels during compression, the LR were given a B channel that was either the Z component of the normal, a random constant color, or a random texture (usually the G channel of the associated albedo) before compression. The LR + B channel was then compressed and the resulting BC7-compressed DDS was converted back into a PNG and had its B channel zeroed out.

More information: https://github.com/RunDevelopment/ESRGAN-models/blob/main/normals/README.md

Normal RG0 BC7

This is part of my [PBRify_Remix](<https://github.com/Kim2091/PBRify_Remix>) project. This is a much more capable model based on SwinIR Medium, which should strike a balance between capacity for learning + inference speed. It appears to have done so :)

4x-PBRify_UpscalerSIR-M_V2

4x-PBRify_UpscalerSPANV4

Upscaling and dedithering pre-rendered sprites, images and textures made in the 90s. Basically vintage CGI.

Purpose: Game textures/Art

This model upscales artwork for the game Volfoss (2001). The model peaked in quality very quickly. The NR model removes most noise, but has the downside of removing transparent portions. Use the main model in most cases.

VolArt

VolArtNR

A 4x upscaler for BC1-compressed wood textures. The model was trained on wood planks, wood stems, and a bit of tree bark. It performs reasonably well on woody textures and produces sharp outputs. However, it also tends to slightly shift the hue of the image, so results might appear slightly more red.

More information: https://github.com/RunDevelopment/ESRGAN-models/blob/main/wood/README.md

Wood BC1

Category: Art/Pixel Art

xbrz plus dedithering style pixel-art upscaling model to wiki under specialised

Architecture	SwinIR
Scale	4x
Size	Medium
Color Mode	RGB
License	CC0-1.0 Private use Commercial use Distribution Modifications No Liability & Warranty Disclaimer
Date	2024-05-19
Dataset	ambientCG + PolyHaven + UltraSharpV2
Dataset size	26000
Training iterations	400000
Training batch size	8
Training HR size	256
Training OTF	No

4x-PBRify_UpscalerSIR-M_V2

Collections that include this model

Similar Models