Nice to release a model again! This one is intended for realistic imagery, and works especially well on faces, hair, and nature shots. It should only be used on somewhat clear shots, without a lot of grain. I trained this model on SPAN, which as of the time of release, you'll need chaiNNer-nightly for. I aimed for a softer, more natural look for this model with as few artifacts as possible.

In addition to the Normal model, I've included a "soft" model. The Soft model is... softer. Basically it was an earlier version of the model with a more limited dataset. It produces more natural output on games or rendered content, but suffers a bit more with realistic stuff.

Note: In shots with DOF (depth of field) or bokeh, unfortunately there will be artifacts. 

Compatibility: You'll have to use the latest chaiNNer-nightly to use this model

ClearRealityV1

Fine-tuned 4xFSDedither to upscale images from the game Riven, but should be better in general, particularly on ordered dithering. I adjusted the dataset to have a better variety of dithering parameters, and turned up the HFEN and pixel loss to get better details and color restoration with less noise.

FSDedither Riven

Images from the Fate/Extra games. Works better on the newer ones.

Just a model I trained quickly to test traiNNer-redux and see what I could do with OTF. Works well enough

FatePlus Compact

Category: Alphas
Purpose: Alpha (4 channel)

FireAlpha

This model is intended to mainly handle PS2 compression and a mixture of Realistic and cartoonish textures, it's not meant to be used for very low resolution textures such as item icons.

GameAI 1.0

GameAI 2.0

Category: Foliage/Ground
Purpose: Upscales ground textures

Ground

Gamecube and Wii textures Dumps.

https://github.com/Venomalia/HDcube/tree/main/v2

HDCube2

Purpose: Gamecube and Wii textures.
Pretrained: 4x_HDcube2

It can be used for all image formats supported by Gamecube and Wii hardware and can remove its typical artifacts like CMPR Block Compression (DXT1 algorithm, also known as BC1), color palette errors, color reduction up to 8bit color depth and 1bit alpha depth.

HDCube3

Upscale photos to x4 their size.

4xLSDIRCompactv2 supersedes the previously released models, it combines all my progress on my compact model. Both CompactC and CompactR had received around 8 hours more training since release with batch size 10 (CompactR had only been up to 5 on release), and these two were then interpolated together. This allows v2 to handle some degradations, while preserving the details of the CompactC model. Examples: https://imgsli.com/MTY0Njgz/0/2

LSDIR Compact v2

Upscale small photos with compression to 4x their size.

Trying to extend my previous model to be able to handle compression (JPG 100-30) by manually altering the training dataset, since 4xLSDIRCompact can't handle compression. Use this instead of 4xLSDIRCompact if your photo has compression (like an image from the web).

LSDIR Compact C

Upscale compressed photos to x4 their size.

Able to handle JPG compression (30-100).

LSDIR Compact C3

Upscale small photos with compression, noise and slight blur to 4x their size.

Extending my last 4xLSDIRCompact model to Real-ESRGAN, meaning trained on synthetic data instead to handle more kinds of degradations, it should be able to handle compression, noise, and slight blur.

Here is a comparison to show that 4xLSDIRCompact cannot handle compression artifacts, and that these two models will produce better output for that specific scenario. These models are not ‘better’ than the previous one, they are just meant to handle a different use case.

LSDIR Compact R

Upscale (degraded) photos to x4 their size. 

Trained on synthetic data, meant to handle more degradations

LSDIR Compact R3

The RealESRGAN_x4plus finetuned with the big LSDIR dataset (84,991 images / 165 GB), with manually added jpg compression.

4xLSDIRplusC

4xNomos2_otf_esrgan

Scale: 4  
Architecture: ESRGAN  
Architecture Option: esrgan  
[Github Release Link](https://github.com/Phhofm/models/releases/tag/4xNomos2_otf_esrgan)  

Author: Philip Hofmann  
License: CC-BY-0.4  
Purpose: Restoration  
Subject: Photography  
Input Type: Images  
Release Date: 22.06.2024  

Dataset: Nomos-v2  
Dataset Size: 6000  
OTF (on the fly augmentations): Yes  
Pretrained Model: RealESRGAN_x4plus  
Iterations: 246'000  
Batch Size: 8  
GT Size: 256  

Description:  

4x ESRGAN model for photography, trained using the Real-ESRGAN otf degradation pipeline.  

Showcase:
[Slow Pics 8 Examples](https://slow.pics/s/Y5wdyTPh?canvas-mode=fit-width&image-fit=contain)

4xNomos2_otf_esrgan

A 4x upscaler for BC1-compressed normal maps with a zeroed-out B channel. The output normals will also have a constant-zero B channel. Use external software or image editing plugins to properly normalize the generated normals and generate the Z component (if necessary). E.g. chaiNNer can do this with Normalize Normal Map node. Do not rely on this network producing unit vectors. 

**Dataset transformation:** \
The LR have been compressed with various BC1 compression settings (dithering, weighting) using Texconv version 2021.11.8.1. Since the contents of the B channel influence the R and G channels during compression, the LR were given a B channel that was either the Z component of the normal, a random constant color, or a random texture (usually the G channel of the associated albedo) before compression. The LR + B channel was then compressed and the resulting BC1-compressed DDS was converted back into a PNG and had its B channel zeroed out.

More information: https://github.com/RunDevelopment/ESRGAN-models/blob/main/normals/README.md

Normal RG0 BC1

A 4x upscaler for BC7-compressed normal maps with a zeroed-out B channel and no alpha. The input is required to have no alpha and constant-zero blue channel. BC7-compressed images with an alpha channel should be handled by the BC1 model instead. This is because BC7 achieves very different quality for images with and without an alpha channel. The output normals will also have a constant-zero B channel. The output normals will also have a constant-zero B channel. Use external software or image editing plugins to properly normalize the generated normals and generate the Z component (if necessary). E.g. chaiNNer can do this with Normalize Normal Map node. Do not rely on this network producing unit vectors. 

**Dataset transformation:** \
The LR have been compressed using Texconv version 2021.11.8.1. Since the contents of the B channel influence the R and G channels during compression, the LR were given a B channel that was either the Z component of the normal, a random constant color, or a random texture (usually the G channel of the associated albedo) before compression. The LR + B channel was then compressed and the resulting BC7-compressed DDS was converted back into a PNG and had its B channel zeroed out.

More information: https://github.com/RunDevelopment/ESRGAN-models/blob/main/normals/README.md

Normal RG0 BC7

Project page: https://github.com/Kim2091/PBRify_Remix

Yet another model in the PBRify_Remix series. This is a new upscaler to replace the previous 4x-PBRify_UpscalerSIR-M_V2 model.

This model far exceeds the quality of the previous, with far more natural detail generation and better reconstruction of lines and edges.

Comparison: https://slow.pics/c/DCjlXPGb

4x-PBRify_UpscalerDAT2_V1

This is part of my [PBRify_Remix](<https://github.com/Kim2091/PBRify_Remix>) project. This is a much more capable model based on SwinIR Medium, which should strike a balance between capacity for learning + inference speed. It appears to have done so :)

### Replaced by 4x-PBRify_UpscalerDAT2_V1

4x-PBRify_UpscalerSIR-M_V2

This is part of a larger model set, PBRify_Remix. PBRify_Remix is an easy way to upscale and generate PBR textures using existing low quality textures. The dataset consists of ethically sourced textures from websites like ambientCG and Polyhaven, which sets it apart from most other models.

It's intended for use with RTX Remix (hence the name) but it'll work for other things as well.

4x-PBRify_UpscalerSPANV4

This model was made to upscale realistic low-res textures that are compressed by either JPEG or BC1. From my testing, this works rather well on realistic GameCube textures such as the ones from Shrek Extra Large and the board textures from Mario Party 4. This model could also work on some real life images, especially the ones that are taken outdoors.

RealisticRescaler

Purpose: Game textures/Art

This model upscales artwork for the game Volfoss (2001). The model peaked in quality very quickly. The NR model removes most noise, but has the downside of removing transparent portions. Use the main model in most cases.

VolArt

VolArtNR

A 4x upscaler for BC1-compressed wood textures. The model was trained on wood planks, wood stems, and a bit of tree bark. It performs reasonably well on woody textures and produces sharp outputs. However, it also tends to slightly shift the hue of the image, so results might appear slightly more red.

More information: https://github.com/RunDevelopment/ESRGAN-models/blob/main/wood/README.md

Architecture	ESRGAN
Scale	4x
Size	64nf23nb
Color Mode	RGB
License	WTFPL Private use Commercial use Distribution Modifications Disclaimer
Date	2021-06-23
Dataset	Custom (Ground textures Google)

Ground

Similar Models