4x photo upscaler for faces with otf jpg compression, blur and resize, trained on FFHQ dataset. This has been trained on and for faces, but i guess can also be used for other photos, might be able to retain skin detail. This is not face restoration, but simply a 4x upscaler trained on faces, therefore input images need to be of good quality if good output quality is desired.

4xFFHQDAT

Description: 4x photo upscaler for faces, trained on the FaceUp dataset. These models are an improvement over the previously released 4xFFHQDAT and are its successors. These models are released together with the FaceUp dataset, plus the accompanying [youtube video](https://www.youtube.com/watch?v=TBiVIzQkptI)

This model comes in 4 different versions:  
4xFaceUpDAT (for good quality input)  
4xFaceUpLDAT (for lower quality input, can additionally denoise)  
4xFaceUpSharpDAT (for good quality input, produces sharper output, trained without USM but sharpened input images, good quality input)  
4xFaceUpSharpLDAT (for lower quality input, produces sharper output, trained without USM but sharpened input images, can additionally denoise)  

I recommend trying out 4xFaceUpDAT

4xFaceUpLDAT

4xFaceUpSharpLDAT

4x anime image upscaler with a bit of otf jpg compression and blur. Trained on musl's hfa2k dataset release for Anime SISR, which has been extracted from modern anime films, where the selection criteria was high SNR, no DOF and high frequency information.

Examples: https://imgsli.com/MTc2NDgx (PS Example input images are small, each around 500x280 px) \
Example input files: https://drive.google.com/drive/folders/1RI6gGqRy-KxDujbaIrpEMdvFkIWHvfPt \
Example output files: https://drive.google.com/drive/folders/1GqHwPlFp6bIQl4R1AxmrmJ6vUUD8FUxH \
All my model files can be found on my github repo https://github.com/Phhofm/models

HFA2k

Purpose: 4x anime upscaler handling video compression artifacts, trained for 200 epochs

4x anime upscaler handling video compression artifacts since trained with otf degradations for "mpeg2video", "libxvid", "libx264", "libx265" with crf 20-32, mpeg bitrate 3800-5800 (together with the standard Real-ESRGAN otf pipeline). A faster arch using this otf degradation pipeline would be great for handling video compression artifacts. Since this one is a GRL model and therefore slow, [as noted by the dev](https://github.com/Kiteretsu77/VCISR-official/issues/3) maybe more for research purposes (or more for single images/screenshots). Trained using [VCISR](https://github.com/Kiteretsu77/VCISR-official) for 200 epochs.  

"This is epoch 200 and the start iteration is 85959 with learning rate 2.5e-05"  

Slow Pics examples:  
[h264_crf28](https://slow.pics/c/fqOnxXep)  
[ludvae1](https://slow.pics/c/OcukRy7d)  
[ludvae2](https://slow.pics/c/FI33mX4F)

HFA2k VCISR GRLGAN ep200

Photos/realistic 3D with JPEG compression, quality 85-95 and 4:2:0 chroma subsampling. - Created for Myst3 images, since all have 4:2:0 chroma subsampling and existing JPEG models did not give good results. Favors smoothing over over-sharpening.

Jaypeg90

Upscale small photos with compression to 4x their size.

Trying to extend my previous model to be able to handle compression (JPG 100-30) by manually altering the training dataset, since 4xLSDIRCompact can't handle compression. Use this instead of 4xLSDIRCompact if your photo has compression (like an image from the web).

LSDIR Compact C

Upscale compressed photos to x4 their size.

Able to handle JPG compression (30-100).

LSDIR Compact C3

Upscale small photos with compression, noise and slight blur to 4x their size.

Extending my last 4xLSDIRCompact model to Real-ESRGAN, meaning trained on synthetic data instead to handle more kinds of degradations, it should be able to handle compression, noise, and slight blur.

Here is a comparison to show that 4xLSDIRCompact cannot handle compression artifacts, and that these two models will produce better output for that specific scenario. These models are not ‘better’ than the previous one, they are just meant to handle a different use case.

LSDIR Compact R

A 4x photo upscale DAT model trained with otf (resize, jpg, small blur) on the LSDIR dataset.

4xLSDIRDAT

Interpolation of 4xLSDIRplusC and 4xLSDIRplusR to handle jpg compression and a little bit of noise/blur

4xLSDIRplus

The RealESRGAN_x4plus finetuned with the big LSDIR dataset (84,991 images / 165 GB), with manually added jpg compression.

4xLSDIRplusC

The RealESRGAN_x4plus finetuned with the big LSDIR dataset (84,991 images / 165 GB), with jpg compression and noise and blur

4xLSDIRplusR

Purpose: Art/CGI

Upscaler for clean images or images with compression artifacts (jpeg quality >75) - Produces very sharp lines/edges due to NN-Filtered HR images. Proven to produce very, very good results on drawings (sharp lines) and CGI, but should also work pretty well for real-world images.

NMKD PatchySharp

Universal upscaler for clean and slightly compressed images (JPEG quality 75 or better)

NMKD Siax ("CX")

4x photo upscaler with otf jpg compression and blur, trained on musl's Nomos8k_sfw dataset for realisic sr

Nomos8kSC

Purpose: 4x universal DoF preserving upscaler

4x universal DoF preserving upscaler, pair trained with jpg degradation (down to 40) and multiscale (down_up, bicubic, bilinear, box, nearest, lanczos) in neosr with adamw, unet and pixel, perceptual, gan and color losses.
Similiar to the last model I released, with same dataset, this is a full RGT model in comparison.

FP32 ONNX conversion is provided in the google drive folder for you to run it.

6 Examples (To check JPG compression handling see Example Nr.4, to check Depth of Field handlin see Example Nr.1 & Nr.6):
[Slowpics](https://slow.pics/s/iMuE3vE5)

NomosUni rgt multijpg

Purpose: 4x universal DoF preserving upscaler

4x universal DoF preserving upscaler, pair trained with jpg degradation (down to 40) and multiscale (down_up, bicubic, bilinear, box, nearest, lanczos) in neosr with adamw, unet and pixel, perceptual, gan, color and ldl losses.

Examples:
[Imgsli](https://imgsli.com/MjQwNDk5)
[Slowpics](https://slow.pics/s/sIRl3w7J)

NomosUni rgt s multijpg

4x fast universal upscaler pair trained with jpg degradation (down to 40) and multiscale (down_up, bicubic, bilinear, box, nearest, lanczos).

4x-NomosUni_span_multijpg

Purpose: 4x universal DoF preserving upscaler

4x universal DoF preserving upscaler, pair trained with jpg degradation (down to 40) and multiscale (down_up, bicubic, bilinear, box, nearest, lanczos).

NomosUniDAT2 multijpg ldl

NomosUniDAT2 multijpg ldl sharp

Category: Images
Purpose: Stylization

Photo stylization from JPEGs. Trained on images upscaled by ISO Denoise v2 -> DeJPEG Fatality PlusULTRA -> NMKD Yan2. Essentially a combination of that model chain into one. Use if you're looking for a stylized output, not photo quality.

Pretrained model: NMKD Yandere2

Rek's Effeks Photoanime v2

Description: 4x photo upscaler on the SSDIR_Sharp dataset, trained with otf for jpg, resize and small blur. This model sharpens.

4xSSDIRDAT

Pretrained: 4xESRGAN

This is my best model yet! It generates lots and lots of detail and leaves a nice texture on images. It works on most images, whether compressed or not. It does work best on JPEG compression though, as that's mostly what it was trained on. It has the ability to restore highly compressed images as well! If you want a more balanced output, check out the UltraMix Collection down below. It's a bunch of interpolated models based around UltraSharp and my other models

UltraSharp

Vast improvement over v1 in low frequency detail; moiré and artifacting reduced significantly and less random noise from JPEG artefacts in the input. Also now only works on 1 channel images, so it runs slightly faster on average and resulting images are much smaller but it might not work on some ESRGAN implementations, I personally recommend using chaiNNer. v1 may still be better in some edge cases.

There's also a supplementary 1x model that denoises very low quality LRs and smooths halftones so the image works better with the 4x model. Only trained it to help build the dataset and it's useless for already decent-ish LRs but may help you in some situations.

Architecture	RGT
Scale	4x
Color Mode	RGB
License	CC-BY-4.0 Private use Commercial use Distribution Modifications Credit required State Changes No Liability & Warranty Disclaimer
Date	2024-02-20
Dataset	nomosuni
Dataset size	2989
Training iterations	100000
Training epochs	79
Training batch size	12
Training HR size	128
Training OTF	No

NomosUni rgt multijpg

Similar Models