4x photo upscaler for faces with otf jpg compression, blur and resize, trained on FFHQ dataset. This has been trained on and for faces, but i guess can also be used for other photos, might be able to retain skin detail. This is not face restoration, but simply a 4x upscaler trained on faces, therefore input images need to be of good quality if good output quality is desired.

4xFFHQDAT

4x anime image upscaler with a bit of otf jpg compression and blur. Trained on musl's hfa2k dataset release for Anime SISR, which has been extracted from modern anime films, where the selection criteria was high SNR, no DOF and high frequency information.

Examples: https://imgsli.com/MTc2NDgx (PS Example input images are small, each around 500x280 px) \
Example input files: https://drive.google.com/drive/folders/1RI6gGqRy-KxDujbaIrpEMdvFkIWHvfPt \
Example output files: https://drive.google.com/drive/folders/1GqHwPlFp6bIQl4R1AxmrmJ6vUUD8FUxH \
All my model files can be found on my github repo https://github.com/Phhofm/models

HFA2k

Upscale small photos with compression to 4x their size.

Trying to extend my previous model to be able to handle compression (JPG 100-30) by manually altering the training dataset, since 4xLSDIRCompact can't handle compression. Use this instead of 4xLSDIRCompact if your photo has compression (like an image from the web).

LSDIR Compact C

Upscale compressed photos to x4 their size.

Able to handle JPG compression (30-100).

LSDIR Compact C3

A 4x photo upscale DAT model trained with otf (resize, jpg, small blur) on the LSDIR dataset.

4xLSDIRDAT

Interpolation of 4xLSDIRplusC and 4xLSDIRplusR to handle jpg compression and a little bit of noise/blur

4xLSDIRplus

The RealESRGAN_x4plus finetuned with the big LSDIR dataset (84,991 images / 165 GB), with manually added jpg compression.

4xLSDIRplusC

The RealESRGAN_x4plus finetuned with the big LSDIR dataset (84,991 images / 165 GB), with jpg compression and noise and blur

4xLSDIRplusR

Upscale Anime while keeping as much of the original detail as possible. Isn't among the sharpest models and if the anime is somewhat blurry it will retain that detail but add more pixels to give a smoother edge. Doesn't change the color very much and may make some scene's very slightly darker.

Pretrained model: Pony Models

Loyaldk Giroro

Loyaldk Keroro

Loyaldk Kororo

Good for Vector 2D art however converts detail to blobs. Quality seems weak with this one. However posting anyways to see if a use is found.

Loyaldk LitePony V2.0

Upscale MLP episodes. Full version. Able to handle compression better compared to V1.0 and no longer creates halo's/rainbows. Good for Vector 2D art however converts detail to blobs.

Loyaldk MediumPony V2.0

Loyaldk SuperPony V2.0

4xNomos2_otf_esrgan

Scale: 4  
Architecture: ESRGAN  
Architecture Option: esrgan  
[Github Release Link](https://github.com/Phhofm/models/releases/tag/4xNomos2_otf_esrgan)  

Author: Philip Hofmann  
License: CC-BY-0.4  
Purpose: Restoration  
Subject: Photography  
Input Type: Images  
Release Date: 22.06.2024  

Dataset: Nomos-v2  
Dataset Size: 6000  
OTF (on the fly augmentations): Yes  
Pretrained Model: RealESRGAN_x4plus  
Iterations: 246'000  
Batch Size: 8  
GT Size: 256  

Description:  

4x ESRGAN model for photography, trained using the Real-ESRGAN otf degradation pipeline.  

Showcase:
[Slow Pics 8 Examples](https://slow.pics/s/Y5wdyTPh?canvas-mode=fit-width&image-fit=contain)

4xNomos2_otf_esrgan

4xNomos2_realplksr_dysample  
Scale: 4  
Architecture: [RealPLKSR with Dysample](https://github.com/muslll/neosr/?tab=readme-ov-file#supported-archs)  
Architecture Option: [realplksr](https://github.com/muslll/neosr/blob/master/neosr/archs/realplksr_arch.py)  
[Github Release](https://github.com/Phhofm/models/releases/tag/4xNomos2_realplksr_dysample)  

Author: Philip Hofmann  
License: CC-BY-0.4  
Purpose: Pretrained  
Subject: Photography  
Input Type: Images  
Release Date: 30.06.2024  

Dataset: [nomosv2](https://github.com/muslll/neosr/?tab=readme-ov-file#-datasets)  
Dataset Size: 6000  
OTF (on the fly augmentations): No  
Pretrained Model: [4xmssim_realplksr_dysample_pretrain](https://github.com/Phhofm/models/releases/tag/4xmssim_realplksr_dysample_pretrain)  
Iterations: 185'000  
Batch Size: 8  
GT Size: 256, 512  

Description: 
A Dysample RealPLKSR 4x upscaling model that was trained with / handles jpg compression down to 70 on the Nomosv2 dataset, preserves DoF.   
Based on the [4xmssim_realplksr_dysample_pretrain](https://github.com/Phhofm/models/releases/tag/4xmssim_realplksr_dysample_pretrain) I released 3 days ago.  
This model affects / saturate colors, which can be counteracted a bit by using wavelet color fix, as used in these examples.  

Showcase:
[Slowpics](https://slow.pics/s/p3sMnd5l)

4xNomos2_realplksr_dysample

A 4x photo upscaler with otf jpg compression, blur and resize, trained on musl's Nomos8k_sfw dataset for realisic sr, this time based on the [DAT arch](https://github.com/zhengchen1999/DAT), as a finetune on the official 4x DAT model.


The 295 MB file is the pth file which can be run with the [dat reo github code](https://github.com/zhengchen1999/DAT). The 85.8 MB file is an onnx conversion.


All Files can be found in [this google drive folder](https://drive.google.com/drive/folders/1b2vQHxlFQrVW22osIhQbDk98sdXzzFkx). If above onnx file is not working, you can try the other conversions in the onnx subfolder.


Examples:

[Imgsli1](https://imgsli.com/MTk4Mjg1) (generated with onnx file)

[Imgsli2](https://imgsli.com/MTk4Mjg2) (generated with onnx file)

[Imgsli](https://imgsli.com/MTk4Mjk5) (generated with testscript of dat repo on the three test images in dataset/single with pth file)

4xNomos8kDAT

4x photo upscaler with otf jpg compression and blur, trained on musl's Nomos8k_sfw dataset for realisic sr

Nomos8kSC

Purpose: 4x universal DoF preserving upscaler

4x universal DoF preserving upscaler, pair trained with jpg degradation (down to 40) and multiscale (down_up, bicubic, bilinear, box, nearest, lanczos) in neosr with adamw, unet and pixel, perceptual, gan and color losses.
Similiar to the last model I released, with same dataset, this is a full RGT model in comparison.

FP32 ONNX conversion is provided in the google drive folder for you to run it.

6 Examples (To check JPG compression handling see Example Nr.4, to check Depth of Field handlin see Example Nr.1 & Nr.6):
[Slowpics](https://slow.pics/s/iMuE3vE5)

NomosUni rgt multijpg

Purpose: 4x universal DoF preserving upscaler

4x universal DoF preserving upscaler, pair trained with jpg degradation (down to 40) and multiscale (down_up, bicubic, bilinear, box, nearest, lanczos) in neosr with adamw, unet and pixel, perceptual, gan, color and ldl losses.

Examples:
[Imgsli](https://imgsli.com/MjQwNDk5)
[Slowpics](https://slow.pics/s/sIRl3w7J)

NomosUni rgt s multijpg

4x fast universal upscaler pair trained with jpg degradation (down to 40) and multiscale (down_up, bicubic, bilinear, box, nearest, lanczos).

4x-NomosUni_span_multijpg

Purpose: 4x universal DoF preserving upscaler

4x universal DoF preserving upscaler, pair trained with jpg degradation (down to 40) and multiscale (down_up, bicubic, bilinear, box, nearest, lanczos).

NomosUniDAT2 multijpg ldl

NomosUniDAT2 multijpg ldl sharp

Description: 4x photo upscaler on the SSDIR_Sharp dataset, trained with otf for jpg, resize and small blur. This model sharpens.

4xSSDIRDAT

## 4xTextures_GTAV_rgt-s_dither

**Scale:** 4  
**Architecture:** [RGT](https://github.com/zhengchen1999/RGT)  
**Architecture Option:** RGT-S  

**Author:** Philip Hofmann  
**License:** CC-BY-0.4  
**Purpose:** Restoration  
**Subject:** Game Textures  
**Input Type:** Images  
**Release Date:** 08.05.2024  

**Dataset:** [GTAV_512_Textures](https://discord.com/channels/547949405949657098/905446120333930566/1132367991808466975)  
**Dataset Size:** 7061  
**OTF (on the fly augmentations):** No  
**Pretrained Model:** 4xTextures_GTAV_rgt-s  
**Iterations:** 128'000  
**Batch Size:** 6,4  
**GT Size:** 128,256  

**Description:**
A model to upscale game textures, trained on GTAV Textures, handles jpg compression down to 80 and was trained with dithering. Basically the previous 4xTextures_GTAV_rgt-s model but extended to handle dithering.

**Showcase:**  
[Slow Pics 25 Examples](https://slow.pics/s/EW7Ifiuw)

Architecture	SPAN
Scale	4x
Color Mode	RGB
License	CC-BY-4.0 Private use Commercial use Distribution Modifications Credit required State Changes No Liability & Warranty Disclaimer
Date	2023-12-15
Dataset	nomos_uni
Dataset size	2989
Training iterations	57000
Training epochs	33
Training batch size	9
Training HR size	512

4x-NomosUni_span_multijpg

Similar Models