Nice to release a model again! This one is intended for realistic imagery, and works especially well on faces, hair, and nature shots. It should only be used on somewhat clear shots, without a lot of grain. I trained this model on SPAN, which as of the time of release, you'll need chaiNNer-nightly for. I aimed for a softer, more natural look for this model with as few artifacts as possible.

In addition to the Normal model, I've included a "soft" model. The Soft model is... softer. Basically it was an earlier version of the model with a more limited dataset. It produces more natural output on games or rendered content, but suffers a bit more with realistic stuff.

Note: In shots with DOF (depth of field) or bokeh, unfortunately there will be artifacts. 

Compatibility: You'll have to use the latest chaiNNer-nightly to use this model

ClearRealityV1

Streets with dense foliage in the background. Outdoor scenes.

CountryRoads

Official Paper pretrain model.

See https://github.com/XPixelGroup/HAT for more details.

HAT-L_SRx4_ImageNet-pretrain

Official Paper model.

See https://github.com/XPixelGroup/HAT for more details.

HAT-S_SRx4

Universal upscaler for clean and slightly compressed images (JPEG quality 75 or better)

NMKD Siax ("CX")

[Link to Github Release](https://github.com/Phhofm/models/releases/tag/4xNomos2_hq_dat2)

# 4xNomos2_hq_dat2   
Scale: 4   
Architecture: [DAT](https://github.com/zhengchen1999/dat)   
Architecture Option: [dat2](https://github.com/muslll/neosr/blob/5fba7f162d36052010169e6517dec3b406c569ab/neosr/archs/dat_arch.py#L1111)   

Author: Philip Hofmann   
License: CC-BY-0.4   
Purpose: Upscaler   
Subject: Photography   
Input Type: Images   
Release Date: 29.08.2024   

Dataset: [nomosv2](https://github.com/muslll/neosr/?tab=readme-ov-file#-datasets)   
Dataset Size: 6000   
OTF (on the fly augmentations): No   
Pretrained Model: DAT_2_x4   
Iterations: 140'000   
Batch Size: 4   
Patch Size: 48   

Description:    
A dat2 4x upscaling model, similiar to the [4xNomos2_hq_mosr](https://github.com/Phhofm/models/releases/tag/4xNomos2_hq_mosr) model, trained and for usage on non-degraded input to give good quality output.    

I scored 7 validation outputs of each of the 21 checkpoints (10k-210k) of this model training with 68 metrics.    
[The metric scores can be found in this google sheet](https://docs.google.com/spreadsheets/d/1NL-by7WvZyDMHj5XN8UeDALVSSwH70IKvwV65ATWqrA/edit?usp=sharing).   
The corresponding image files for this scoring can be [found here](https://drive.google.com/file/d/1ZTp9fBMeawftNqzg4RN9_zIvHtul5jVc/view?usp=sharing)     
Screenshot of the google sheet:     
![|100](https://i.slow.pics/VZJTsrUv.webp)

Release checkpoint has been selected by looking at the scores, manually inspecting, and then getting responses on discord to this quick visual test, A B or C, which denote different checkpoints: https://slow.pics/c/8Akzj6rR   

Checkpoint B is the one released here, but you can also try out [Checkpoint A](https://github.com/Phhofm/models/releases/download/4xNomos2_hq_dat2/4xNomos2_hq_dat2_150000.pth) or [Checkpoint C](https://github.com/Phhofm/models/releases/download/4xNomos2_hq_dat2/4xNomos2_hq_dat2_10000.pth) if you like them better.

## Model Showcase:
[Slowpics](https://slow.pics/c/yuue9WpF)

4xNomos2_hq_dat2

[Link to Github Release](https://github.com/Phhofm/models/releases/tag/4xNomos2_hq_mosr)

# 4xNomos2_hq_mosr  
Scale: 4  
Architecture: [MoSR](https://github.com/umzi2/MoSR)  
Architecture Option: [mosr](https://github.com/umzi2/MoSR/blob/95c5bf73cca014493fe952c2fbc0bdbe593da08f/neosr/archs/mosr_arch.py#L117)  

Author: Philip Hofmann  
License: CC-BY-0.4  
Purpose: Upscaler  
Subject: Photography  
Input Type: Images  
Release Date: 25.08.2024  

Dataset: [nomosv2](https://github.com/muslll/neosr/?tab=readme-ov-file#-datasets)  
Dataset Size: 6000  
OTF (on the fly augmentations): No  
Pretrained Model: [4xmssim_mosr_pretrain](https://github.com/Phhofm/models/releases/tag/4xmssim_mosr_pretrain)  
Iterations: 190'000  
Batch Size: 6  
Patch Size: 64  

Description:   
A 4x [MoSR](https://github.com/umzi2/MoSR) upscaling model, meant for non-degraded input, since this model was trained on non-degraded input to give good quality output.   

If your input is degraded, use a 1x degrade model first. So for example if your input is a .jpg file, you could use a 1x dejpg model first.  

Model Showcase:  [Slowpics](https://slow.pics/c/cqGJb0gT)

4xNomos2_hq_mosr

[Link to Github Release](https://github.com/Phhofm/models/releases/4xNomos8k_atd_jpg)

Name: 4xNomos8k_atd_jpg   
License: CC BY 4.0   
Author: Philip Hofmann   
Network: [ATD](https://github.com/LabShuHangGU/Adaptive-Token-Dictionary)   
Scale: 4   
Release Date: 22.03.2024   
Purpose: 4x photo upscaler, handles jpg compression   
Iterations: 240'000   
epoch: 152   
batch_size: 6, 3   
HR_size: 128, 192   
Dataset: nomos8k   
Number of train images: 8492   
OTF Training: Yes   
Pretrained_Model_G: 003_ATD_SRx4_finetune   

Description:
4x photo upscaler which handles jpg compression. This model will preserve noise. Trained on the very recently released (~2 weeks ago) Adaptive-Token-Dictionary network.   

Training details: 
AdamW optimizer with U-Net SN discriminator and BFloat16.
Degraded with otf jpg compression down to 40, re-compression down to 40, together with resizes and the blur kernels.  
Losses: PixelLoss using CHC (Clipped Huber with Cosine Similarity Loss), PerceptualLoss using Huber, GANLoss, [LDL](https://github.com/csjliang/LDL) using Huber, YCbCr Color Loss (bt601) and Luma Loss (CIE XYZ) on [neosr](https://github.com/muslll/neosr).

7 Examples:
[Slowpics](https://slow.pics/s/uwnoI435)

 4xNomos8k_atd_jpg

I release my span otf series:
They come in three variations: weak, middle, and strong.
Mainly meant for photos (can be tried on other things of course).

(Also there is a non-otf span model I had been working on simultaneously that I will release shortly, should give better results on less degraded input in comparison to this span otf series)

Basically I trained the otf_strong for 90k iter and then medium and weak based off that, with some more training to de-learn (tone down) the (too?) strong degradations. Used discrim resets to correct occuring colorloss in all of them. gt size was for the most part 512 with batch 9 (since i hoped it would give better results) with 0.55 it/s training speed (first 40k at the beginning were gt size 256 with batch 20 with 0.58 it/s).

Nomos8k_span_otf_medium

Nomos8k_span_otf_strong

Nomos8k_span_otf_weak

Nomos8kHAT-L_otf

NomosUniDAT_otf

4x general purpose upscaler for non-degraded content.

Has been trained as paired dataset on box downsamples as a DAT2 model, AdamW with pixel, perceptual, gan, color, ldl and ff loss.

4xNomosUniDAT2_box

[Omni Aggregation Networks for Lightweight Image Super-Resolution (OmniSR)](https://github.com/Francis0625/Omni-SR)

While lightweight ViT framework has made tremendous progress in image super-resolution, its uni-dimensional
self-attention modeling, as well as homogeneous aggregation scheme, limit its effective receptive field (ERF) to
include more comprehensive interactions from both spatial and channel dimensions. To tackle these drawbacks,
this work proposes two enhanced components under a new Omni-SR architecture. First, an Omni Self-Attention (OSA) block is proposed based on dense interaction principle, which can simultaneously model pixel-interaction from both spatial and channel dimensions, mining the potential correlations across omni-axis (i.e., spatial and channel). Coupling with mainstream window partitioning strategies, OSA can achieve superior performance with compelling computational budgets. Second, a multi-scale interaction scheme is proposed to mitigate sub-optimal ERF (i.e., premature saturation) in shallow models, which facilitates local propagation and meso-/global-scale interactions, rendering an omni-scale aggregation building block. Extensive experiments demonstrate that Omni-SR achieves recordhigh performance on lightweight super-resolution benchmarks (e.g., 26.95dB@Urban100 ×4 with only 792K parameters). Our code is available at https://github.com/Francis0625/Omni-SR

OmniSR 4x DF2K

OmniSR 4x DIV2K

Pretrained: 4xESRGAN

This is my best model yet! It generates lots and lots of detail and leaves a nice texture on images. It works on most images, whether compressed or not. It does work best on JPEG compression though, as that's mostly what it was trained on. It has the ability to restore highly compressed images as well! If you want a more balanced output, check out the UltraMix Collection down below. It's a bunch of interpolated models based around UltraSharp and my other models

UltraSharp

UniScale strikes a nice balance between sharpness and realism. This model can upscale almost anything well. It was originally intended to upscale game textures, but was expanded into a universal upscaler. Interp is these two models interpolated.

UniScale Balanced

UniScale_Restore has strong compression removal that helps with restoring heavily compressed or noisy images. It is intended to compete with BSRGAN. Trained with BSRGAN_Resize and Combo_Noise in traiNNer.

UniScale Restore

UniScale Strong

Version of UniScale trained with camera noise injection (NR = Noise Removal). This model removes noise from images while upscaling.

UniScaleNR Balanced

UniScaleNR Strong

These models work great on game textures when interpolated 50/50 with UniScale_Restore, and work amazingly on uncompressed images. DO NOT USE FOR COMPRESSED IMAGES, use the original UniScale or UltraSharp for that.

Architecture	ESRGAN
Scale	4x
Size	64nf23nb
Color Mode	RGB
License	CC-BY-NC-SA-4.0 Private use Distribution Modifications Credit required Same License State Changes No Liability & Warranty Disclaimer
Date	2021-08-23
Dataset	Custom Dataset consisting of lossless 4k frames from Metal Arms: Glitch in the System, Just Cause 3, Dirt 3, Forza Horizon 3, Sleeping Dogs, and self-edited photos from SignatureEdits
Dataset size	18909
Training iterations	140000
Training batch size	4
Training HR size	128

UniScale Balanced

Similar Models