2x SRFormer_light anime upscale model that handles AVC (h264) compression since h264 crf 20-28 degradation together with bicubic, bilinear, box and lanczos downsampling has been applied on musl's HFA2k dataset with Kim's dataset destroyer for training.


If you want to run this model with chaiNNer (or another application) you need to use the onnx files with an onnx upscale node. All onnx conversions can be found in the [onnx folder on my repo](https://github.com/Phhofm/models/tree/main/2xHFA2kAVCSRFormer_light/onnx).

Example 1: https://imgsli.com/MTkxMTQz

Example 2: https://imgsli.com/MTkxMTQ0

2xHFA2kAVCSRFormer_light

Category: VHS Tapes
Purpose: VHS

VHS captures of Film material, but may work on VHS recorded native SD-TV material as well. Also useable for cleaned up source material

VHS upscale and denoise Film

DeIndeo

Category: Fabric/Cloth
Purpose: Fabric

This model set upscales fabric or cloth textures (works on cats too!). The Alt model is just an earlier iteration version. It may work better on some images.The images need to be minimally compressed or passed through a decompression model first. It works with DDS compression though.

Fabric

Fabric-Alt

This model is intended to mainly handle PS2 compression and a mixture of Realistic and cartoonish textures, it's not meant to be used for very low resolution textures such as item icons.

GameAI 2.0

Gamecube and Wii textures Dumps.

https://github.com/Venomalia/HDcube/tree/main/v2

HDCube2

Purpose: Gamecube and Wii textures.
Pretrained: 4x_HDcube2

It can be used for all image formats supported by Gamecube and Wii hardware and can remove its typical artifacts like CMPR Block Compression (DXT1 algorithm, also known as BC1), color palette errors, color reduction up to 8bit color depth and 1bit alpha depth.

HDCube3

4x anime image upscaler with a bit of otf jpg compression and blur. Trained on musl's hfa2k dataset release for Anime SISR, which has been extracted from modern anime films, where the selection criteria was high SNR, no DOF and high frequency information.

Examples: https://imgsli.com/MTc2NDgx (PS Example input images are small, each around 500x280 px) \
Example input files: https://drive.google.com/drive/folders/1RI6gGqRy-KxDujbaIrpEMdvFkIWHvfPt \
Example output files: https://drive.google.com/drive/folders/1GqHwPlFp6bIQl4R1AxmrmJ6vUUD8FUxH \
All my model files can be found on my github repo https://github.com/Phhofm/models

HFA2k

Purpose: 4x anime upscaler handling video compression artifacts, trained for 200 epochs

4x anime upscaler handling video compression artifacts since trained with otf degradations for "mpeg2video", "libxvid", "libx264", "libx265" with crf 20-32, mpeg bitrate 3800-5800 (together with the standard Real-ESRGAN otf pipeline). A faster arch using this otf degradation pipeline would be great for handling video compression artifacts. Since this one is a GRL model and therefore slow, [as noted by the dev](https://github.com/Kiteretsu77/VCISR-official/issues/3) maybe more for research purposes (or more for single images/screenshots). Trained using [VCISR](https://github.com/Kiteretsu77/VCISR-official) for 200 epochs.  

"This is epoch 200 and the start iteration is 85959 with learning rate 2.5e-05"  

Slow Pics examples:  
[h264_crf28](https://slow.pics/c/fqOnxXep)  
[ludvae1](https://slow.pics/c/OcukRy7d)  
[ludvae2](https://slow.pics/c/FI33mX4F)

HFA2k VCISR GRLGAN ep200

[Link to Github Release](https://github.com/Phhofm/models/releases/tag/4xHFA2k_ludvae_realplksr_dysample)

4xHFA2k_ludvae_realplksr_dysample  
Scale: 4  
Architecture: [RealPLKSR with Dysample](https://github.com/muslll/neosr/?tab=readme-ov-file#supported-archs)  
Architecture Option: [realplksr](https://github.com/muslll/neosr/blob/master/neosr/archs/realplksr_arch.py)  

Author: Philip Hofmann  
License: CC-BY-0.4 
Purpose: Restoration  
Subject: Anime  
Input Type: Images  
Release Date: 13.07.2024  

Dataset: HFA2k_LUDVAE  
Dataset Size: 10'272  
OTF (on the fly augmentations): No  
Pretrained Model: [4xNomos2_realplksr_dysample](https://github.com/Phhofm/models/releases/tag/4xNomos2_realplksr_dysample)  
Iterations: 165'000  
Batch Size: 12  
GT Size: 256  

Description:  
A Dysample RealPLKSR 4x upscaling model for anime single-image resolution.  
The dataset has been degraded using DM600_LUDVAE, for more realistic noise/compression. Downscaling algorithms used were imagemagick box, triangle, catrom, lanczos and mitchell. Blurs applied were gaussian, box and lens blur (using chaiNNer). Some images were further compressed using -quality 75-92. Down-up was applied to roughly 10% of the dataset (5 to 15% variation in size). Degradations orders were shuffled, to give as many variations as possible.  

Examples are inferenced with [neosr](https://github.com/muslll/neosr) testscript and the released pth file. I include the test images also as a zip file in this release together with the model outputs, so others can test their models against these test images aswell to compare.  

onnx conversions are  static since dysample doesnt allow dynamic conversion, I tested the conversions with [chaiNNer](https://github.com/chaiNNer-org/chaiNNer).  

Showcase:  
[Slowpics](https://slow.pics/c/FKDZAcyI)

4xHFA2k_ludvae_realplksr_dysample

4x anime super-resolution with real degradation.

4xHFA2kLUDVAEGRL_small

4x lightweight anime upscaler with realistic degradations (compression, noise, blur).

4xHFA2kLUDVAESRFormer_light

4xHFA2kLUDVAESwinIR_light

Photos/realistic 3D with JPEG compression, quality 85-95 and 4:2:0 chroma subsampling. - Created for Myst3 images, since all have 4:2:0 chroma subsampling and existing JPEG models did not give good results. Favors smoothing over over-sharpening.

Jaypeg90

Upscale small photos with compression to 4x their size.

Trying to extend my previous model to be able to handle compression (JPG 100-30) by manually altering the training dataset, since 4xLSDIRCompact can't handle compression. Use this instead of 4xLSDIRCompact if your photo has compression (like an image from the web).

LSDIR Compact C

Upscale compressed photos to x4 their size.

Able to handle JPG compression (30-100).

LSDIR Compact C3

Upscale small photos with compression, noise and slight blur to 4x their size.

Extending my last 4xLSDIRCompact model to Real-ESRGAN, meaning trained on synthetic data instead to handle more kinds of degradations, it should be able to handle compression, noise, and slight blur.

Here is a comparison to show that 4xLSDIRCompact cannot handle compression artifacts, and that these two models will produce better output for that specific scenario. These models are not ‘better’ than the previous one, they are just meant to handle a different use case.

LSDIR Compact R

The RealESRGAN_x4plus finetuned with the big LSDIR dataset (84,991 images / 165 GB), with manually added jpg compression.

4xLSDIRplusC

Purpose: Art/CGI

Upscaler for clean images or images with compression artifacts (jpeg quality >75) - Produces very sharp lines/edges due to NN-Filtered HR images. Proven to produce very, very good results on drawings (sharp lines) and CGI, but should also work pretty well for real-world images.

NMKD PatchySharp

Universal upscaler for clean and slightly compressed images (JPEG quality 75 or better)

NMKD Siax ("CX")

4xNomos2_otf_esrgan

Scale: 4  
Architecture: ESRGAN  
Architecture Option: esrgan  
[Github Release Link](https://github.com/Phhofm/models/releases/tag/4xNomos2_otf_esrgan)  

Author: Philip Hofmann  
License: CC-BY-0.4  
Purpose: Restoration  
Subject: Photography  
Input Type: Images  
Release Date: 22.06.2024  

Dataset: Nomos-v2  
Dataset Size: 6000  
OTF (on the fly augmentations): Yes  
Pretrained Model: RealESRGAN_x4plus  
Iterations: 246'000  
Batch Size: 8  
GT Size: 256  

Description:  

4x ESRGAN model for photography, trained using the Real-ESRGAN otf degradation pipeline.  

Showcase:
[Slow Pics 8 Examples](https://slow.pics/s/Y5wdyTPh?canvas-mode=fit-width&image-fit=contain)

4xNomos2_otf_esrgan

4xNomos2_realplksr_dysample  
Scale: 4  
Architecture: [RealPLKSR with Dysample](https://github.com/muslll/neosr/?tab=readme-ov-file#supported-archs)  
Architecture Option: [realplksr](https://github.com/muslll/neosr/blob/master/neosr/archs/realplksr_arch.py)  
[Github Release](https://github.com/Phhofm/models/releases/tag/4xNomos2_realplksr_dysample)  

Author: Philip Hofmann  
License: CC-BY-0.4  
Purpose: Pretrained  
Subject: Photography  
Input Type: Images  
Release Date: 30.06.2024  

Dataset: [nomosv2](https://github.com/muslll/neosr/?tab=readme-ov-file#-datasets)  
Dataset Size: 6000  
OTF (on the fly augmentations): No  
Pretrained Model: [4xmssim_realplksr_dysample_pretrain](https://github.com/Phhofm/models/releases/tag/4xmssim_realplksr_dysample_pretrain)  
Iterations: 185'000  
Batch Size: 8  
GT Size: 256, 512  

Description: 
A Dysample RealPLKSR 4x upscaling model that was trained with / handles jpg compression down to 70 on the Nomosv2 dataset, preserves DoF.   
Based on the [4xmssim_realplksr_dysample_pretrain](https://github.com/Phhofm/models/releases/tag/4xmssim_realplksr_dysample_pretrain) I released 3 days ago.  
This model affects / saturate colors, which can be counteracted a bit by using wavelet color fix, as used in these examples.  

Showcase:
[Slowpics](https://slow.pics/s/p3sMnd5l)

4xNomos2_realplksr_dysample

4x photo upscaler with otf jpg compression and blur, trained on musl's Nomos8k_sfw dataset for realisic sr

Nomos8kSC

Purpose: 4x universal DoF preserving upscaler

4x universal DoF preserving upscaler, pair trained with jpg degradation (down to 40) and multiscale (down_up, bicubic, bilinear, box, nearest, lanczos) in neosr with adamw, unet and pixel, perceptual, gan and color losses.
Similiar to the last model I released, with same dataset, this is a full RGT model in comparison.

FP32 ONNX conversion is provided in the google drive folder for you to run it.

6 Examples (To check JPG compression handling see Example Nr.4, to check Depth of Field handlin see Example Nr.1 & Nr.6):
[Slowpics](https://slow.pics/s/iMuE3vE5)

Architecture	ESRGAN
Scale	4x
Size	64nf23nb
Color Mode	RGB
License	WTFPL Private use Commercial use Distribution Modifications Disclaimer
Date	2020-08-15
Dataset	own custom dataset
Training iterations	130000
Training batch size	8
Training HR size	128
Training OTF	No

DeIndeo

Similar Models