Name: 4x NumericFrames 2.0
Author: Muf

Restore frames to their original look as on Drawings. Before analog transfer

Trained on thousands of 4K HQ Drawing scans, the purpose of this model is restore the frame to its original paper and plastic look, with a particular emphasis on textures and preserving those brushstrokes and natural lines. Not to be used with heavily grainy sources.
Note: The random white speckles are an unfortunate side effect of not filtering the dataset.

AnalogFrames 1.0

Interpolation between 4x-UltraSharp and 4x-TextSharp-v0.5. Works amazingly on anime. It also upscales text, but it's far better with anime content. I rebranded this model on 2/10/22 to 4x-AnimeSharp from 4x-TextSharpV1.

Pretrained model: Interpolation between 4x-UltraSharp and 4x-TextSharp-v0.5

AnimeSharp

This model is a lite version of AnimeSharp. It was trained using student-teacher learning (if i'm using the term properly), where the HRs are LRs upscaled by the full size AnimeSharp ESRGAN model, and the lite model is trained on those outputs as the HR. It works best on clean or slightly blurry anime. Downscale by 50% first in almost all cases

AnimeSharp lite

This model is designed to mainly upscale anime artworks.

BooruGan 600k

This model is designed to mainly upscale anime artworks. If you have issues with chroma then try the 600k iterations release.

BooruGan 650k

Purpose: upscale anime from dvd

Anime upscale from dvd with x4, a little softer lines and look but keeps the colors.

https://imgsli.com/MjM3ODEy

Drawimation compact

Images from the Fate/Extra games. Works better on the newer ones.

Just a model I trained quickly to test traiNNer-redux and see what I could do with OTF. Works well enough

FatePlus Compact

4x anime image upscaler with a bit of otf jpg compression and blur. Trained on musl's hfa2k dataset release for Anime SISR, which has been extracted from modern anime films, where the selection criteria was high SNR, no DOF and high frequency information.

Examples: https://imgsli.com/MTc2NDgx (PS Example input images are small, each around 500x280 px) \
Example input files: https://drive.google.com/drive/folders/1RI6gGqRy-KxDujbaIrpEMdvFkIWHvfPt \
Example output files: https://drive.google.com/drive/folders/1GqHwPlFp6bIQl4R1AxmrmJ6vUUD8FUxH \
All my model files can be found on my github repo https://github.com/Phhofm/models

HFA2k

Purpose: 4x anime upscaler handling video compression artifacts, trained for 200 epochs

4x anime upscaler handling video compression artifacts since trained with otf degradations for "mpeg2video", "libxvid", "libx264", "libx265" with crf 20-32, mpeg bitrate 3800-5800 (together with the standard Real-ESRGAN otf pipeline). A faster arch using this otf degradation pipeline would be great for handling video compression artifacts. Since this one is a GRL model and therefore slow, [as noted by the dev](https://github.com/Kiteretsu77/VCISR-official/issues/3) maybe more for research purposes (or more for single images/screenshots). Trained using [VCISR](https://github.com/Kiteretsu77/VCISR-official) for 200 epochs.  

"This is epoch 200 and the start iteration is 85959 with learning rate 2.5e-05"  

Slow Pics examples:  
[h264_crf28](https://slow.pics/c/fqOnxXep)  
[ludvae1](https://slow.pics/c/OcukRy7d)  
[ludvae2](https://slow.pics/c/FI33mX4F)

HFA2k VCISR GRLGAN ep200

[Link to Github Release](https://github.com/Phhofm/models/releases/tag/4xHFA2k_ludvae_realplksr_dysample)

4xHFA2k_ludvae_realplksr_dysample  
Scale: 4  
Architecture: [RealPLKSR with Dysample](https://github.com/muslll/neosr/?tab=readme-ov-file#supported-archs)  
Architecture Option: [realplksr](https://github.com/muslll/neosr/blob/master/neosr/archs/realplksr_arch.py)  

Author: Philip Hofmann  
License: CC-BY-0.4 
Purpose: Restoration  
Subject: Anime  
Input Type: Images  
Release Date: 13.07.2024  

Dataset: HFA2k_LUDVAE  
Dataset Size: 10'272  
OTF (on the fly augmentations): No  
Pretrained Model: [4xNomos2_realplksr_dysample](https://github.com/Phhofm/models/releases/tag/4xNomos2_realplksr_dysample)  
Iterations: 165'000  
Batch Size: 12  
GT Size: 256  

Description:  
A Dysample RealPLKSR 4x upscaling model for anime single-image resolution.  
The dataset has been degraded using DM600_LUDVAE, for more realistic noise/compression. Downscaling algorithms used were imagemagick box, triangle, catrom, lanczos and mitchell. Blurs applied were gaussian, box and lens blur (using chaiNNer). Some images were further compressed using -quality 75-92. Down-up was applied to roughly 10% of the dataset (5 to 15% variation in size). Degradations orders were shuffled, to give as many variations as possible.  

Examples are inferenced with [neosr](https://github.com/muslll/neosr) testscript and the released pth file. I include the test images also as a zip file in this release together with the model outputs, so others can test their models against these test images aswell to compare.  

onnx conversions are  static since dysample doesnt allow dynamic conversion, I tested the conversions with [chaiNNer](https://github.com/chaiNNer-org/chaiNNer).  

Showcase:  
[Slowpics](https://slow.pics/c/FKDZAcyI)

4xHFA2k_ludvae_realplksr_dysample

4x anime super-resolution with real degradation.

4xHFA2kLUDVAEGRL_small

4x lightweight anime upscaler with realistic degradations (compression, noise, blur).

4xHFA2kLUDVAESRFormer_light

4xHFA2kLUDVAESwinIR_light

Upscaling of Numeric Animation from SD to HD with high texture retention.

A serious upgrade over 1.0. Much more universality. Can look good on both clean SD and noisy/grainy source frames. It still has a weakness against sources with strong halos and jagged edges and rainbowing. (Recommended that these issues are fixed beforehand with avisynth)

NumericFrames 2.0

Upscaling of Numeric Animation from SD to HD with high texture retention.

Provides the sharpest results yet. About 30% better than the base 2.0 version. But as the title says it's the most aggressive version of NF. Does it's best on animation with little to no textures. The model as well as any version of NF is not suitable at all for overly deteriorated/blurred and low quality TVRips and VHSRips copies of animation pieces.

NumericFrames 2.1-Aggressive

Upscaling of Numeric Animation from SD to HD with high texture retention.

Big leap from 2.0, especially as much as texture retention is concerned. But also deals much better with distant characters/shots.

NumericFrames 2.5

This model is based on a private model by @eula 5600x 3070 named 4x_eula_anifilm_v1_225k. He sent me a copy of the model, and I decided to train a compact model based on it with his permission. This model seems to fix the majority of the issues the original model had while being far faster, it's just a tiny bit softer in some images.

The dataset consists of Dragon Ball movies converted to YUV24 with @sgdisk --zap-all /dev/sda's help to reduce artifacts, then upscaled with ArtClarity and eula_anifilm. LRs are the original frames right from DVD. As a result, this model corrects some color space issues. The 2x model's HRs were downscaled by 50% with Lanczos.

The 2x and 4x models are pretty close in output despite being trained separately. The 2x model is a bit softer overall.

The models in the Real-ESRGAN Compatible folder are the original output from Real-ESRGANs training code for compatibility reasons.

Anifilm Compact (4x)

Anime super-resolution, with real degradation.

animerd v1

This is the first community model using the OmniSR network. I trained it mostly to test this network.\nNote: the model output decreases brightness. This is a well known issue we had with OmniSR.

4x_ardo

Purpose: Anime / Visual Novel Art

Third iteration of my eroge upscaling model. Discriminator: https://drive.google.com/file/d/18q-4ktFNZ8tPjkszuoG6kVBhCjKl8iFa/view?usp=sharing

escale

Upscaling cel animation. Trained this more than a year ago, releasing cause I've got a much better v2 and v3 now.

eula_anifilm v1

[Link to Github Release](https://github.com/Phhofm/models/releases/tag/4xDRCT-mssim-pretrains)

Since no [DRCT](https://github.com/ming053l/DRCT/tree/main) model releases exist yet, I am releasing my drct-s, drct and drct-l pretrains. 
These can be used to speed up and stabilize early training stages when training new drct models.
Trained with mssim (and augs, and color and lumaloss) on downscaled [nomosuni](https://github.com/muslll/neosr/tree/0ecbeb98dcefd97801da0ea39ca2cd03a87fce21?tab=readme-ov-file#datasets).
Training files are also provided additionally.

## 4xmssim_drct-l_pretrain

**Scale:** 4  
**Architecture:** [DRCT](https://github.com/ming053l/DRCT)  
**Architecture Option:** [DRCT-L](https://github.com/ming053l/DRCT/blob/8c13e63135f494913cd504c073e41ef52250d1d4/options/train/train_DRCT-L_SRx4_ImageNet_from_scratch.yml#L55)  

**Author:** Philip Hofmann  
**License:** CC-BY-0.4  
**Purpose:** Pretrained  
**Subject:** Anime, Photography  
**Input Type:** Images  
**Release Date:** 28.04.2024  

**Dataset:** [nomos_uni](https://github.com/muslll/neosr?tab=readme-ov-file#datasets)  
**Dataset Size:** 2989  
**OTF (on the fly augmentations):** No  
**Pretrained Model:** None (=From Scratch)  
**Iterations:** 108'000  
**Batch Size:** 2-6  
**GT Size:** 128-320  

**Description:** A pretrain to start drct-l model training, since there are no official released drct pretrains yet I trained these myself and release them here.

4xmssim_drct-l_pretrain

[Link to Github Release](https://github.com/Phhofm/models/releases/tag/4xDRCT-mssim-pretrains)

Since no [DRCT](https://github.com/ming053l/DRCT/tree/main) model releases exist yet, I am releasing my drct-s, drct and drct-l pretrains. 
These can be used to speed up and stabilize early training stages when training new drct models.
Trained with mssim (and augs, and color and lumaloss) on downscaled [nomosuni](https://github.com/muslll/neosr/tree/0ecbeb98dcefd97801da0ea39ca2cd03a87fce21?tab=readme-ov-file#datasets).
Training files are also provided additionally.

## 4xmssim_drct_pretrain

**Scale:** 4  
**Architecture:** [DRCT](https://github.com/ming053l/DRCT)  
**Architecture Option:** [DRCT](https://github.com/ming053l/DRCT/blob/8c13e63135f494913cd504c073e41ef52250d1d4/options/train/train_DRCT_SRx4_ImageNet_from_scratch.yml#L55)  

**Author:** Philip Hofmann  
**License:** CC-BY-0.4  
**Purpose:** Pretrained  
**Subject:** Anime, Photography  
**Input Type:** Images  
**Release Date:** 28.04.2024  

**Dataset:** [nomos_uni](https://github.com/muslll/neosr?tab=readme-ov-file#datasets)  
**Dataset Size:** 2989  
**OTF (on the fly augmentations):** No  
**Pretrained Model:** None (=From Scratch)  
**Iterations:** 95'000  
**Batch Size:** 2-6  
**GT Size:** 128-320   

**Description:** A pretrain to start drct model training, since there are no official released drct pretrains yet I trained these myself and release them here.

4xmssim_drct_pretrain

[Link to Github Release](https://github.com/Phhofm/models/releases/tag/4xDRCT-mssim-pretrains)

Since no [DRCT](https://github.com/ming053l/DRCT/tree/main) model releases exist yet, I am releasing my drct-s, drct and drct-l pretrains. 
These can be used to speed up and stabilize early training stages when training new drct models.
Trained with mssim (and augs, and color and lumaloss) on downscaled [nomosuni](https://github.com/muslll/neosr/tree/0ecbeb98dcefd97801da0ea39ca2cd03a87fce21?tab=readme-ov-file#datasets).
Training files are also provided additionally.


## 4xmssim_drct-s_pretrain.pth  

**Scale:** 4  
**Architecture:** [DRCT](https://github.com/ming053l/DRCT)  
**Architecture Option:** [DRCT-S](https://github.com/muslll/neosr/blob/0ecbeb98dcefd97801da0ea39ca2cd03a87fce21/neosr/archs/drct_arch.py#L923)  

**Author:** Philip Hofmann  
**License:** CC-BY-0.4  
**Purpose:** Pretrained  
**Subject:** Anime, Photography  
**Input Type:** Images  
**Release Date:** 28.04.2024  

**Dataset:** [nomos_uni](https://github.com/muslll/neosr?tab=readme-ov-file#datasets)  
**Dataset Size:** 2989  
**OTF (on the fly augmentations):** No  
**Pretrained Model:** None (=From Scratch)  
**Iterations:** 75'000  
**Batch Size:** 6  
**GT Size:** 128-320  

**Description:** A pretrain to start drct-s model training, since there are no official released drct pretrains yet I trained these myself and release them here.

4xmssim_drct-s_pretrain

[Github Release Link](https://github.com/Phhofm/models/releases/4xSPAN_pretrains)

[Neosr](https://github.com/muslll/neosr)'s latest update from yesterday included a [new adaptation of the multi-scale ssim loss](https://github.com/muslll/neosr/wiki/Losses#mssim_opt).     
This was an experiment to test out the difference between making a SPAN pretrain with pixel loss with L1 criteria (as often used in research) vs mssim loss as its only loss.     
Models are provided so they can be used for tests or also used as a pretrain for another SPAN model.  

---

## 4xmssim_span_pretrain

Scale: 4  
Architecture: SPAN  

Author: Philip Hofmann    
License: CC-BY-4.0  
Purpose: Pretrain  
Subject: Realistic, Anime  
Date: 10.04.2024  

Dataset: [nomos_uni](https://github.com/muslll/neosr)  
Dataset Size: 2989   
OTF (on the fly augmentations): No  
Pretrained Model: None  
Iterations: 80'000  
Batch Size: 12  
GT Size: 128  

Description: 4x SPAN pretrain trained on [neosr](https://github.com/muslll/neosr)'s [new adaptation of the multi-scale ssim loss](https://github.com/muslll/neosr/wiki/Losses#mssim_opt) from yesterdays update on downsampled nomos_uni dataset using kim's [dataset destroyer](https://github.com/Kim2091/helpful-scripts/tree/main/Dataset%20Destroyer) with down_up,linear,cubic_mitchell,lanczos,gauss,box (while down_up used the same and with range = 0.15,1.5). 
The new augmentations except CutBlur have also been used (since CutBlur is meant to be applied to real-world SR and may cause undesired effects if applied to bicubic-only). 
Config and training log provided for more details.
 
Showcase: 
[7 Slowpics Examples](https://slow.pics/c/zyilXhKU)

Architecture	ESRGAN
Scale	4x
Color Mode	RGB
License	WTFPL Private use Commercial use Distribution Modifications Disclaimer
Date	2024-07-20
Dataset	SD Numeric cartoon and anime frames and counterpart HD versions
Training iterations	905000
Training epochs	7
Training OTF	No

NumericFrames 2.0

Similar Models