Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add NES Composite to RGB Model, Digital Pokémon Models #464

Merged
merged 5 commits into from
Jan 28, 2025
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
53 changes: 53 additions & 0 deletions data/models/1x-NES-Composite-2-RGB.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,53 @@
{
"name": "NES Composite to RGB",
"author": "pokepress",
"license": "MIT",
"tags": [
"debanding",
"denoise",
"restoration",
"video-frame"
],
"description": "Takes composite/RF/VHS NES footage and attempts to restore it to RGB quality. Assumes footage has been properly deinterlaced via field duplication from 240p to 480p. Note that:\n\n* All footage was captured in 240p/480p NTSC.\n* RGB footage was captured via an AV Famicom with the RGB Blaster via the Retrotink 2x.\n* The model was trained exclusively on individual frames, so it can't fix things like dropouts.\n* The even and odd fields of NES composite tend to be a bit...different from each other, so there will be some jitter at 60fps.\n* I don't have access to an NES Toploader, so I wouldn't expect it to fix the jailbars very well.",
"date": "2024-11-03",
"architecture": "omnisr",
"size": null,
"scale": 1,
"inputChannels": 3,
"outputChannels": 3,
"resources": [
{
"platform": "pytorch",
"type": "pth",
"size": 3223546,
"sha256": "77511d759530b0cef77c919c40870f3fe3b9330e39e2aaacaac7848c06fb2b20",
"urls": [
"https://www.mediafire.com/file/qzaox0y51zh9ja7/NES_Composite_to_RGB.pth/file"
]
}
],
"trainingIterations": 445000,
"trainingHRSize": 128,
"trainingOTF": false,
"dataset": "Screenshots of NES games",
"datasetSize": 194,
"images": [
{
"type": "paired",
"LR": "https://imgsli.com/i/ce97c530-8f99-448c-8101-e072b7f72851.jpg",
"SR": "https://imgsli.com/i/e3b66191-0e6e-4264-a97f-d7b79c8a2f23.jpg"
},
{
"type": "paired",
"caption": "Legacy of the Wizard (VHS)",
"LR": "https://imgsli.com/i/0e8cc744-8e50-4b4c-8a0a-ccca9ffb9ea3.jpg",
"SR": "https://imgsli.com/i/d730abc1-ce80-495d-8a79-1504c6f7df33.jpg"
},
{
"type": "paired",
"caption": "Defender of the Crown (RF)",
"LR": "https://imgsli.com/i/0f0d8130-cc2b-4e3a-afad-45aa6bf5c504.jpg",
"SR": "https://imgsli.com/i/4416deb1-bbed-49a2-b882-45179b301b46.jpg"
}
]
}
59 changes: 59 additions & 0 deletions data/models/2x-DigitalPokemon-l.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,59 @@
{
"name": "Digital Pokémon-Large",
"author": "pokepress",
"license": "MIT",
"tags": [
"anime",
"cartoon",
"general-upscaler"
],
"description": "This model is designed to upscale the standard definition digital era of the Pokémon anime, which runs from late season 5 (Master Quest) to early season 12 (Galactic Battles). During this time, the show was animated digitally in a 4:3 ratio. This process was also used for Mewtwo Returns, most of Pokémon Chronicles, and the Mystery Dungeon specials.\n\nAdvice/Known Limitations:\n* This OmniSR model can occasionally produce black frames when run in fp16 mode. This seems to be more common in the TPCi era (seasons 9 and later). The issue is sporadic enough that it probably makes sense to do a first pass in fp16, then re-upscale any affected shots in fp32.\n* I recommend using QTGMC on a preset of \"Slow\" or slower for deinterlacing. While the show is primarily animated at 12/24 fps, some elements like backgrounds are animated at a full 60i.\n* The model is not great at handling fonts, particularly the italicized text in the episode credits. This is despite including font images in the training data,.",
"date": "2025-01-05",
"architecture": "omnisr",
"size": null,
"scale": 2,
"inputChannels": 3,
"outputChannels": 3,
"resources": [
{
"platform": "pytorch",
"type": "pth",
"size": 3244282,
"sha256": "ff5e8f803b6153b0c16ba246c5579524a978d16a90545d2736603703d9d67a2a",
"urls": [
"https://www.mediafire.com/file/gckgn1299krt2so/digital_pokemon_omnisr.pth/file"
]
}
],
"trainingIterations": 465000,
"trainingHRSize": 64,
"trainingOTF": false,
"dataset": "Screenshots from seasons 6-11 of the English Pokémon dub, plus some manually created images for fonts.",
"datasetSize": 74,
"images": [
{
"type": "paired",
"caption": "A Bite to Remember",
"LR": "https://imgsli.com/i/9ae50058-ac4a-415a-a243-8f924015fd46.jpg",
"SR": "https://imgsli.com/i/d96a8dcd-5b70-464f-8b45-2ed443f8fa3d.jpg"
},
{
"type": "paired",
"caption": "Going, Going, Yawn Title Card",
"LR": "https://imgsli.com/i/64ed6a26-8fb9-4849-996d-2d240b3eda97.jpg",
"SR": "https://imgsli.com/i/aea9dd40-c261-41d4-93d0-bea5f702700b.jpg"
},
{
"type": "paired",
"caption": "Fear Factor Phony!",
"LR": "https://imgsli.com/i/165ae236-385e-4519-b062-d7e8ec21d797.jpg",
"SR": "https://imgsli.com/i/fcbae9aa-dd0d-4c50-9071-86c8299f5b25.jpg"
},
{
"type": "paired",
"caption": "Once There Were Greenfields",
"LR": "https://imgsli.com/i/91270773-c8e9-4ea3-a679-ce1acde79b60.jpg",
"SR": "https://imgsli.com/i/1498de96-c924-4fba-b7cb-3b128e765d05.jpg"
}
]
}
59 changes: 59 additions & 0 deletions data/models/2x-DigitalPokemon-s.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,59 @@
{
"name": "Digital Pokémon-Small",
"author": "pokepress",
"license": "MIT",
"tags": [
"anime",
"cartoon",
"general-upscaler"
],
"description": "This model is designed to upscale the standard definition digital era of the Pokémon anime, which runs from late season 5 (Master Quest) to early season 12 (Galactic Battles). During this time, the show was animated digitally in a 4:3 ratio. This process was also used for Mewtwo Returns, most of Pokémon Chronicles, and the Mystery Dungeon specials.\n\nAdvice/Known Limitations:\n* I recommend using QTGMC on a preset of \"Slow\" or slower for deinterlacing. While the show is primarily animated at 12/24 fps, some elements like backgrounds are animated at a full 60i.\n* The model is not great at handling fonts, particularly the italicized text in the episode credits. This is despite including font images in the training data,.",
"date": "2025-01-05",
"architecture": "compact",
"size": null,
"scale": 2,
"inputChannels": 3,
"outputChannels": 3,
"resources": [
{
"platform": "pytorch",
"type": "pth",
"size": 2418324,
"sha256": "bfa3409a2a2306314645c65f6660cff2077bde1ba9dbbbf08248ecbace7ade3a",
"urls": [
"https://www.mediafire.com/file/37n5iwfkrpqd3ef/digital_pokemon_compact.pth/file"
]
}
],
"trainingIterations": 230000,
"trainingHRSize": 64,
"trainingOTF": false,
"dataset": "Screenshots from seasons 6-11 of the English Pokémon dub, plus some manually created images for fonts.",
"datasetSize": 74,
"images": [
{
"type": "paired",
"caption": "A Bite to Remember",
"LR": "https://imgsli.com/i/db8243fa-875a-410e-a3cd-fafbb3af9cb1.jpg",
"SR": "https://imgsli.com/i/08e7cfd5-a764-4db4-9184-a9392504af3c.jpg"
},
{
"type": "paired",
"caption": "Going, Going, Yawn Title Card",
"LR": "https://imgsli.com/i/d36cf8f0-7755-443e-b248-c06e2a7c9449.jpg",
"SR": "https://imgsli.com/i/bdd8af00-b6c0-4a53-8465-bfa82c5fe0c3.jpg"
},
{
"type": "paired",
"caption": "Fear Factor Phony!",
"LR": "https://imgsli.com/i/2d6cacbe-91e9-4564-a197-9a86d9ed4c60.jpg",
"SR": "https://imgsli.com/i/e7623bdb-6aec-4b83-bb90-8e7b0a4a63fd.jpg"
},
{
"type": "paired",
"caption": "Once There Were Greenfields",
"LR": "https://imgsli.com/i/5a326f65-f23f-4eee-9538-94eba40d0c0b.jpg",
"SR": "https://imgsli.com/i/93ca0d6e-28ac-4eef-9227-8e828b90a045.jpg"
}
]
}
Loading