AI game upscaling

Jow Forums are you excited about neural networks ability to upscale graphics and low res media?

The picture here was upscaled 70% random art trained / 30% manga109 trained ESRGAN AI upscaled.

Attached: 1547320563017.png (1024x1024, 441K)

Other urls found in this thread:

github.com/xinntao/ESRGAN
mediafire.com/file/1rkhc7g9x4i9jhq/RandomArt.zip/file
kingdomakrillic.tumblr.com/post/181294654011/manga109-model-attempt-for-illustrations
doomworld.com/forum/topic/99021-v-0-95-doom-neural-upscale-2x/
twitter.com/SFWRedditImages

DUDE AI LMAO

Getting start with image upscaling using state of the art ESRGAN

ESRGAN: github.com/xinntao/ESRGAN

Custom trained models
RandomArt: mediafire.com/file/1rkhc7g9x4i9jhq/RandomArt.zip/file

Manga109
kingdomakrillic.tumblr.com/post/181294654011/manga109-model-attempt-for-illustrations

Attached: 1547422831819.jpg (384x139, 19K)

Never understood how to do a whirl attack on N64

Looks like shit

Attached: 1483247123577.gif (212x212, 1.02M)

That's very impressive to be honest.

>needing statistical brute force to upscale fucking pixel art

doom

Attached: 1545169184333.png (1024x500, 66K)

that's not how that meme works, friend.

non-neural network upscales are strictly worse in every case pretty much

bilinear/etc are garbage compared to this

Attached: 1545177429594.jpg (3000x1600, 1.24M)

FFVII

Attached: 1546781817267 (1).jpg (2560x1920, 1.4M)

>Need an Nvidiot GPU + CUDA
>upscaling a 1280x720 pic eats more than 3.5GB of VRAM
Eh

>x works how i say because i say so
thanks for letting me know

Attached: QQJNeMQ.jpg (896x472, 83K)

I don't feel so well

Attached: 1.png (127x126, 9K)

it's interesting to see how it guesses / statistically does it wrong sometimes. Obviously doesn't 100% eliminate human touch up but reduces it a lot.

>CNN pixel art upscaling
Whats wrong with the the algos with funny names that only exist in forum posts archieved in Wayback Machine?

Can't decrypt your message

It's a very interesting concept, and the results are definitely better than standard upscaling methods.
But the originals are still better than the upscales.

The ai endgame is that you just tell your ai butler to take that old game and modernize it.

it doesnt look any better than the source material so what's the point

it gets better over time
doesnt take artist effort
most remasters are lazy garbage that just increase the viewpoint size

Attached: 1545533919364.jpg (2560x1920, 1.64M)

>it gets better over time
no it doesn't
it's just an upscale
it doesn't make the art any better, it can't work with information that doesn't exist

yes, but the algorithm architecture and everything gets better over time

Meaning to upgrade simply requires re-running with the new improved algorithm

so yes, outputs will get better over time.

even human-drawn art upscaling doesn't improve art, you're missing the point

What do you want from upscaling?

The point is simply to make older games look better aka not as pixelated on modern HD-4K screens

Attached: IrEdwkf.jpg (1728x2016, 994K)

Can it upscale my dick?

Looks like shit desu. Waifu2x is a better choice for vn's

What is even the point of making pixel art look "better"? Just display it without smoothing as it was intended.
It's like wanting to make a drawing look like a painting

there is a manga trained version of ESRGAN

high res pixel art looks better

but application isn't only pixel art

Attached: pixel-art-wallpaper-full-hd-1920x1080-110940.jpg (1920x1080, 342K)

It's (probably) primarily meant for games that came out during the N64/PS1 era. Lots of those games are 3D, but had very low resolution, as a result when the devs developed the rasterized graphics for the game they only scaled them according to the resolution of the system at the time. While it's relatively easy to upscale 3D environments because of the nature of the math behind it, to upscale anything that is rasterized either requires going in and re-doing all the art assets or upscaling them with sub-par techniques like is talking about.

>What do you want from upscaling?
Nothing
Upscaling doesn't make pixel art look better, or any art for that matter

The idea seems to be trying to add back in details that were originally covered up or blurred by the pixelation, something I wouldn't use the word "upscaling" to describe. The main purpose of this seems to be so that when you view the resulting image on a large screen at a close distance, you'll notice less of the individual pixels and more of the image they were meant to communicate. Sometimes however you're definitely right that it's pointless to do this, and this is in situations where the pixellation was a fundamental part of the style (for example, I don't think you'd be doing Legend of Mana or Mario Bros any favors by trying to add details to them, but the Doom sprites are slightly modified photos of physical models and they would look better in game when they get up close, with more detail).

The pixellated image is the image they were meant to communicate. If you look at the models that were photographed for doom monsters, they look worse than the result. Hiding detail is part of the artists intent (not that this algorithm can make pre-renders actually look like their source anyway)

It needs to uncensor jav or it's useless

nice oil painting

Wtf I love AI now!

coping AMD retard

NVIDIA supported and pushed machine learning
AMD was stuck twiddling their shit thumbs doing jack shit

>finally a somewhat quality thread
>/v/tards already ruining them with their brand flamewars
Just kill yourself, you fucking faggot.

doomworld.com/forum/topic/99021-v-0-95-doom-neural-upscale-2x/

as usual, if it exists there's a doom mod for it

I want to use this to make my crappy programmer art look good.
Should I make my own 'make look good' ai or try to rely on up scaling?

I really doubt upscaling will work on programmer art. Maybe take photos of things, downscale and upscale / style transfer

You're probably right that upscaling is insufficient.
It's just that I feel I can express the shapes very roughly but everything beyond that is pure shit.

Look into style transfer, it won't look great but maybe better than programmer art

plus people eat up "artsy" things

I'll look into it. Thanks.

yeah it's easier to use than you'd imagine. Lots of potential applications