• Hello everybody! We have tons of new awards for the new year that can be requested through our Awards System thanks to Antifa Lockhart! Some are limited-time awards so go claim them before they are gone forever...

    CLICK HERE FOR AWARDS

Machine learning and how it could be applied to KH



REGISTER TO REMOVE ADS

AegisXIII

Well-known member
Joined
Jun 23, 2017
Messages
1,070
Awards
3
If there is a topic that has gained a lot of attention lately, it's machine learning: the process of teaching algorithms how to solve problems by training them with a huge amount of data.
The goal of this topic is not to look at how it works, but rather at the potential applications that such a domain could have for the serie, especially when it comes to remasters.

As you might have noticed, Square Enix remasters are a bag of mixed quality. Some of it is amazing, some of it is well a bit rough on the edges. This happens especially for games where the source code was lost. In such case, the amount of changes you can apply is limited. For example, replacing 3d models is easy (it's just simple modding), but improving pre-recorded videos is nearly impossible as you would have to rerender with a higher resolution (which cannot be done if the source code has been lost).

Last year FF8 remaster got released and it was received with mixed feelings. The improved characters models were great, but the background were unbearable. It's blurry and unfit for hd screens.
1603368109844.png

And that's where AI come into the game. Some fans have trained their algorithm with tons of data (low res and high res reference image) so that they could try to artificially improve the background resolution. Take a look at what it did on FF8:
1603368339543.png
1603368647776.png1603368675910.png

So yes it is not perfect, but it helps and with the proper training data, you can really achieve nice results. Those technologies are becoming more mature than ever and it is a bit frustrating to see that Square Enix is still reluctant to use them and rely on fans to do the job.

For example, I have been complaining that some of the cutscenes in kh are not fit for hd screens and even less for 4k. This is for example all the cutscenes of chain of memories, days and re:coded which are encoded in 720p with a terrible aliasing. This is probably because:
1. they lost the data for chain of memories
2. they need to fit all the games on one disc, thus the compression.
1603369065936.png1603369101579.png
BAD HD

1603369164324.png
The only true HD prerecorded scene which is the fight vs xion that was made as a dlc.

However, with ai, it could be possible to keep the same source video as entry and use neural network to optimize the result when they are played on screen. I would love to see them using those kind of technologies so that my eyes do not start crying when I watch them on my 4k screen.

And what about you? Do you have thoughts on AI and its use on improving old games quality?
 

.:Mega:.

Active member
Joined
Jun 9, 2006
Messages
901
Awards
4
Location
In your nightmares!
I'm baffled Square hasn't done this sooner. Surely they're aware of the Moguri Mod and other fan mods that improve and enhance their older titles. It seems like they're sleeping on a golden opportunity to better preserve these games for a new generation.

If fans can do it, a corporate entity has no excuse not to. :p
 

AegisXIII

Well-known member
Joined
Jun 23, 2017
Messages
1,070
Awards
3
I'm baffled Square hasn't done this sooner. Surely they're aware of the Moguri Mod and other fan mods that improve and enhance their older titles. It seems like they're sleeping on a golden opportunity to better preserve these games for a new generation.

If fans can do it, a corporate entity has no excuse not to. :p
Yes it is weird. Although I am not sure if other franchise do it. But for compression of data, this is a must have. This could be a selling point for a PS5 compilation. PS5 uses recent hardware. recent hardware has dedicated chips for neural network.
 
Back
Top