guibrandt/osulearn

An attempt at using machine learning to create a neural network that learns how to play osu! like a human from replay data

OsuLearn

An attempt at creating a Neural Network that learns how to play osu!std like a human from replays

(Plz don't judge me too much I'm new to machine learning and i can't english)

Introduction

osu! is a free and open-source rhythm game developed and published by Australian-based company PPY Developments PTY, created by Dean Herbert (also known as peppy). Originally released for Microsoft Windows on September 16, 2007, the game has also been ported to macOS (this version might be unstable), and Windows Phone. Its gameplay is based on titles including Osu! Tatakae! Ouendan, Elite Beat Agents, Taiko no Tatsujin, Beatmania IIDX, O2Jam, and DJMax.

-- Wikipedia

The goal here is to model and train a Neural Network to generate replays for any osu beatmap it is given based on a dataset of recorded human replays (.osr files) and their respective beatmap (.osu) file.

To accomplish that, I've trained a Recurrent Neural Network with my replays and beatmaps.

Results

This is a preview for a replay generated for a map the AI had never seen before:

Pretty good, actually!

It has figured out how to aim without looking like a robot and can even hit some jumps. Of course it is not perfect, but neither is the data set it has been trained on, so I am considering this a success.

Future

The next step is to transform this into a GAN, so it can generate multiple different replays for a given map, mimicking a human play style.

This might take some time though, so that's it for now x).

osulearn's Issues

.osr support?

Hello, I got this to work all nicely and was wondering if you would make it able to generate .osr files to watch the replay ingame

please explain if it's not difficult

I'm just getting started in this area myself, and your code is amazing to learn from. If you still go to GitHub and look at the questions, then it would be very interesting for me to know what exactly needs to be entered in replays = glob(os.path.join(".generated", "* () [[][]]. npy") instead of generated and * () [[][]].npy
I would be VERY grateful if you could answer

i keep geting the same error

im new to machine learning and i was trying to run the program but when i try to run it i get this error:

ModuleNotFoundError Traceback (most recent call last)
Cell In[15], line 13
10 import pandas as pd
11 import matplotlib.pyplot as plt
---> 13 import osu.rulesets.beatmap
14 import osu.rulesets.replay
15 import osu.rulesets.hitobjects as hitobjects

ModuleNotFoundError: No module named 'osu'

any ideas how to fix this ? or im doing something wrong ?