Hello,everyone.
I'm trying to make a game like muse-dash.As I don't want to play with the built-in music that takes up GBs of space, I came up with the idea that using music API platform for music and a pre-trained model to generate the notes.
I want to run deep-learning models inside a game on the host machine CPU,but using TorchSharp was impossible because it wouldn't work on Android at all.Besides, NAudio hardly worked on Android as well.
So I managed to try building an engine with onnx support by myself, but with no results.
After so much attempts, I thought of Termux, a great application that can run anything runs on Linux.
Is it possible to bind Godot and Termux environment together and create a game powered by AI?
Built-in Termux with godot to get full python support
- Edited
You may be better off generating the notes outside of the game, save as MIDI or some tracker format (those files are super small), and then bundle those files with your game (but not AI)
axolotl
I just want to explore a way to build AI powered games by godot.It's really a cool and challenging job.
NONAME_STUDIO why do you need android? Phones are not good computers. Maybe focus on desktop, and later down the line someone might emulate your app on droid.
But yeah, just like axo said, have an external app that does the conversion. you can run system commands from godot.. maybe have a websocket that connects to your external app on free ports on the computer and exchange bits that way?
It's not possible because I can't take a computer with me all the time.
I just think that I shouldn't require my users to install termux and setup the environment on their phones by themselves, especially in a release version of the game.
In short,it's not convenient at all.
NONAME_STUDIO uhm, laptop? ever heard of such thing? There are pocket size x86 laptops out there. Or maybe then look for x86 phone, then you have solved your issue .
Another approach is to have a service - web service under your control that you keep alive for eternity so that your game can function..
kuligs2
I don't want to pay for anything.(As I don't have much)
I just want my game with AI support can run on any kinds of devices.
NONAME_STUDIO I just want my game with AI support can run on any kinds of devices.
What kind of AI is it if it works on any device? Intelligence chooses which device to run on.
Tomcat
It's a beat detection model,used for music game.
It predicts the notes from a mel spectrum.
- Edited
How would Termux be used here?
Google has APIs that allow an Android app to communicate directly with Gemini (Google's AI model).
I'm not sure how that would be hooked into a Godot app.
DaveTheCoder
What about offline using?
I don't want to depend on web API.
- Edited
NONAME_STUDIO What about offline using?
Gemini Nano allows you to deliver rich generative AI experiences without needing a network connection or sending data to the cloud.
https://developer.android.com/ai/gemini-nano
I have no experience with this myself. I don't know how well it works.