mimi ai pet

DaveTheCoder

aiaimimi security sensitive users

You mean people with common sense.

No offense, but you registered on GitHub and this site five days ago, and you're surprised that people are cautious about downloading your executable code?

aiaimimi

DaveTheCoder
The reason for the new registration is because I am in China and you know that if you are in China, you need to be careful to hide your personal information

Actually, I have another account on this forum that has been registered for a long time and often answers questions

aiaimimi

Updated a version, v1_0_1

The main update of this version is the import of the ffmpeg module through gdextension,
allowing you to freely play any format of audio and video, including HTTP streaming
(The main reason for implementing this plugin is that my music plugin often downloads music in incompatible formats such as M4A, so I implemented this plugin)

The audio can also be played normally, but GIF cannot record sound and the demonstration is meaningless.

aiaimimi

The content planned for the next version update is:

Download plugin update: The current HTTP form download is too slow
Ticket grabbing plugin update: This is a unique feature of China, where you need to grab tickets during the Chinese New Year

Toxe

Where does all the music and video come from, that the AI can search for and download?

aiaimimi

Toxe

From many different sources, such as QQ Music, NetEase Music, music resource sites, or from search engines
Then from the searched links, match the song that best matches your needs based on the artist name and song title.
download it and play

Toxe

Is that legal?

aiaimimi

I am not very familiar with the laws of other countries, but in China, it is legal for you to download music from QQ Music and NetEase Music. AI plugins only help you search for the most suitable music for you and download it. In theory, you can manually download the same music from these sources
As for downloading music from resource websites, it will not constitute infringement in China

As for foreign laws, I am not very familiar with them.

In short, music_adapter plugin is Borrowed from this python module https://github.com/charlespikachu/musicdl.
You can check if musicdl has any infringement issues

aiaimimi

After continuous attempts, I finally successfully loaded aria2.DLL into the GD plugin and completed a download.

It was really complicated, but I am happy to have completed the first step. The next step will be to slightly encapsulate the interface of aria2

aiaimimi

I integrated Aria2 into Godot, and you can get higher download speeds like this

The main purpose of implementing this plugin is to accelerate the download speed of users in MIMI

aiaimimi

update v1_0_2:

add aria2 support : You can get faster download speed
add downloader_list plugin : You can manage the current download properties and use HTTP and aria for downloading
add file_list ui : You can mount cloud storage content such as AWS, Cloudflare, and IPFS, and download these contents

aiaimimi

The content planned for the next version update is:

Voice system, I hope to have a conversation with my robot through voice

aiaimimi

I found this plugin to implement the voice system, although it is incomplete: https://github.com/V-Sekai/godot-whisper

In actual testing, it was found that running under Windows would result in an unresponsive state, and the recognition effect was not ideal.

I plan to study how to improve his code, I hope everything goes smoothly

aiaimimi

I didn't expect that it has been 2 weeks since the last update of the post, and TTS and Whisper have been tormenting me endlessly. In the end, I have preliminarily implemented the dialogue plugin,

Godot Whisper: I have made some contributions on the basis of the original code ：https://github.com/V-Sekai/godot-whisper
https://github.com/V-Sekai/godot-whisper/assets/153103332/a1fed48f-59a7-4ae9-9da6-6c0734a14b35

Godot_tts: I used SummerTTS as the core code to implement a Godot plugin: https://github.com/aiaimimi0920/godot-tts

https://github.com/aiaimimi0920/godot-tts/assets/153103332/0813ddc9-2c71-453e-8ddb-50ce7f846ba9

I should make further changes to the implementation of these two plugins in the future and use them in my mimi pet

« Previous Page