vivekchakraverty sure maybe u used open source solutions for all the actions listed above, but there is no machine in any of your standard indie developers bedroom that would be able to run all the functions on it. Most of the opensource implementations for AI assumes you use cuda or nvidia types, while it can be done on AMD, most of the developers choose not to add amd supprot.
What i have tested myself on my hardware: AMD 7900xtx 24gb, Nvidia RTX4070s 12gb
Img gen - nvidia/amd works on my machine takes from 5-30s
3d model generation - nvidia, works but takes 30min per model. AMD has no current implementation that is reasonable to install for noobs.
Video to FBX Mocap - tried to do it on nvidia, didnt work out too well. AMD not sure if there are any open source implementations.
Image to Video - i have tried the img2video gen - wan2.0 or 2.1 3s video on AMD 15min. Same could be done on 3090 24gb.
Extracting Frames from Videos - can be done on CPU with ffmpeg.
Narrative Design Assistant - you can run any assistant on pretty much any platform. Quality is depending on what llm model you use
TTS - can be done on CPU, tested both on AMD and Nvidia, These days can be done on 12gb GPU or less.
Now what i envision is that, unless it takes less than 30s per action, it is not really helpful. You are there sitting like a goon, waiting for 2h for the clanker to finish something and then it errors out.. and all that time was wasted for nothing. I can afford to loose 30s of life on a clanker. But for this to be reality we would need to run data centre grade AI systems at home. Unless you like paying for things. And leak your delicious data to the enemy - corporations. Or, as time have shown, wait for more advanced llm models to appear that can do stuff more precisely with more efficiency.
Im not against AI use if it helps you create thing that you envision. But im against the slop. Games or assets with no soul. Even before AI there were many many "unreal asset", "unity asset" type slop games on steam just made without care and story ans without soul, thrown together by greedy bastards and trying to sell and see if any of the popular streamers play it so they get boost in marketing.
What i found that there is asset lib/addon for godot that runs action server for the clanker that you can connect to and using opencode and your local llm server, task the clanker to make things for you. For me it created a functional control scene with volume slider that changes color based on volume value in 4min on a AMD 24gb GPU. Kinda impressive if you ask me. I could make a post about it if anyone is interested.
Waiting for OP to tell more about his plugin
