Switching clips with AudioStreamInteractive

housatic

I created a AudioStreamPlaybackInteractive and added two clips, but I can't figure out how to make it switch to the next one. The dynamic music features are pretty new so I couldn't find much online, but based on the docs I tried:

AudioStreamPlayer audioPlayer = (AudioStreamPlayer)GetNode("AudioPlayer");
AudioStreamPlaybackInteractive audioPlayback = (AudioStreamPlaybackInteractive)audioPlayer.GetStreamPlayback();

audioPlayback.SwitchToClip(1);
audioPlayer.Play();

When I log ((AudioStreamInteractive)audioPlayer.Stream).GetClipName(1) I see the name of the clip, so I know I'm using the right index, but SwitchToClip just doesn't seem to do anything, the first clip keeps playing. Anyone have ideas?

Edit: Found an example here https://forum.godotengine.org/t/how-do-i-switch-audiostreaminteractive-clips-in-code/78954 , I'll try if the same issue happens with GDScript

Edit 2: Without the audioPlayer.Play();, the SwitchToClip() function works.

housatic

I created a new AudioStreamPlayer in a blank project with the GDScript attached but still nothing, it always plays the first clip (the clip with index 0):

extends AudioStreamPlayer

func _ready() -> void:
	get_stream_playback().switch_to_clip_by_name("second_clip")
	play()

Now I also noticed that setting "Initial clip" in the inspector results in an error...

E 0:00:00:0856 set_initial_clip: Index p_clip = 1 is out of bounds (clip_count = 0).
<C++ Source> modules/interactive_music/audio_stream_interactive.cpp:89 @ set_initial_clip()

even though stream.clip_count confirms that I have 3 clips.

housatic

Okay, changing the audio player's "Switch to clip" directly works.

extends AudioStreamPlayer

func _ready() -> void:
	self["parameters/switch_to_clip"] = "clip_name"
	play()

Or in C#:

using Godot;

public partial class Test : AudioStreamPlayer
{
	public override void _Ready()
	{
		Set("parameters/switch_to_clip", "clip_name");
		Play();
	}
}

housatic

I celebrated too early. This way I can change the clip of a AudioStreamInteractive inside a AudioStreamPlayer, but now I have no idea how to change it for substreams. My structure is:

AudioStreamPlayer with a AudioStreamInteractive, inside of which are multiple AudioStreamSynchronized streams, inside of which are multiple AudioStreamInteractive streams. So I can't use the above method of changing a AudioStreamPlayer's parameters because the substreams inside other streams, not inside a AudioStreamPlayer...

Edit: I found a demo here https://github.com/TheLotanos/Godot-4.3-Adaptive-Music-Demonstration , but again it only uses "parameters/switch_to_clip"

housatic

So the Play() was causing SwitchToClip() not to switch the clips, without it my original code from the OP works. Still no luck with substreams though, because to use SwitchToClip() I need to get the AudioStreamPlaybackInteractive, which you get with AudioPlayer.GetStreamPlayback(), and again, the stream is not (directly) inside an AudioPlayer so I can't use that...

I can use AudioStream.InstantiatePlayback() which returns a playback from the stream, but from the description I can't tell if it uses the Playback, or creates a new one that I'm supposed to assign to something?

Returns a newly created AudioStreamPlayback intended to play this audio stream. Useful for when you want to extend _instantiate_playback but call instantiate_playback from an internally held AudioStream subresource. An example of this can be found in the source code for AudioStreamRandomPitch::instantiate_playback.
https://docs.godotengine.org/en/stable/classes/class_audiostream.html#class-audiostream

I'm guessing the latter, because this doesn't work:

AudioStreamPlayer audioPlayer = (AudioStreamPlayer)GetNode("AudioPlayer");
AudioStreamPlaybackInteractive audioPlayback = (AudioStreamPlaybackInteractive)audioPlayer.GetStreamPlayback();
AudioStreamInteractive audioPlayerStream = (AudioStreamInteractive)audioPlayer.Stream;

audioPlayback.SwitchToClip(1); // This works

AudioStreamSynchronized substream1 = (AudioStreamSynchronized)audioPlayerStream.GetClipStream(1);
AudioStreamInteractive substream2 = (AudioStreamInteractive)substream1.GetSyncStream(0);
AudioStreamPlaybackInteractive substream2Playback = (AudioStreamPlaybackInteractive)substream2.InstantiatePlayback();

substream2Playback.SwitchToClip(1); // This does not work