hmm I only used 3d counterpart of characterbody, but I would recommend using jolt, which is more reliable and predictable compare to godot homebrew physics engine.
edit:my bad, it seems jolt only supports 3d physics.
For your problem its probably the triggering function is not handled properly on both colliders.