Unfortunately I do not think it’s possible, as much of Godot’s editor gizmos and drawing code is completely separate from the node itself. You can kinda work around this by disabling the gizmo and then drawing your own.
I do not remember 100% right off, but I think there is a drop down in the editor view, I think it’s called view, gizmos or `visibility, and then it will present a drop down with checkboxes for each node gizmo type. Then you can click the collision shape gizmo, which should make it no longer drawn. Not really a solution, but it may help as a workaround.