360 stereo camera projection

xyz

pre Yeah, the way Godot handles offscreen buffer rendering (using viewports) is kind of stringent. The devs should think about implementing a more flexible system.

You'd have to go with multitude of cameras/viewports but I think Godot may handle it well if you run it on powerful enough hardware. And you can always render is several passes, each handling a certain amount of cameras.

pre

Right, there we go, that seems to have it.

You just gotta accept it's going to take several frames to pan the cameras around so you're gonna have to freeze your game.

Made it so you can adjust the number of camera-pairs it uses for each eye from 4 upwards. I found 64 or 128 is about the best number of cameras before it starts getting to memory intensive. Render time then is only like 30 frames, but most of them are long ones.

https://github.com/revpriest/godotPanoRenderer

pre

One interesting thing is that if you set the canvas-size of the subviewports for each camera to just 1 pixel wide they get no lighting showing. I was fiddling about trying to figure why the lights were all on a different layer or something but turned out just the camera was too narrow to let light in or something. Needs at least a five-pixel wide render in order to have any lighting at all really.

Thanks for your help folks.

ctlleoson

It's been a while, is anyone still looking for real-time 360 stereoscopic rendering solution?
I'd like to re-create some lightweight approximate cylindrical stereo render method for Godot or Unreal 5.

PS: Is Godot Asset Store similar to Unity3D's Asset Store? or we just host things via github only? please advise.

pre

ctlleoson I am still using the code I wrote here and it's still far far too slow and I'm still also far from convinced the projection is exactly right. Globes ending up a bit pear shaped. If someone better than me was going to write it into the engine proper or as a render plugin rather than just some multiple-camera panorama scan then I would indeed be interested in that.

I don't have any advice to offer on how to write it that isn't already here. While I might be tempted to pay a small amount me alone isn't going to fund it, for sure.

Godot's Asset Store is pretty new and I haven't looked at it yet.

DaveTheCoder

ctlleoson PS: Is Godot Asset Store similar to Unity3D's Asset Store? or we just host things via github only? please advise.

It's not tied to github. I've created a couple of assets in the store, which I migrated from the Godot Asset Library. Although my assets have github repositories, I had to create new .zip files containing the assets and upload them to the store.

Store documentation:
https://docs.godotengine.org/en/4.7/community/asset_store/

Store repository (for issues or discussions):
https://github.com/godotengine/godot-asset-store-tracker

ctlleoson

pre

RE: @pre
I appreciated that you created this post for 360 stereoscopic discussion, not much game engines implemented ODS solution by default, which is also understandable.

This week, I experimented some math, and successfully reproduce Unity3D liked real-time 360 stereocopic solution in Godot and Unreal. (originally, I re-created my own 360 render method for some in-house private projects, as NDisplay's stitch is also wrong and slow)

This screenshot is a quick test, storing ODS result in planar temporary.
Currently, I integrated my work-in-progress solution by re-compiling source Godot Engine.
It could be a plugin as well, with some modification on math.
My next step will be converting the final result in panorama layout as single render texture.
Some render pass(light/shadow) is not perfect in my quick test, will check how to fix later.
Godot is still new for me(only play around one week), I will post some panorama result once ready.

DaveTheCoder

RE: @DaveTheCoder
Thanks for your reference and guide, I will check them out. appreciated!

I will consider contributing some free assets.
I've been developing Unity3D plugins for many years in my spare time.

Due to the policy changes, I plan on migrating some useful features as SDK for Godot or Unreal. So far, I pretty like Godot's workflow.

PS: If anyone is interested in what I created, here is my website: https://frozenmist.com/
I might try to write some blog later, to document some Godot findings when have time.

pre

Looks good. 👍️

FWIW Youtube seem to have decided they only really like side by side rather than top/bottom these days. In doing so took off the 3d from most of my old vids. 🙄. Making it able to do side/side too is the most trivial part of the process I'm sure.

Was certainly hoping someone would have made the engine proper do it by the time my project was anything close to done. Thanks.

ctlleoson

pre

There are few potential formats in my plan:

for engine side, it could be texture2D arrays following Unity’s cubemap style for each eye.
for human readability, it could be two panoramas.

In that scenario, user can decide either Side-by-Side or Top-Bottom or cubemap on their own.

I wasn’t aware of YouTube changes, can’t believe that they only support Side-by-Side now…how about stereo 360 panorama support? 8k video will be 16k sbs…

I had similar scenario like you, couldn’t find much solution on this topic. Godot seems likely a trending engine for the future, I will explore further about Godot workflow and possibly contribute on more features.

Meanwhile, I am checking if Godot support single pass rendering method(for example, render 4 or 8 viewports into one texture at once like Unreal Engine’s viewfamily class), to reduce drawcalls etc.

ctlleoson

After many trial & errors, I've customised my own Godot edition for true 360 stereoscopic render(real-time).
I created another post in this forum for further discussion.

This forum: https://godotforums.org/d/44134-fm-godot-real-time-360-stereoscopic-omni-directional-panorama-3d-rendering
Other Godot forum: https://forum.godotengine.org/t/fm-godot-real-time-360-stereoscopic-omni-directional-panorama-3d-rendering-based-on-godot-engine/142834

Here is a look at how this mathematical approximation works, why it outperforms traditional stitching, and how it handles 12K resolutions in real-time.

Customised edition based on Godot Engine 4.7

Adding support of real time 360 stereo capture support by Leoson Cheong (CHEONG Tai Leong)

Email: support@frozenmist.com
Full Documentation Blog: Breaking the Stitching Barrier: Real-Time 12K 360 Stereoscopic Rendering in Godot
Video Explain: [FM Godot] Real Time 360 Stereoscopic Omni-Directional Panorama 3D Rendering based on Godot Engine

PS: I am a bit confused, I realised that there are two godot forums? (one for official? one for community? (Is current one still active?) I also tried creating showcase post in official forum but seems pending.

DaveTheCoder

ctlleoson I realised that there are two godot forums?

This forum was created long before the current "official" forum.
https://godotforums.org/d/43395-whats-the-deal-with-this-forum-theres-already-a-godot-forum

ctlleoson

DaveTheCoder Thanks for clarify this, I will stay on both forums.

« Previous Page