Skybox AI: Use AI to generate 3D worlds
skybox.blockadelabs.com
skybox.blockadelabs.com
It's titled "What's New At Blockade Labs", a title which continues to display even when you scroll down and find the terms of service below the news... which is presumably why the button is labeled "Confirm"
1. Point-NeRF: Point-based Neural Radiance Fields - 2022: This paper presents Point-NeRF, a localized neural representation that combines volumetric radiance fields with point clouds to model complex local scene geometry and appearance. It achieves better rendering quality than NeRF and is more efficient in reconstructing complex and large-scale scenes.
2. TensoRF: Tensorial Radiance Fields - 2022: TensoRF proposes a tensorial radiance field representation that can achieve fast reconstruction and high rendering quality. It is significantly faster than NeRF and many previous methods.
3. GazeNeRF: 3D-Aware Gaze Redirection with Neural Radiance Fields - 2022: GazeNeRF incorporates 3D awareness with gaze redirection by applying a rotation matrix to the disentangled eyeball feature maps. It represents a static scene with multi-layer perceptrons and maps the 3D positions and viewing directions to a density and radiance for generating novel views with volume rendering.
[1] https://arxiv.org/abs/2212.04823
Regardless this answer does not responded to the parent comment's question at all since all of these papers are about radiance fields.
As opposed to what I am doing, trying to write a whole program from scratch, probably the most complex and difficult to pull off application of AI. It's quite challenging to explain what you want and get a functioning attractive output. Also to run arbitrary backend code I need to deploy VMs which are relatively expensive. People don't seem interested in paying for my website.
So right now I am trying to think of something similar to my original idea but maybe easier to accomplish successfully and with less work for the user.
Maybe if I can finally do a good job with filling web page templates that is what I should start with. Because even if it can synthesize code for some unique requirement, the fact that the web pages it outputs don't look attractive is probably making it hard for people to understand that it's useful.
But basically I think this blockade thing is a good lesson for me if I can find a way to adapt a similar approach to what I have been trying to do.
> A world made of very strong rock that has lots of rain. The rain contains acid, which wears the rock down. There is lots of soil, but it s in very thin layers because the world is relatively new.
https://skybox.blockadelabs.com/215b2684ceac6daac1958d020e24...
https://skybox.blockadelabs.com/c0e1e883df8d91a50f8e30180d73...
In other words, I'd like to turn my existing images into 3D skyboxes.
But theoretically the devs could easily add a more "direct" pipeline with better results. There is a HF diffusers function for encoding input images like they are text prompts.
I think this is called pix2pix or style transfer.
Being able to take the same scene and just change the time of day is really cool, my generative storytelling demonstration site[1] uses that feature to show the passage of time.
My largest wish is that generation wasn't so slow. I get their main use case is actually generating 3d environments that can be navigated around (and their Discord has some cool examples of early adopters using it for just that!) but I just need fast generation of panoramas!
Really what it comes down to is that OpenAI and their obscene levels of funding have made everyone used to AIs that give results almost instantly, but smaller scrappier startups cannot afford to buy a large % of the world's GPU supply.
It’s the term for the image used for the sky in a 3D environment.
Part of me loves it because I recall telling VCs about 5 years ago that we would be increasing the resolution of our 3D worlds, and making more engaging by using AI to enhance the 3D world we had already built.
I got laughed at, and told that I didn't know what I was talking about. This was pre-facebook getting into the metaverse, and I was labelling it "spatial media".
Even with customers and revenue, nobody wanted to have anything to do with us.
We sold the technology and our patents last year, as the team had moved onto bigger and better things, but I love seeing how well this future is progressing.
Anyway, still wait for someone to make real 3D scenes generator (so we can import to UE5).
Proportions are out of whack.
You can't use this for anything.