Hi I'm Marcus (one of the creators). Feel free to hit me up if you have any questions :-)
We are "very alpha" right now.
Edit: We have an API over at: https://usdz.app/api
We are "very alpha" right now.
Edit: We have an API over at: https://usdz.app/api
It would be nice to have some idea going in for what the requirements are. - I have to admit, I don't understand why I can't preview the 3D experiences right on my computer. - Likewise, when I try the QR code on my iPhone 6 ... well, I'm hardly surprised to not see anything in 3D, but it wouldn't hurt to have a little more detail than "Scan this QR code on your iPhone or iPad."
I suppose I could mention that I've done some game development and a little bit of VR/AR, but have never heard of the USDZ file format before.
USDZ is the format that Apple is backing for VR/AR delivery (developed by Pixar)[1]. We're betting that it is what is going to be used in any Apple headset.
Right now you can't easily view USDZs in the browser (the format is a moving target), however Apple is making strides to make it available with the proposed Model element[2].
We were doing some USDZ --> GLTF converstion (GLTF being a format that will work in the browser), but it is jankey (technical term).
I have not tried an iPhone 6 yet. I will have to pry it from my children's hands and remove a layer of cheese and excretions before I do.
I've made a video on how to do this via the browser here[3].
TBH, the experience a heap better in the iOS App (currently in testflight) [4].
[1] https://graphics.pixar.com/usd/release/wp_usdz.html (seem to have cert issues) [2] https://github.com/WebKit/explainers/tree/main/model [3] https://usdz.app/screencasts/getting-started [4] https://testflight.apple.com/join/VteIxFd7
Thank you.
You can import both of these into Blender and export as Obj (and I'm pretty sure STLs).
You may want to use our API to do the Images ---> USDZ conversion[1].
- Frontend & API (Rails + jumpstartrails.com)
- Images --> USDZ (Swift Code on a Cloud hosted Mac)
- USDZ --> GLTF (Swift + Custom Ruby)
- CDN (AWS Cloudfront)
- AWS S3 / Cloudfront
- AWS SQSThe API allows you to create 3D models from images with just a few lines of code.
https://developer.apple.com/augmented-reality/object-capture
That black box is Object Capture API, which takes a folder of images and outputs an USDZ (or OBJ) file. Model I/O isn’t necessary.
Kudos to Apple for releasing a photogrammetry pipeline that allows web and app developers to build tools like this, with zero knowledge of 3D reconstruction required.
I just saw that you're from https://www.aboundlabs.com and metascan.ai Your scans look great! So how does your black box work?
I work in the same field, making a capture app for photogrammetry software
I think that the photogrammetry side of things, the "give me an object now" will shift towards mobile device camera apps.
It is only serverside now due to power requirements.
How are you handling spam or other kinds of content moderation? Is it easier because users don’t upload a regular text/image and need to create something custom?
If it gets out of hand, we'll look at something similar to Akismet, or an ML based solution.
Right now we're hand picking experiences to make it to the front page.
Thankfully if one throws a bunch of random images at the API and trys to make a model, the algorithm just fails.
However we're thinking it might be fun to do something w/ NSFW image detection and display a silly model...