If it's not a secret, I'd love to read some design document about the backend behind this app. What's the blackbox that takes set of images as an input and produces a 3D model as an output?
The API allows you to create 3D models from images with just a few lines of code.
https://developer.apple.com/augmented-reality/object-capture
That black box is Object Capture API, which takes a folder of images and outputs an USDZ (or OBJ) file. Model I/O isn’t necessary.
Kudos to Apple for releasing a photogrammetry pipeline that allows web and app developers to build tools like this, with zero knowledge of 3D reconstruction required.
I just saw that you're from https://www.aboundlabs.com and metascan.ai Your scans look great! So how does your black box work?
I work in the same field, making a capture app for photogrammetry software
I think that the photogrammetry side of things, the "give me an object now" will shift towards mobile device camera apps.
It is only serverside now due to power requirements.
- Frontend & API (Rails + jumpstartrails.com)
- Images --> USDZ (Swift Code on a Cloud hosted Mac)
- USDZ --> GLTF (Swift + Custom Ruby)
- CDN (AWS Cloudfront)
- AWS S3 / Cloudfront
- AWS SQS