Show HN: In3D – An App to Create Your Realistic 3D Avatar for Metaverse
youtube.com
youtube.com
I'm Dmitry, one of the founders of in3D.
With in3D app [0], anyone can create their realistic 3D avatar with just a phone camera within 30 seconds. Once scanned, users can animate their avatars, make funny videos in AR, try-on digital looks, and play as themselves in GTA V, Second Life, and VRChat. Or order custom jeans at [1].
We believe that sooner or later digital copies of humans will become useful for many people. So we are building tech for digitization. There are two goals we try to achieve: 1) quality 2) accessibility. For the latter we try to design the scanning process to be as convenient as possible, i.e. we try not to require too much from the user, help users during the scanning process and fix any issues such as lighting conditions transparently to the user while building the avatar. For the quality -- MetaHuman quality would be great :)
One of the major challenges here is the absence of the datasets with 3D humans scanned in real environments. So it's not possible to create an end-to-end DL-based solution that works well enough. We managed to use FaceID sensor of the iPhone to build avatars without using much DL. And now we have a dataset of ~70k scans that we use internally to improve the algorithms.
We are also building some applications for the 3D avatars: our app [0] that is now more like a demo of the technology rather than a product, the Virtual Fitting Room for desktop [3] that we launched with digital fashion house Replicant [4]. We have helped Softbank scan people for World Gymnastics Championships [5] and celebrities for their game [6]. Soon, the game will have scanning embedded inside of the game app.
Would love to hear your thoughts and feedback! You can try the app here https://apple.co/3vnUf3H (3 day free trial), Android version is coming in January.
[3] https://www.youtube.com/watch?v=Xl0ffFJW8cU
[4] https://www.instagram.com/replicant.fashion/
[5] https://in3d.io/blog_page/in3d-partners-with-softbank-to-cre...