Image uploaded from iOS.png

The 6D Reality Platform enhances the AR apps you build, helping them interact with the world in a natural and realistic way.

Current AR limits a user to a small area, where content is lost as soon as an app is closed. Devices using the 6D Reality Platform have a deeper understanding of the world around a user.


How it works:

  • The 6D.ai API uses a standard built-in smartphone camera to build a real-time, three-dimensional semantic, crowd sourced map of the world, all in the background. No depth camera is needed to capture the world in 3D.

  • Using the 3D mesh generated by the 6D.ai API, developers build world-scale apps where assets are persistent, responsive to occlusion, and synced between multiple users more efficiently.

  • Spatial computing apps that were only possible to build on expensive Head Mounted Displays are now possible on ARCore and ARKit smartphones.

  • 3D spatial data provides the foundation for 6D.ai AI neural-networks to help developers’ applications understand the world in 3D.

3D occlusion mesh was built 100% on-device (no cloud or offline processing) at 30fps, while the app was running, using only the iPhone camera. No depth cameras like structure etc. no speed-up or post processing of the video. This is a raw capture.

 
 
Persistence Final 2.gif

Persistence

6D relocalization technology ensures that AR content stays in place between sessions, and is easy to find again when a new session starts nearby. The location of that AR content is not limited to the host device, but available to any other device that has the permission to access it.

  • Users have one app session, close the app, and return to it weeks or months later with all the AR content just like they left it.

  • Groups of users can asynchronously add digital content to a location over a long period of time.

  • Pre-scan time is decreased for users that start an app session in a location that has already been visited by another user.

Occlusion.gif

Occlusion

The 6D platform uses a standard built-in smartphone camera to build a real-time, three-dimensional semantic, crowd sourced maps of the world, all in the background.

  • No depth camera is needed to capture the world in 3D.

  • AR content can be blocked from view - occluded - by real world objects.

  • A digital kitten can hide behind a real world box; virtual beads can be placed into a real world bowl; an AR puppy can run under and around a real world table.

MultiplayerImg.png

Multiplayer

Sharing an AR experience with someone else can be great when it works, but getting it to work is usually difficult. With the 6D platform, people can almost instantly joining from any position:

  • Player 1 starts a session, automatically uploading a map of the location.

  • Player 2 opens the app, and quickly joins as soon as background processes successfully relocalize.

  • From the user’s point of view, it just works.

CrossPlatformImg.png

Cross-Platform

True spatial computing apps that were only possible to build on expensive Head Mounted Displays are now possible on ARCore and ARKit smartphones. 6D is cross platform to make it easier for developers to ship their AR content to multiple smartphone platforms. This also provides an opportunity for developers that have made apps for AR HMDs or depth cameras to make their content available to a wider audience.