metaio has updated its Augmented Reality (AR) browser junaio. In addition to obtaining information on nearby points of interest such as shops and restaurants, the cameras eye can now identify objects and “glue” object-specific real-time, dynamic, social and 3D information on to the object itself. The feature is being extended through collaboration with kooaba, and its visual object search capability, providing access to kooaba`s extensive object databases. The update is initially available on Android, with an iPhone release to follow soon.
Using metaio’s image recognition and object tracking technology, junaio can identify an object through the phone`s camera, access relevant information through visual search, and then virtually “glue” information displays onto it. By moving the object or camera, the user can interact with the “glued” augmented reality layer in order to navigate through information, rotate 3D displays, issue game commands, provide feedback, and more.
“We are taking AR to a new level,” says metaio CTO, Peter Meier. “The combination of visual search and object tracking is an amazing and highly intuitive way of interacting with objects and information.”
The combination of server-side and client-based image processing is the next step towards an ever present and highly accurate information overlay on physical objects in our real world, metaio believes. It will enable users to retrieve information on places or objects around them, with multimedia experiences triggered by images, signs, posters, magazines or newspaper pages, packaging or any other object nearby. It will enable ratings, tips, affiliates and other e-commerce functions to be displayed on real products, enabling advertisers to augment their print ads with games or added displays.
For example, users will be able to take a CD cover and access relevant online information by pointing their smartphone at the CD. This service is available now on junaio within the kooaba channel. The user will then be able to see band related merchandise on ebay, details of any nearby events they are involved in, and a 3D animation related to the content category. Junaio then “glues” this information directly onto the camera image of the CD, allowing the user to interact and navigate through these displays simply by rotating the CD.
“CDs are only the beginning,” says kooaba CTO, Dr. Till Quack. “Our database is constantly growing. The visual search and live-rendering will be accessible for more and more services and products.”
There’s a video demo explaining how the new feature works here.