Kodemint’s Augmented Reality Browser

Little bit of chit chat as usual: ☺

No wonder why my progress report always had the remarks “talkative” in it while I was a student. Looks like, I just cannot start blogging something without talking a bit about what made me publish that particular post. ☺ Sorry, it is the hang over of the days when I used to blog a lot about stuffs which were never related to my work. Yesterday, I met one of the most popular Malayalam Bloggers, Mr. Manoj Ravindran (Niraksharan). We had a talk regarding his upcoming coffee table book, which is a travelogue and how technology can make the book even more attractive. I proposed Kodemint’s AR to him. It is when he asked for a write up that I noticed that we still do not have a good write up about Kodemint’s Augmented Reality Browser, with the help of which a layman can understand what exactly an Augmented Reality Browser is.

We do have some documentations about our AR Browser on slideshare and even on our website. But, looks like it is not serving the purpose always. So I thought of preparing an exclusive write up about it so that anyone who would like to understand what exactly an AR browser is, can use this post.

What is Augmented Reality?

The word meaning of Augment is supplement. The concept of Augmented Reality hence stands for supplementing real world objects with extra information.

For eg: let us take an example of a book - say a book on our master blaster Sachin Tendulkar’s 100 centuries. (While I am writing this, I have the book — “Sachin — Tribute to a legend”, published by “The Hindu” in mind)

Each of the pages of this book has a write up about a century of Sachin. It covers almost all information about that match in which he scored that particular century. What if there was some technology with the help of which a reader could watch a video of the moment when “God” made that particular century as well?

So, what I am trying to say? I am trying to say that we are going to supplement\Augment the page with an additional information, ie, a small video of that moment when Sachin made that century. How can we do this? An Augmented Reality browser can do this by giving the reader an excellent user experience by using the power of computer vision.

Kodemint’s Vision & Computer Vision:

Kodemint’s Vision and Computer Vision — Isn’t it rhyming? :D

Kodemint’s vision: This is the age of mobile applications. Almost all software applications which were developed earlier will now have to be ported to mobile to ensure that they are not outdated. This means that mobile phones are now going to be even more powerful when it comes to its computing capabilities. Also, most of the smart phones have cameras. Our vision is to harness the computing power behind a mobile camera and make applications with it so that a mobile camera can do almost anything that a human eye can do! Too much to wish for? Ha ha.. True. ☺ I am proud to say that we are 0ne among those those lucky few who could build at least a few apps with this vision of ours.

Computer Vision: Computer Vision — in layman’s terms can be described as a science which can enable one’s computer to “see” or identify real world objects.

Eg: of apps based on computer vision: A QR Code is one of the most popular applications of computer vision. A mobile camera scans or “sees” the QR code and navigates your browser to a website which is encoded within the QR code.

Augmented Reality Browser: How does it work? — Explaining with an example again

An Augmented Reality Browser works very similar to a QR code. Like the QR code reader, this is also a mobile application. First, you need to download the application on your mobile phone. Instead of scanning the QR code, here you need to point your mobile camera to the Augmented Image. In the book, “Sachin — A Tribute to the Legend”, each page itself or an image in the page can be augmented. In short, it means that, if the image or the page is augmented, your mobile browser could be directly navigated to play a short video from the match when Sachin makes his 100th run.

Augmented Reality Browsers — Type of Augmentations Possible

As I mentioned earlier, Augment means supplement. In the example, we dealt with earlier, we were talking about an image or a page to be augmented with a video. However, in reality, the additional information need not be in the form of a video alone. The below are just a few examples of what all augmentations are possible.

  1. Image to Video (An old video which was created for internal purposes can be watched here.)
  2. Image to Photo Gallery
  3. Image to Website
  4. Image to Voice or music
  5. Image to Text
  6. Image to 3D model
  7. Location to Information — For eg: if one is standing at some place, the app can give you a complete information about the public transportation system via that route.

Augmented Reality Browsers in the Indian Market:

  1. Times of India — has an Augmented Reality Browser called Alive.
  2. Hindustan Times & Mathrubhoomi — each has an Augmented Reality Browser powered by “point” — which is developed by Telebrahma Technologies.

Kodemint’s Augmented Reality Browser— Our USPs

  1. The image recognition algorithm used in Kodemint’s AR Browser ensures an instant recognition of the images (Recognition happens in fraction of a second)
  2. User experience provided by Kodemint’s AR browser is superior & it makes the browser easy to use.
  3. Highly scalable design of the Back end — making image to any media augmentation implementation faster.
  4. Image to video, Image to photo gallery, Image to 3D, Image to website and 6 more augmentations already implemented.
  5. Less than 6MB in size.

A video — Image to 3D Augmentation — Demo:

Watch the video here.

(Sorry, the video was recorded long back and I could not trace the best video we had. So, in case, this is not enough, please do try out our demo by following the instructions in the below section.

Try a Demo: (Android Version)

Feel the magic of an Augmented Reality Browser by following the instructions in the below document:

https://docs.google.com/document/d/1XVXYFUfc8R9VsVav2uNiSJd_cmsoQFTnyFA1fDyca9U/edit?usp=sharing