The Time of Flight Camera is Shaping the Future!

DeCode Staff
DeCodeIN
Published in
5 min readFeb 17, 2020

The race to create and transform technology every day, is never ending. From smartphones to adhesive tape, we see this trend appearing and reappearing regularly. You might have heard about the time-of-flight (ToF) cameras that smartphone companies use these days. Surprisingly, ToF technology has been in the market for quite a few years now. What is this tech that is already incorporated in our phones, and where else can we use it?

ToF technology is revolutionising the machine-vision technology by providing 3D imaging, using a low-cost CMOS pixel array and the camera also has an active, modulated light source. The compact construction, ease of use, and high accuracy provided by ToF camera make this technology so popular. Time-of-flight cameras hit the headlines in 2019, claiming they will revolutionise the smartphone industry. But, what exactly is it?

Time-of-Flight Camera

ToF cameras are being popularly used in mobile phones, drones, and industrial robots. Also known as depth cameras, they create a map of the surroundings to generate a basic 3D representation of the object in front of them.

A time-of-flight camera consists of sensors that use a tiny laser to shoot out infrared light, which is invisible to the naked eye. The light, then, bounces off any object that is in front of it, and then, goes back to the sensor. The amount of time the light takes to bounce back to the sensor is measured and translated to provide information about distance, which in turn, is used to create a depth map. This entire process is completed within the blink of an eye. For instance, if a subject is standing 5 km away, the time taken for the light to hit the object and bounce back to the sensor is just 33 nanoseconds! The camera examines every individual pixel in the image, and creates a 3D representation of the scene.

ToF camera sensor is used to measure distance and volume, as well as for scanning objects, indoor navigation, obstacle avoidance, gesture recognition, and much more. The data gained from these cameras can be used for 3D imaging and improving augmented reality (AR). In smartphones, this tech is used for 3D photography, AR, and also for clicking pictures in portrait mode. Since ToF uses infrared light to measure the distance, it is used to assist the user in low-light situations and can help focus even in low light.

Is This New Technology?

ToF isn’t exactly a new technology in the market, and various companies around the world have been experimenting with it. Microsoft has used this to create their second-generation Kinect devices. Light Detecting and Ranging (Lidar) companies also feature a ToF camera in their cars. Many drone companies have also started to adopt this tech. ToF isn’t an entirely new thing and is now becoming more efficient, affordable, and accessible.

ToF cameras found their way into phones as the tech became more readily available to smartphone manufacturers. LG has used this camera in their G8 ThinQ models. They have intelligently used it for 3D facial mapping for the face unlock feature, which is up to the mark with Apple’s FaceID technology. The main difference between the two is LG uses only one camera lens while Apple uses multiple cameras and dot emitters to get the job done. LG uses ToF for advanced depth perception in its front-facing cameras. This gives the ability to create 3D light sources and other depth tricks based on the actual distance between the phone and your face. Just like LG, Samsung has also implemented it in the Galaxy Note 10+. After working to incorporate and improve depth perception in their phones for a long time, they have put these sensors on the rear camera.

Inspired by this, Honor, a smartphone brand owned by Huawei, is using this tech for their Honor View 2.0 model. The ToF camera is paired up with a 48 MP sensor as a part of the main rear-facing camera. This provides depth information which enhances the portrait mode where the subject appears to be much sharper, because the background is blurred.

What does the Future of ToF look like?

ToF has the ability to help manufacturers and app developers make better AR applications. For AR-based applications, it is important to measure the surroundings accurately in 3D. It also helps with detecting and recognising an object. There is an immense number of use cases and potential in ToF technology for AR-based gadgets.

In the medical field, ToF can play a very crucial role in patient monitoring and positioning. In shops or restaurants, this can be used to augment the real user experience by adding more information for the customer who might be going through the clothes rack or a menu.

In logistics, ToF can be used for packaging and assistance, filling boxes, stacking, volume scanning, or labelling. It can also be used for diagnosing errors and making repairs. In automobile manufacturing, ToF cameras are used to find, pick, or mount objects and prove to be very useful in this industry as they easily detect damage and failure. For autonomous vehicles, this tech is a very valuable tool. It can help in navigation and alert the users with safety warnings.

There are endless possibilities as to where ToF can be used. This is only the beginning of exploring time-of-flight capabilities. It will blow your mind knowing what will happen when it is coupled with 5G connectivity and cloud computing! Believe us, you will really start to see science fiction turning into science facts.

--

--