An Engineering Solution for Detection, Understanding, Tracking & Localization

Vidhi Khaitan
csivit
Published in
3 min readMay 24, 2022

Have you ever thought of locating the position of a car on a surveillance camera to a Map without the use of any GPS data? Well, that which was once impossible has turned out to be a reality with Experion Technologies.

Why do you need to detect, track, and localize objects?

Imagine if you had to perform crowd controlling for the next big mega-concert or during a festival in your city. You will need to precisely monitor the traffic, and performance management based on the insights obtained from the traffic or crowd management system. Do you plan to perform a periodic count on the livestock on your farm?

Challenges that pose a threat to existing solutions are:

1. Efficient detection and tracking.
2. Multiplicate counting of an object.
3. Challenges to locating objects on Map.

The above challenges make the solution inefficient though it seems simple. To overcome these obstacles, the problem was broken down into three major areas.
1. Detection
2. Tracking
3. Localization

What does Detection do?

Detection across different spectra of classes across various objects like vehicles, livestock, and even people requires sufficient data modeling, engineering, and deep learning implementation. This has been made easier using customizable models (models generated based on the use-case) that can be deployed on low-resource devices as well as GPU-powered hardware as a standalone or cloud-based solution.

What is the need for tracking?

A detected object needs to be tracked continuously between 2 points of interest. For performing crowd control or for livestock/ vehicle counting, duplicate counting should be avoided to enable continuous tracking. This would happen only if tracking were accurate. Custom-made stabilization methods like reducing the impact of occlusion, adjustable region for reidentification, understanding the state of the vehicle (parked, stationary, moving), and ROI for tracking on top of Kalman filter coefficient adjustments have made tracking accurate.

Why localizing?

Positions of objects (vehicles, pedestrians, animals, etc.) can be identified and annotated on Map without tracking the individual the GPS data. Using camera-enabled edge computation systems, you can now identify the distance of the object from the camera or between other objects, its real-time speed as well as position on the Map.

The solution that Experion has engineered uses technology tools like deep learning, and signal processing along with cartography techniques and can be deployed on low-resource devices like Raspberry, and Nvidia Jetson as well as GPU-powered Nvidia hardware as a standalone or cloud-based solution.

Transfer learning was done on State-of-the-Art deep learning algorithms used in detection and tracking with the custom-made dataset. Object information collected during detection, tracking & localization is fed into a message generator. Generated message (CSV/JSON/XML) is then broadcast to vehicles.

A Potential Use Case

Traffic Management - Information regarding objects in the ROI of a camera can be generated as messages without utilizing GPS data. Information can be related to traffic surveying, pedestrian and cyclist monitoring, traffic violations including speeding, wrong-way driving, U-turns, stop sign driving, unsafe lane changes, traffic congestion prediction, and prevention by alerting the authority on blocking vehicles, shoulder parking, and misuse of reserved lanes, efficient parking management by detecting occupancy, preventing overtime and illegal parking.

There is now a solution to localize and derive patterns from random and spurious movements when observed at scale.

About Experion Technologies

Experion Technologies is a global IT solutions provider with strong Product Engineering DNA and an unwavering focus on delivering Customer Value. Experion has been recognized for its core expertise in digital product engineering services, that drive new revenue streams, digitize business processes, and help improve operational efficiency and productivity. As a digital transformation partner to 350+ global customers across 35 countries, Experion has helped its customers to transmute their businesses from within, and become more future-aligned, and be successful.

--

--