Metrics to Test Your AI Algorithm

So you’ve finally finished training the last epoch of your AI. It’s always a great feeling after hours of cleaning data and waiting for those epochs to finish up.

Now comes one of the most important parts of finishing up a new model … evaluating its performance.

Most tutorials online use % accuracy to measure a model’s performance. Yet despite its popularity, that’s not always the best option.

The Downfalls of Accuracy

To show accuracy can be a misleading metric, I’m going to use a model that detects COVID-19 as an example.

Let’s take the world’s COVID data as an example

Photo by Jefferson Santos on Unsplash

A full cybersecurity guide for small business and individuals

Right now, almost every single company in the world leverages technology and manages data in some way.

With the power of data comes the burden of protecting it.

Right now cyber-security is a bit similar to car crashes or robberies: they’re events we hear about all the time in the news, but we never expect them to happen to us.

Technology that could potentially bring neurotechnology to consumers.

Photo by Alexander Van Steenberge on Unsplash

fNIRS are a type of non-invasive brain imaging tool that measures the oxygen levels in your brain to understand your brain activity.

fNIRS stands for functional Near-Infrared Spectroscopy.

It’s similar to a pulse oximeter (the device you see on patients’ fingertips in hospitals sometimes).

Natural Language Processing’s powerful evolution using Word Embeddings

It’s a pretty well-known fact that humans suck at being random. Whether or not we realize it, everything we do tends to have some pattern to it.

The languages we use to communicate are no exception to this rule. All languages follow some set pattern of rules called syntax.

But why does this matter?

A large chunk of the deep learning industry is focused on something called Natural Language Processing (NLP). NLP is a subfield of artificial intelligence focused on training computers to process human language.

Person speaking at a neural network
Person speaking at a neural network
Credit: Elvis

Natural language processing started off in the 1950s when a researcher from Harvard created…

Right now the Earth is filled with energy, and we’re doing our best to capture and use it. While we’ve gotten better at moving towards renewable energies, we still suck at storing that energy.

Right now, the highest standard of battery tech is Lithium-ion batteries. They seem to have the best energy density, high efficiencies (around 99%), and they last pretty long.

So what’s the problem? With the increasing amount of renewable energies we’re capturing, the energy density of lithium-ion batteries just isn’t good enough anymore.

It may not seem like a deal since we can just keep mass-producing the…

Two of the top pieces of advice I’ve heard over and over again is to ask smart people for help when you’re stuck and that the ability to just figure shit out is super valuable.

These two things seem contradictory at first because asking for help and figuring stuff out by yourself are two opposite things. The key lies in knowing when to do each one.

Some of the biggest disruptions in the world have happened when someone used a good balance of the two to make things happen.

There’s this great video of Steve Job where he talks about…

Hundreds of years ago, the typical human being was a farmer. Most people’s primary concern was to go to work on the farm so they could produce enough food to feed their families and sell whatever was leftover for some money. 200 years ago 90% of the population was producing food.

But a lot has changed since then. In the modern world, 2% of the population produces all of the world’s food. Farmers can provide food for 10x the amount of people they could in the 1900s.

While there are many different factors that helped farmers get better at what…

I still remember the day I got the e-mail saying that I was chosen to interview for my top internship pick — Zero Gravity Labs (The innovation lab for Loyalty One).

I was visiting my family in India and had just taken a 12-hour train to Udaipur, getting ready to celebrate Holi. We finally got to the hotel, and of course, I was eager to connect to the wifi. Not soon after connecting to the internet I saw the email saying I had been selected for an interview.

Me and my dad playing Holi in Udaipur, India

It was really exciting for me. I was 16 and had spent…

There are a lot of different ways to play shooter games. You can play Call of Duty on your console, run SuperHot on a VR headset, or even paintball. These are all some really cool ways to simulate the thrill of a shooter game.

Unfortunately, console games aren’t extremely realistic, VR limits where you can physically move around, and paintball isn’t exactly conveniently available to play whenever you want.

Augmented reality (AR) introduces a way to turn your physical environment into a shooting range, or competitive arena.

To prove this concept I used Apple’s ARKit 3 to create an AR

Augmented reality is this amazing technology that let you … augment your reality.

It uses a camera to analyze the real world and anchor virtual objects into the camera feed.

By adding merging the digital world with the real work, we can create experiences in the environment of the real world with the physics and convenient entertainment of a virtual world.

Using Apple’s ARKit3, I created an iOS app that lets users play basketball anywhere they want. …

Mayank Jain

Neuroengineer @IDUNTech. 17-year-old Neurotech, Deep Learning, and AR developer. Prev: Innovation Developer at @Zero Gravity Labs (Loyalty One)

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store