Artificial Intelligence (AI) is one of the hottest topics today. Recent advances literally talk for themselves — say hi to GPT-3, and it will greet you back. AI-discovered pharmaceutics is around the corner. Companies are hiring more Ph. Ds than ever while policy-makers are trying to make sense of this year tech with centuries-old laws. Exciting times for researchers and investors alike, maybe not so much for politicians and lawyers.
This year, for the third time, Nathan Benaich and Ian Hogarth teamed up to compile a state-of-affairs report on AI, covering the latest research, industry, talents, and policy news. Last but not least, the authors lay their predictions for 2021. …
Many of us data scientists deal with massive amounts of information daily. More often than not, these data streams doesn’t fit the available memory, and when this happens, things can get pretty slow — or crash. Buying more RAM isn’t your only option; there are many tricks to use the system memory better. This can be as simple as changing data types or employing smart caching/paging strategies to hide latency.
In this article, I go over the most fundamental way of reducing memory consumption: using the right data-types. …
Training machine learning models is far from easy. In fact, the unaware data scientist might trip and fall in as many pitfalls as there are living AWS instances. The list is endless but divides itself nicely into two broad categories: underfitting, your model is bad, and overfitting, your model is still bad, but you think it isn’t. While overfitting can manifest itself in various ways, shortcut learning is a recurring flavor when dealing with custom datasets and novel problems. It affected me; it might be affecting you.
Informally, shortcut learning occurs whenever a model fits a problem on data not expected to be relevant or present, in general. …
Those working with Neural Networks know how complicated Object Detection techniques can be. It is no wonder there is no straight forward resource for training them. You are always required to convert your data to a COCO-like JSON or some other unwanted format. It is never a plug and play experience. Moreover, no diagram thoroughly explains Faster R-CNN or YOLO as there is for U-Net or ResNet. There are just too many details.
While these models are quite messy, the explanation for their lack of simplicity is quite straight forward. It fits in a single sentence:
Neural Networks have fixed-sized…
Four days ago, Hannah Kerner wrote
“Too many AI researchers think real-world problems are not relevant. The community’s hyperfocus on novel methods ignores what’s really important.”
This isn’t the first article (and won’t be the last) to discuss how the AI community seems to follow an agenda of its own. Large venues blatantly ignore application papers — works focused on applying current methods to real-world problems and the challenges of doing so (which are many). Proceedings are simply out of touch with reality. An extra 10% on object detection is far more valued than a 1% reduction in cancer deaths.
The AI community largely ignores the obvious: deep learning is an experimental science. Despite their formal roots, neural networks are massive non-linear systems that defy explanation. Although the growing body of work dedicated to their interpretation, neural networks remain as mysterious as ever. …
Every week a “don’t do this” article is posted somewhere. Don’t use inheritance, never write a singleton, scrum is dead. But are we really supposed to abandon it all? Is an if-statement really that bad a thing? How can we tell what advice is worth listening to?
There isn’t a perfect programming language, nor is there a right way to code. There are guidelines (and known pitfalls). Browsing through programming advice on the internet today is terrifying — everyone is telling you to stop doing something. Soon we’ll be out of commands to use. Everything is a source of bugs.
Consider this analogy: You don’t send a truck down a wooden bridge and expect it to reach the other side. …
Do suor da testa, esculpimos sonhos
Que ardem e derretem em vão ao sol
Escorre o pranto que acumulam tantos
No rio que corre o que clama o canto
O que queres tanto jaz neste rio
Que flui os bens de quem já sorriu
Não pule não, não tente nadar
Pois jamais voltou quem veio do mar
O mar é calmo, certo e simpático
Há tanto espaço qu’eu nem me acho
Não sei se existo, se há outro ser vivo
Nunca fui visto, chorado, lembrado
Subimos ao rio, não há graça no mar
Tant’água em vão sem chão para um lar
Onda alguma jamais correnteza
Vivemos da esperteza
Pois não há…
Recently, I needed to run an object detection model for a proof-of-concept I was working on. Since I was using TensorFlow 2, the Object Detection API seemed a good fit. Unfortunately, however, the installation process is far more troublesome than it looks, and the official docs are Docker-based, which just seems an unnecessary burden for what ought to be only an ordinary pip package. Long story short, I rolled up my sleeves and went through it, fixing one step at a time until it worked. Here, I present to you how to do it.
Disclaimer: I am not against Docker in any way. …
AI is the new electricity, as Andrew Ng styles it. Every day another application is disrupted by cutting-edge machine learning research. Trying to keep up with the endless stream of new technologies is heart-breaking. If you fancy trying to cope with it, here I present you with what are my top 5 resources for AI-related news and knowledge.
The deeplearning.ai weekly newsletter. Each week, it packs recent break-throughs and noteworthy news alongside a short intro by Andrew Ng himself. …
We ought to love the absurd
The exceptional outlier
Consider the geometry, s’il vous plait
There are way more things outside the circles
— that any circumference could ever dream to contain
And I don’t want to be in, my dear,
— it feels good outside
I smell the air
and the flowers that feel
In the realms of the absurd,
Chickens are but ducks afraid of the sea
Cold-blooded lizards have the warmest of hearts
The perfume of colors are revealed to the deaf
— and all scents to the blind.
Don’t bother understanding,
The absurd has no form
And here, I present myself, naked,
It would surprise you,
That the skies are red
And no thoughts are…