High Time to Regulate Face Recognition A.I.
We’ve reached a tipping point where it is now high time that we start the conversation of regulating Face Recognition Artificial Intelligence (AI).
In a previous post, I explored some ideas of how we may regulate AI. I looked at several regulations in other fields and explored how they might apply for AI. The most compelling argument against AI regulation has been that it isn’t clear for many as to precisely what needs to be regulated. However, in recent days, it has come to my attention that a specific kind of AI algorithm needs serious thought for regulation.
Stanford researchers have trained a Deep Learning system to recognize a person’s sexual orientation. I don’t doubt the effectiveness of the system that they’ve built. Many however questioned the interpretations of the researchers. I am however very concerned about the potential for misuse of this kind of technology.
In May this year, Chinese researchers developed an even more dubious face classification system that determined if someone was likely to be a criminal or not.
We now urgently need to analyze the benefits of facial recognition against the risks. I am going to take a stab at this and will eventually make the argument that the risks outweigh the benefits.
Here are some of the benefits of facial recognition:
Security — Facial recognition is now built into the iPhone X (see: Face ID) and is used as an authentication mechanism to unlock one’s phone. Previously, the iPhone (an other smart phones) used one’s fingerprint for unlocking a device. Facial recognition can also be used for monitoring people visiting homes or offices.
Social Engagement — Facebook can automatically tag faces found in photographs. The value of this feature is to increase engagement by people who are tagged as well as from people who follow other people. Facebook has added additional security features that allow a user to opt-out of the automatic face tagging feature.
Safety- In car face monitoring devices can determine if a driver is distracted momentarily. This application can be employed in any work-related activity that requires focused attention from the employed worker.
Healthcare — Monitoring devices for people who are sick or disabled may be useful in providing more responsive care to their needs.
Entertainment — Virtual Reality or Augmented Reality games may react to the emotions of its participants.
Productivity — Face recognition is used by Google Photos to automatically organize and search one’s personal photos.
Law Enforcement — Face recognition can be used to identify suspects in a criminal investigation. This can also be used to track and find missing persons.
Here are the potential risks:
Police State — Facial recognition allows states to track the movement and behavior of its citizens. This allows the states to enforce compliance to its agenda.
Biological Identification — Facial recognition may recognize a person’s sexual orientation. In many countries, one’s sexual orientation is punishable as a crime. It may be debatable how accurate a system like this can become. However, if governments are satisfied with its accuracy, then people will be persecuted for being who they are and not what they had done. Recognizing a person’s heritage or race is another area where this can be abused.
Behavioral Manipulation — This involves the identification of a person facial responses in different contexts. Identification of reactions like disgust or awe may indicate to the observer the inner personal views of a person. Exploiting this information allows other parties (i.e., marketing, sales, government, employer, etc.) to execute behavioral manipulation techniques that may be in conflict with a person’s well being. We have already been witness to these behavioral techniques in social networks to influence one’s actions.
Behavioral Enforcement — Workers can be monitored to asses their continued focus on a task at hand. Day dreaming will be penalized with wage garnishment.
I am going to stop here now with regards to the risks. There are many more risks that I am deliberately failing to mention here. One can even extrapolate far in the future, and it is easy to envision a scenario that we would regret ever allow machines to recognize us.
However, what is the general overarching principle here why facial recognition is such a dangerous idea? The first problem is that because it is performed by automation, it can be done at scale and relentlessly. This leads to the same privacy concerns we have with large internet companies. The second concern is also that of privacy; that is, our inner thoughts and preferences should remain private. The third problem is the potential for summary judgment by a machine. It is all too easy for humans to lazily rely on an algorithm to perform judgment rather than to do so themselves. Furthermore, having an algorithm make a judgment, in many ways washes one clean of any responsibility for the consequences. This judgment is made much worse when the criteria are based on how you look.
Photo copier machines are regulated from being able to copy and print legal paper currencies. The software in any printer is hardwired to detect specific signatures in money and thus preventing facsimile copy. Similarly, it may perhaps be possible to require that any new deep learning silicon (of sufficient performance) be required to invalidate any facial recognition task. Alternatively, it should be illegal to hook up a deep learning device with an image capture system without the necessary ‘safeguard chip’ in place.
A lighter form of regulation should allow any person to opt-out from facial recognition. It could be implemented with the use of a kind of marker or code that is worn by the user (perhaps a barcode on the forehead?). This is analogous with the self-identification race forms found in the US. A person should, by law, be always allowed to opt-out from facial recognition software. The alternative will be a new kind of fashion:
I am absolutely certain that many AI researchers will be up in arms with this proposal for regulation. However, you will need to be able to make the case that the benefits of facial recognition capabilities absolutely outweigh the risks. The risks are very real and it is about time that we begin serious discussion.
Further Reading
