BT/ FaceTec liveness rolled out for Tinder users in trial while the bounty for biometric liveness spoofs doubles

Paradigm
Paradigm
Published in
41 min readApr 25, 2022

Biometrics biweekly vol. 36, 11th April — 25th April

TL;DR

  • Tinder is rolling out biometric selfie verification built with FaceTec’s technology to both iOS and Android users in a limited pilot. FaceTec’s bounty for biometric liveness spoofs doubles to $200K
  • Amazon is bringing its Amazon One palm payment solution to Whole Foods Market outlets in Austin
  • Hyundai patents in-car iris biometrics authentication
  • Subaru SUV comes with face biometrics to monitor driver
  • Fujitsu declares success in the trial of self-sovereign ID for students with university
  • Affective computing draws Intel’s attention, prompts debate
  • GAO says the US military playing too loose with AI development management
  • Diamond Fortress wins $20M in a lawsuit against Everest over biometrics license
  • Faceunity updates facial analysis algorithms in AR SDK for live streamers
  • CardLogix upgrades mobile biometric enrollment and verification tablet with 1:N matching
  • Reported AI-based emotion recognition by Zoom irks rights advocates
  • Neurotechnology’s fingerprint algorithm maintains the top NIST ranking
  • SIA urges more support for NIST biometrics tests, the passage of two US tech competition bills
  • Aviation pins hopes on digital identity, super apps, biometrics to turn around revenues
  • Paychex releases biometric time and attendance clock with Iris ID scanner
  • Nymi was acquired by Innominds to integrate continuous workplace biometrics
  • Faceunity updates facial analysis algorithms in AR SDK for live streamers
  • CardLogix upgrades mobile biometric enrollment and verification tablet with 1:N matching
  • Veriff biometric KYC widens Alloy’s AML platform capabilities
  • Shufti Pro wins regtech startup award; provides digital ID verification for 10M Ukrainians
  • Nametag expands biometric ID document verification capabilities, certified for data security
  • Regtech to pass $204B, make up half of all regulatory compliance spend by 2026
  • Paravision and HID Global are co-developing a new line of face biometric solutions
  • NEC, Hitachi biometrics planned for payments, hospitality check-in in Japan
  • Idex partners with G+D JV to commercialize biometric payment cards in Eastern Europe
  • Biden urged to consider the federal digital identity framework
  • Suprema face biometrics enable UK schools to cut back plastic waste from access cards
  • Zwipe was chosen for the Jordanian biometric payment cards pilot, integrated for access control
  • Subscribers scramble for biometric SIM registrations in Kenya as deadline extended
  • Australia considers following African countries in biometric SIM registration to curb crime
  • Finland considers using biometrics from civil, travel registries to investigate major crimes
  • Veridos partners to produce Costa Rica’s biometric passports
  • Tasmania seeks contractor for digital services portal to enhance online access
  • Philippines launches authentication platform for national ID
  • Nigeria’s biometric voter system detects over 1M invalid entries
  • Luxembourg Government Leverages Mobile ID, Biometric Tech for e-Services Authentication
  • Ex-employee accuses Apple of training iPhone biometrics by violating staff privacy
  • A team of researchers at Stanford University say they have invented a 3D camera that is simple and affordable for smartphones, possibly changing how facial authentication is performed on mobile devices
  • Researchers in a multinational team say they have created a biometric recognition system that uses three-dimensional images of faces and ears together that is 99.25 percent accurate with an 0.75 percent error rate threshold
  • A coder has created a new computer interface that uses more-than-subtle facial expressions and used the software to complete an apparently real job interview code test
  • Researchers have created a unique database of 8,000 hand vein and palmprint images using newly created hardware that captures four biometrics from each hand scanned
  • Biometric industry events. And more!

Biometrics Market

The Biometric system market size is projected to grow from USD 36.6 billion in 2020 to USD 68.6 billion by 2025; it is estimated to grow at a CAGR of 13.4% during the forecast period. Increasing use of biometrics in consumer electronic devices for authentication and identification purposes, the growing need for surveillance and security with the heightened threat of terrorist attacks, and the surging adoption of biometric technology in automotive applications are the major factors propelling the growth of the biometric system market.

Biometric Research & Development

Latest Research:

Two biometric identifiers are better than one. Researchers fuse face, ear images

Researchers in a multinational team say they have created a biometric recognition system that uses three-dimensional images of faces and ears together that is 99.25 percent accurate with an 0.75 percent error rate threshold.

The two biometrics are fused to increase authentication accuracy, according to a paper from a team made up of scientists from India, South Korea, Saudi Arabia, and Bangladesh. Their results indicate the method is competitive with the state of the art.

Three-dimensional facial images have their challenges, not least of which is file size, but they are better than two-dimensional images in that they are capable of solid face affirmation and work better in low light. And there is more biometric data with which to authenticate.

Visual analysis of concatenated coordinates: (a) X-coordinate view, (b) Y-coordinate view, and (с) concatenation of X, Y, and Z coordinates.

Three-dimensional ear images are stable over many years but have problems with low light levels and pose variations, and large file sizes can result in high computational costs.

Principal component analysis was used for three-dimensional facial recognition and independent component analysis was used for ear recognition.

For facial recognition, the team used the Face Recognition Grand Challenge database. Each of the chosen 30 subjects expressed anger, happiness, disgust, fear, surprise, and sadness.

The University of Notre Dame collections F and G provided 30 pairs of ear images captured at various angles.

The researchers said they next will tackle biometric hardware. They are considering ways to cut the cost of a portable 3D scanner in a handheld or notebook device.

The experimental scanner collects novel palmprints and vein biometric dataset

Researchers in India have created a unique database of 8,000 hand vein and palmprint images using newly created hardware that captures four biometrics from each hand scanned.

According to a paper from the PES College of Engineering, from each hand, the multimodal device can record the palmprint, dorsal vein, wrist vein, and palm vein. Contact is required.

The hardware used near infra-red light-emitting diodes to the image to illuminate the veins and a single-camera CMOS sensor to record them. Palmprints were lit using multiple white LEDs.

The researchers scanned 308 people to get 8,336 hand vein and palm print images from two hands each. Almost half of the participants were 20 to 30 years old. About a third were 15 to 20 years old. The rest were 30 to 80 years old. The creation of new biometric datasets has been a regular source of ethical and privacy concerns.

Classification accuracy with the multi-modal approach was 99.8 percent in k nearest neighbor, 99 percent in a random forest, 99.8 percent in support vector machine, 99.8 percent in the neural network, 97.7 percent in gradient boosting, and 99.8 in percent logistic regression.

Multi-modal biometric systems to date have generally referred to systems that combine hand- or fingerprints with facial or iris recognition.

Chinese, U.S. researchers turn teeth-grinding into a biometric identifier

In a development that begs the question, when will stomach-growling be a biometric identifier, separate research studies from the United States and China say that teeth-grinding can ID a person.

Everyone’s teeth are different, as are their jaws and the way they move their mouth when grinding their teeth. So, the teams used earbud-like devices with microphones to listen in and pass the data on to new biometric algorithms.

Although the development should be called grind recognition, it is being pushed as dental authentication, according to reporting by trade publisher Unite.AI.

An unreviewed study by a research team from Florida State and Rutgers universities reports that the so-called ToothSonic is 95 percent accurate “with only one of the users’ tooth gestures.”

Teeth-grinding is a superior identifier because, as the report’s authors state, teeth are “hidden in the mouth and skull.” That checks out. The ToothSonic would achieve wide acceptability, too, according to the report, because it would work without scanning a hand or an iris.

The Chinese team, from several Chinese universities and Temple University in the United States, came up with TeethPass, a dental occlusion-based authentication device.

Their paper claims biometric authentication accuracy of 96.8 percent. Like the ToothSonic, TeethPass collects teeth noise conducted through the skull and through the ear canal.

There are similar devices making the rounds, including VoicePop, which recognizes pop noises made when people breathe. LipPass, which, according to the Chinese team’s paper, finds unique signatures from a person’s “speaking lips.”

Apple, with millions of dollars worth of electronics stuffed into the ears of people around the world, filed for a patent on a biometric anti-eavesdropper app for its AirPods. A signal would acoustically map an ear canal to verify a person’s identity.

Researchers claim the biometric deepfake detection method improves state-of-the-art

Biometrics can effectively be used to detect deepfakes, according to a paper from a team of Italian and German researchers reported by Unite.AI, and could be a less “unwieldy” method of doing so than detecting synthetic artifacts and other methods.

The framework for the method specifies the use of at least ten genuine videos of the subject to train the biometric model, the researchers from the University of Federico II in Naples and the Technical University of Munich write.

The research into ‘Audio-Visual Person-of-Interest DeepFake Detection’ has been posted to Arxive, and describes what the authors say is a new state-of-the-art in deepfake detection. In testing against well-known datasets, the researchers improved area under curve (AUC) scores by 3 and 10 for accuracy in identifying genuine high and low-quality videos, respectively, and 7 percent for deepfake videos.

Interestingly, on high-quality videos, the worst-performing system delivered deepfake detection accuracy of above 69 percent.

The method was arrived at after the researchers discovered that segments of facial movement and audio were most discriminative for each identity by using a contrastive learning paradigm, essentially picking out their individual mannerisms.

The ‘POI-Forensics’ system compares “high-level audio-visual biometric features” and semantic features to detect either single modality (visual or audio) and multi-modal manipulation. Simulating these features, the researchers say, remains far beyond the capability of current deepfake-generation technologies.

The method could be used to build a platform for people to prove the manipulation of deepfake videos made depicting them.

Unite.AI notes that several innovations in deepfake detection are published each week on Arxive alone.

Simulating the biometrics of a subject is not typically a high priority for the autoencoder systems or generative adversarial networks (GANs) that are used to create deepfakes, however.

The researcher’s choice of biometric data as the detection tool may not be the most effective approach to deepfake detection as BioID’s Ann-Kathrin Freiberg said in a recent EAB webinar that AI algorithms are generally effective at detecting the artifacts in images that give away digital manipulation.

Turning that expression of frustration into code: A new human-machine interface

A coder has created a new computer interface that uses more-than-subtle facial expressions and used the software to complete an apparently real job interview code test. The greatest innovation, however, might be giving “duckface” a legitimate reason to exist.

Fletcher Heisler, director of the developer enablement at application security firm Veracode, has posted a video demonstrating how he built and tested his interface, called CheekyKeys. It incorporates facial recognition and expression tracking.

The coding appears to be light-duty, the commands look tiring but the tale itself is very entertaining. Much work continues in this field, some of it worth more than an eye-roll.

An article at Hackaday.com recounts how Heisler conceived of his innovation as a new father wondering if there was a way to hold his newly arrived sleeping baby while coding.

His first stab was to learn Morse code, which he could transmit with blinking (and, eventually, jaw movements) accompanied by some facial gestures and interpreted by biometrics-based software.

Heisler used Google’s machine learning software, called MediaPipe, principally designed for tasks like animating facial image filters, to track almost 500 facial landmarks.

So armed he dreamed up commands and modifiers, including the infamous but omnipresent duckface pose women and girls strike in ironic Instagram fashion poses.

Heisler’s dry delivery, especially as he makes his interview call, is fun, but there is no getting around the fact that watching an adult perform stationary facial kabuki — and ace his test — is a treat.

Researchers develop 3D smartphone biometrics with a standard camera

A team of researchers at Stanford University say they have invented the 3D camera that is simple and affordable for smartphones, possibly changing how facial authentication is performed on mobile devices. Samsung’s Galaxy Z Fold 4 and Flip 4 will retain their fingerprint sensors on the sides of the phone, and Google’s Pixel 6 line may be releasing face biometrics as an unlock option for the first time since launch.

  • Stanford team opens develops lidar with a standard camera

A Stanford University research team has devised a novel way of integrating acoustic resonance rather than light as a more energy- and space-efficient method of performing 3D imaging. The development potentially paves a future for smartphones to play a bigger role in a variety of biometric applications.

Currently, most smartphone cameras are only able to see in two dimensions, limiting their potential for more complex uses, such as measuring distance. The most viable alternative on the market is utilizing lidar — light detection and ranging — that emits a laser and by gauging how long it takes to return, calculates the distance, speed, and anticipated intersection moment between two objects. Incorporating 3D imaging into standard sensors is possible, but requires jamming a light source and a modulator into the array. The modulator is particularly energy-intensive, making this option impractical.

As Okan Atalar, a doctoral candidate in electrical engineering at Stanford explains, “Existing lidar systems are big and bulky, but someday, if you want lidar capabilities in millions of autonomous drones or in lightweight robotic vehicles, you’re going to want them to be very small, very energy efficient, and offering high performance.”

The Stanford team opted to explore acoustic resonance as a solution. By submitting a wafer of lithium niobate to electricity, the piezoelectric material vibrates at consistent and controllable frequencies that modulate light.

“What’s more, the geometry of the wafers and the electrodes defines the frequency of light modulation, so we can fine-tune the frequency,” Atalar says. “Change the geometry and you change the frequency of modulation.”

The team says this approach is an extremely energy-efficient method that is compact enough to fit into smartphones. The researchers predict the possibility of small-scale lidar on 3D smartphone cameras. Though the press release does not mention biometric applications, it is likely that the development can be used for more accurate facial recognition that protects against 2D spoofing attempts, and fitness apps that have better reads on biomechanical analysis.

It also opens the opportunity to create megapixel-resolution that would allow lidar to detect and identify objects from farther distances. Autonomous driving systems that use lidar may be able to better protect people by distinguishing between a cyclist and a pedestrian earlier and at a longer distance than before. Amin Arbabian, associate professor of electrical engineering and the project’s senior author, says the acoustic resonance method could set a standard for a compact, affordable, and energy-efficient lidar that can be fixed on drones as well.

  • Samsung sticks to side fingerprint sensors: Report

Samsung will retain fingerprint sensors on the side of their upcoming Galaxy Z Fold 4 and Flip 4 foldable phones and ­pass over rumors of an in-display placement, according to a report by Business Korea.

The move by Samsung bucks a trend among Android phone makers that place their preferred biometric sensor beneath the display. Industry observers said that in-display fingerprint sensors would be included in the next Samsung smartphones due to patent filings by the South Korea conglomerate, but the announcement by Samsung shows a fingerprint sensor on the power button near the side of the phone as the biometric unlocking method.

The patent application describes dual in-display fingerprint sensors for foldable phones like the Galaxy Z Fold 4 that would allow access to a fingerprint sensor whether it was folded or unfurled. One would sit in-display and the other would be located on the side.

However, BGR says the decision to keep the fingerprint sensors on the side was made due to the flip phone design of the Galaxy Z Fold 4 and Flip 4 that would force inconveniences like repeatedly unfolding the models to access mobile payments. BGR also notes the increased cost from two fingerprint sensors and the additional space needed to accommodate both.

  • Possible face biometrics on Pixel 6 Pro smartphone

Hints of evidence suggest that the Google Pixel Pro 6 smartphone has the possibility of facial authentication in a departure from Android’s traditional biometric of fingerprints, according to Pocket Link.

The news site reports a Reddit user found face unlock as an option during set up and further research from 9to5Google discovered references to facial recognition in Pixel 6 Pro Android 12 builds from October 2021. The Reddit user was unable to access the feature in the settings of the Pixel 6 Pro.

Pocket Link theorizes that it is either an option that Google decided against or a hidden feature that will be released soon for the Pixel 6 Pro. It is a change of pace from Android, as smartphones with the OS have gravitated towards fingerprints as the primary biometric and the Pixel 6 Pro lacks depth sensing, unlike Apple’s Face ID or the Pixel 4. This means the security offered by the feature would not be as robust.

Main News

New automotive biometrics growth forecasts, patents, and adjustments unveiled

  • Automotive biometrics on track to become a billion-dollar sector

The automotive biometrics market is forecast to reach US$1.13 billion by 2025 with a compound annual growth rate of 12 percent to 2025, and 16.3 percent by 2028, according to a report by Market Research Future. Covering vehicle security, driver identification, and health monitoring, growth is expected to be led by the passenger vehicle market throughout the forecast period rather than commercial use.

From the early days of automotive biometrics (2018), fingerprints were the main biometric markers, and vehicle security was the main use case. Driver safety systems are now expected to witness higher growth until the end of 2025.

Key players are noted as Fujitsu, Synaptics, Fingerprint Cards, Hitachi, HID Global, EyeLock parent VOXX International and Nuance Communications. While North America has seen large growth up to now, Europe is anticipated to experience rapid growth.

The report highlights some barriers to growth. The high cost of in-car biometrics systems, supply shortages, and labor issues during the COVID-19 pandemic, and “the failure of electronic components utilized in connectivity infrastructure”.

  • Hyundai patents in-car iris biometrics authentication

Hyundai has patented a biometric system to verify a driver via iris recognition to allow engine ignition and adjust the cabin to that driver’s stored preferences, reports The Drive.

The system is aided by an infrared camera to detect whether the driver is wearing sunglasses or whether the face is otherwise obstructed. Then the cabin lighting can be adjusted and the driver asked to remove sunglasses to allow clear access to the iris. Even the steering wheel can be moved by the vehicle to allow a better line of sight.

The Drive notes that Hyundai has previously empowered vehicle unlocking via smartphones with fingerprint sensors. It is not clear whether iris scanning would be in addition to this.

  • Subaru SUV comes with face biometrics to monitor driver

Top-of-the-range models of Subaru Canada’s new 2023 Outback SUV will have infrared cameras and facial analysis technology. Debuted at the New York International Auto Show, the vehicles will monitor driver behavior via a dedicated infrared camera and face biometrics software to detect fatigue or distraction.

The system can issue audio and visual warnings to alert drivers and passengers.

An array of other sensor and camera-based systems with computer vision offer features such as blind-spot detection, automated lane centering, rear cross-traffic alert, and hazard perception with automated braking.

FaceTec selfie biometrics and liveness rolled out for some Tinder users in the trial

Tinder is rolling out biometric selfie verification built with FaceTec’s technology, writes Dutch publication GratisDatingTips, according to a Google translation, to both iOS and Android users in a limited pilot.

The ‘Photo Verification v2’ feature includes FaceTec’s 3D biometric liveness detection technology and is intended to boost the platform’s protection against romance scams. Verified profiles receive a blue checkmark.

The new version of Tinder’s photo verification features is still in development, and “not available to all Tinder members at this time”, the company notes on a support page.

Match Group, the parent company of Tinder, began using selfie biometrics for identity verification in Tinder in early-2020.

GratisDatingTips notes that FaceTec’s technology can also be used for age estimation, which could potentially be used to keep minors from the platform.

The publication’s investigation of Tinder’s Android app code also revealed that the service is planning to offer scanning of biometric passports through NFC, or with a mobile device’s camera.

FaceTec has been supplying its face biometrics for dating app user authentication since at least 2020 when it signed up Meet Group as a client.

Fujitsu declares success in the trial of self-sovereign ID for students with university

Fujitsu and the Keio Research Institute at SFC have finished a month-long trial of a self-sovereign digital identity for students that allows a wide range of identity-related services outside of education.

A press release issued by Fujitsu outlines the intent of establishing a self-sovereign ID to address problems related to the management of personal data, the fragmented storage of personal data across various sites that creates difficulties, and data incompatibilities with other organizations.

To resolve the complications, Fujitsu says it collaborated with the Keio Research Institute at SFC on a digital identity technology in September 2021, which resulted in an identity conversion gateway that enables multiple identity infrastructures to be interconnected without using a unified protocol.

The trial, which took place from March 17, 2022, to April 12, 2022, issued a digital student ID via Keio University’s Next-Generation Digital Identity Platform that was transformed by the identity conversion gateway to examine the applications of online services connected to an identity platform that uses Fujitsu’s digital identity exchange named ‘IDentitY eXchange.’

It started with the creation of a meeting room reservation site by the Keio Research Institute with an anonymous response questionnaire connected to Fujitsu’s digital identity exchange technology. The questionnaires allow the users to disclose only necessary personal information, just like a self-sovereign ID. Then digital student IDs issued by Keio University for the trial would be verified to disclose student ID information on the site by Fujitsu’s identity conversion gateway based on site requests and user selections. The identity conversion gateway then matches and connects to individually managed certificate storage applications, like digital wallets, or other identity platforms.

Fujitsu also develops vein recognition and other biometric systems which could be used to anchor digital identities.

The results of the trial showed that students were able to successfully authenticate themselves on the meeting room reservation site. Additionally, the digital certificate could be used as an anonymous questionnaire after user authentication, by selecting partial items and information on the questionnaire site using Fujitsu’s confidential disclosure certification technology.

The success of the trial indicated to Fujitsu and the Keio Research Institute at SFC that student information could be shared across different services. The two organizations say it can allow users to link personal information issued by companies, universities, and local governments with various services. It may also serve to offer student discount services or aid with job hunting and recruitment support after graduation, the press release suggests.

Fujitsu and the Keio Research Institute at SFC say that after the trial, the two started the ‘Trusted Internet Architecture Laboratory’ on April 1, 2022, as a joint research base for designing architectures and developing technologies for the secure use of internet services leveraging the new digital identity technology.

FaceTec’s bounty for biometric liveness spoofs doubles to $200K

The Spoof Bounty Program run by FaceTec to uncover vulnerabilities and test the defense of biometric liveness detection systems has been doubled, with awards rising from $100,000 to $200,000.

The program was introduced in October 2019, to further presentation attack detection (PAD) and liveness technologies and research. Since then, FaceTec’s 3D Liveness Detection has been used to defend against more than 110,000 attacks under the program, the company says.

FaceTec advocates for spoof bounty programs to evaluate liveness detection effectiveness against a full range of sophisticated attacks, and encourages other liveness vendors to follow suit with their own programs.

“We hoped PAD testing labs would evolve with threats, but they haven’t kept up, allowing unscrupulous liveness vendors to dramatically exaggerate their security levels,” said Kevin Alan Tussy, FaceTec CEO. “Organizations choose FaceTec because security is paramount to them. Breaches can now cost billions, and more people are being hurt by identity theft than ever before. FaceTec’s mission is to stop fraud, not just check a regulatory box. This is why so many of our customers are in unregulated industries.”

The company also argues that deepfakes are inherently beyond the detection capacity of 2D liveness detection systems and that they are the top threat to remote identity proofing systems, citing a report by ENISA and a research paper from earlier this year.

Real data is dead? A half-million image biometric dataset says otherwise

A software firm claims to have assembled a 500,000-photo dataset that it says is not only “legally clean” and suitable for biometrics use, but is the largest such collection ever released.

Standard augmentation methods can boost the total to 2 million, according to vAIsual, which to date has concentrated on synthetic media.

The high-resolution, original photos of real people come with biometric releases allowing them to be used for AI training.

Trained professionals took the photos in a studio with a green-screen backdrop. Machine learning professionals sat in on the sessions to help capture images that are best for machine learning. The consent and capture processes are depicted in a YouTube video.

This is a man-bites-dog story because the machine learning industry is feeling fairly burned by one dataset snafu after another followed by demonstrated bias.

Reported AI-based emotion recognition by Zoom irks rights advocates

Reports that video communications giant Zoom is planning to develop an artificial intelligence-based system to monitor and analyze the emotions of users were met with sharp criticisms from rights advocates who think such technology will portend a major breach of users’ trust.

Information concerning the development of this technology was reported by Protocol, and advocacy group Fight for the Future has, in an open letter, called on the company to rethink its plan, saying such a move will be “manipulative,” “discriminatory” and pure “pseudoscience.”

The Protocol report mentions that sales and customer software companies including Uniphore and Sybill are working on biometrics-based AI products that can help understand the “emotional state” of a business deal and that Zoom is developing similar technology.

In the wake of the report, Fight for the Future said developing such technology will not be a good idea as it will allow people to be monitored and their data manipulated for profit-making motives.

Alluding to systems like facial recognition which come with some inherent biases, Fight for the Future argues that adding the emotion surveillance feature to Zoom will “discriminate against certain ethnicities and people with disabilities, hardcoding stereotypes into millions of devices”, since similar existing systems assume, and wrongly so, that “all people use the same facial expressions, voice patterns, and body language”.

The scientific basis for emotion recognition has also been challenged by researchers.

Fight for the Future has also campaigned against the use of facial recognition technology before.

According to the advocacy group, Zoom can do better by shelving the plan, as it has for controversial ones in the past.

  • Observe.ai gets voice analysis funding, Zoom among investors

Observe.ai says it has raised $125 million in Series C funding with Zoom as one of the important investors, TechCrunch reports. The company analysis customer experiences including emotion AI for sentiment detection.

The funding, the company CEO Swapnil Jain says, is to continue to develop its voice tracking and text conversation management technology by dealing with what the official calls “dreadful experiences” regarding contact center engagements.

The funding round is led by SoftBank Vision Fund. Zoom and other former investors including Menlo Ventures, Scale Venture Partners, and Nexus Venture Partners, also participated in the fund-raise.

TechCrunch reports that Observe.ai CEO declined to give details about Zoom’s investment but it is thought it may just be a move to advance its contact center market entry ambitions after plans to acquire Five9 did not go through despite reaching a tentative deal.

The funding is also to enable Observe.ai to lead some of its innovative projects for the future, such as what the CEO calls “IPO readiness.”

Priya Saiprasad, a partner at SoftBank Investment Advisers, one of the investors in the round, praised Observe.ai’s transformative vision. “The company has built an intelligent, flexible platform with endless use cases, from healthcare companies seeking to enhance patient experience through to financial institutions aiming to boost revenue. We are thrilled to partner with Swapnil and the team to help them accelerate a paradigm shift within the contact center industry,” said Saiprasad, as quoted by TechCrunch.

Affective computing draws Intel’s attention, prompts debate

Intel and edtech startup Classroom Technologies have developed a tool for integration with Zoom to let teachers know if their students are learning well by analyzing their facial expressions with artificial intelligence.

The idea is to improve student engagement, which has been reduced by virtual classrooms during the pandemic, and is hard for teachers to judge even when in class, Protocol reports.

According to critics, however, accurate determinations about how bored or confused a person is are not possible from their facial expressions and similar cues. Furthermore, a student’s reaction, particularly in a home environment, may be caused by a factor other than the educational material.

Classroom Technologies Co-founder and CEO Michael Chasen also acknowledge the need to be sensitive to concerns around how intrusive technology can be in comments to Protocol. He also admits that technology is not yet “fully” mature.

Even whether to require students to use their webcams when in class is controversial, as the application is relatively resource-intensive, and can also reveal otherwise private information about people’s homes.

Some teachers participating in Intel testing gave positive assessments, and the technology is not yet in production.

Intel trained its algorithm on data labeled by experts it hired to review videos of students, applying labels agreed on by two out of three experts.

Concerns about emotion recognition, or ‘emotion AI,’ are leading to confusion about sentiment analysis, according to experts in the field interviewed for a separate article by Protocol.

The terms are often used interchangeably, as in a Fight for the Future campaign cited by Protocol and subsequently updated.

They are different, however, in that sentiment analysis is text-based and emotion recognition is based on facial analysis, according to Affectiva CEO and Co-founder Rana el Kaliouby. It could also be based on other biometrics, like gait.

Nazanin Andalibi, an assistant professor at the University of Michigan School of Information, argues that sentiment analysis is still looking for “affective phenomena,” or physical manifestations of interior states. This interpretation would make sentiment analysis a cousin of emotion AI if not a subset of it.

The article goes on to explore the implications of this kind of characterization for the regulation of facial recognition and biometric data use.

GAO says the US military playing too loose with AI development management

In the U.S. government, it is the job of the Government Accountability Office to poke holes in bureaucrats’ spending plans, and GAO analysts have some strategy-level thoughts on the military development of AI.

It sounds like top defense officials would do well to adopt some warfighting tactics: thoroughly plan, coordinate and create an accountable chain of command.

A recent pair of reports paint a picture of incomplete reporting — and possibly incomplete organization — which could hamper department-wide development of effective systems including computer vision and facial recognition.

Earlier this month, the GAO published a report, mandated by the House of Representatives, critiquing the Navy’s 2021 development framework for uncrewed surface and undersea vessels. It is likely that biometric surveillance will be part of the department’s uncrewed future.

The report found that the Navy is mismanaging its $4.3 billion, five-year program to add 21 robotic vessels.

For example, GAO analysts found that that price tag does not include a digital infrastructure, such as data repositories, to support planned autonomous ships.

They reported that there is no cohesive management of the program, either. Adopting a portfolio management approach instills the discipline needed to align investments throughout the program to match strategic objectives and resources.

Critically, the GAO says, Navy officials have not defined any criteria needed to evaluate prototypes. In fact, the Navy has yet to create improved prototype schedules.

The DoD currently has some but not all of the data and computing power needed for facial recognition, according to the assessment.

Seven executive-level recommendations buttress the report, and together they boil down to more openness with Congress, sturdier schedules, and implementing portfolio management.

The story told in a March GAO report about the Defense Department’s overall AI efforts is very similar.

Analysts wrote that “AI-related strategies could be more comprehensive.” The department also has not “issued guidance that clearly defines the roles and responsibilities of components that participate in AI activities.”

Diamond Fortress wins $20M in the lawsuit against Everest over biometrics license

Apple was served a lawsuit for allegedly infringing on a facial expression recognition patent for messaging systems that the plaintiff claims is used in the Memoji feature in iMessage that imitates the personality and mood of the user with an emoji.

In a filing with the United States District Court Eastern District of Missouri, FaceToFace Biometrics alleges that its patent ‘Expression recognition in messaging systems’ dated June 22, 2021, was infringed by Apple by continuing to sell iPhones and iPads in the U.S. that include iMessage with the Memoji feature. FaceToFace demands Apple to “pay damages adequate to compensate FaceToFace for Defendant’s infringement of the ‘623 Patent” from the sale of the iPhone X to iPhone 13 Pro Max and the 11-inch and 12.9-inch iPad Pro, along with other infringing sales and attorney fees.

Apple’s Memoji is a feature that takes the user’s face acquired from a selfie or video sample to create a customizable emoticon that borrows features from their facial expression and can be sent through iMessage and Facetime.

In the patent listing for FaceToFace, the company details a security system that is said to protect and filter messages in a mobile messaging system with biometrics. The patent would recognize facial expressions that analyze the user’s mood and expressions to determine whether it would present another message from the sender, customize advertisements, automatically generate an emoji corresponding to the user’s emotion, and function as gesture control.

Patently Apple describes FaceToFace as a “patent assertion entity,” or a patent troll.

Faceunity updates facial analysis algorithms in AR SDK for live streamers

Faceunity, a Chinese company that specializes in augmented reality (AR) and virtual avatars, has added new features and facial analysis algorithm overhauls to the software development kit (SDK) of its video effect program with a focus on live streaming.

The company’s AR video effect program utilizes biometric data derived from real-time face tracking, human motion tracking, portrait segmentation, and gesture recognition. The algorithm is said to establish up to 241 dense facial landmarks for the mouth and eyes, recognize 56 facial expression coefficients and 25 human body landmarks; and perform portrait segmentation, head segmentation, and hair segmentation for contour recognition, among other biometric recognition for human motion and gestures.

With its AR video effects, Faceunity says it can perform face beautification, portrait filters, makeup and hairstyling, body reshaping, and face-driven virtual images, among a plethora of actions for live streamers. The product also comes packaged with the FU Creator for developers to create their own AR special effects like 2D and 3D stickers, AR masks, and beauty makeup alongside the ability to trigger special effects with facial expressions and gestures.

The SDK is available on iOS, Android, PC, Mac, and Unity, and can be integrated into other audio and video manufacturers, Faceunity says.

German 3D sensor-maker OQmented recently opened a Silicon Valley office to bring its image-capturing technology closer to more augmented reality developers.

CardLogix upgrades mobile biometric enrollment and verification tablet with 1:N matching

CardLogix Corporation announced the release of the BIOSID Pro, an update on the company’s biometric enrollment, verification, and validation tablet with expanded capabilities including one-to-many matching.

The company says the BIOSID Pro enrolls users, verifies them with an AFIS (Automatic Fingerprint Identification System) and ABIS (Automatic Biometric Identification System), and instantly validates individuals with fingerprints, face, and iris biometrics. It can perform identity checks via secure credentials, a cloud server, and internal storage for operation in challenging conditions, including environments with no internet connection.

The device can connect to the internet with Wi-Fi, BLE, LAN, and Global GSM, CardLogix adds. Additionally, BIOSID Pro is compatible with CardLogix’ M.O.S.T. operating system for smart cards and the CLX Enroll Biometric for desktop computers and is durably built with an IP65 certification, according to the announcement.

SIA urges more support for NIST biometrics tests, the passage of two US tech competition bills

The Security Industry Association (SIA) is voicing its support and feedback for two U.S. bills in Congress that aim to jumpstart America’s technological competitiveness in fields like biometrics, AI, supply chains, education, and semiconductors with billions in funding.

In a letter to U.S. legislative leadership on both sides of the partisan aisle, the SIA laid out recommendations to the U.S. Innovation and Competition Act (USICA), and the America COMPETES Act of 2022 that are currently in both chambers of Congress. Legislators are seeking to reconcile the two bills that will offer billions in funding total to advance U.S. science and technology R&D and contend with China’s rapid pace of development.

The SIA also provided its analysis of the U.S. Infrastructure Investment and Jobs Act in November 2021, saying a portion of the $550 billion could go towards biometrics investments in airports and smart cities.

With regards to biometrics, the SIA says it supports the America COMPETES Act’s sections 10226–10227, which include National Institute of Standards and Technology (NIST) reauthorization and biometrics testing. The association also expressed its support for the USICA’s amendment of “data storage, data management, distributed ledger technologies, and cybersecurity, including biometrics.”

The SIA reiterated its previous letter to President Joe Biden and Vice President Kamala Harris urging the administration and Congress to “consider policies that enable American leadership in developing biometric technologies.” The SIA also sent a letter to congressional leadership it says recommended how SIA members can build public trust surrounding the use of facial recognition technology; issued policy principles for the commercial sector, government agencies, and law enforcement on ethical and responsible use of facial recognition; showed comprehensive public polling on the support of facial recognition use across specific applications; and a list of successful uses of the biometric.

“The U.S. Innovation and Competition Act and the America COMPETES Act promote valuable investments in supply chain resiliency measures and federal R&D in areas like biometrics, AI and machine learning — emerging technologies that have a robust array of applications in security and life safety,” comments SIA CEO Don Erickson. “We encourage members of the House and Senate to reconcile some of the significant differences between these two pieces of legislation and work in a bipartisan manner to produce meaningful investments needed to reinforce the United States as the leader in developing cutting-edge technologies that impact our society and security.”

Updated MOSIP digital ID system is truly multilingual, supported for up to 5 years

After a quiet launch in February 2022, the team behind MOSIP 1.2 Long-term Support (LTS) Release known as ‘Asymmetric Amoeba’ explained the advantages of national digital identity programs in a release webinar.

The developers have incorporated feedback from six countries where the open-source modular system is in use to create a version that can handle any number of languages and will offer support for “three to five years” which they hope will encourage countries to upgrade from 1.1.5 or adopt the digital ID system in the first place.

The not-for-profit project began at the not-for-profit university IIIT-Bangalore in 2018. Version 1.0 was released in 2020 and countries began experimenting and sandboxing, explains Professor S Rajagopalan, with the Philippines putting it into practice later that year and early 2021.

Morocco was second to go live and has been followed by Sri Lanka, Guinea, Togo and Ethiopia are making preparations. ‘Asymmetric Amoeba’ was first mentioned around the same time as the latter agreement.

Nagajaran “Naga” Santhanam, who heads country implementation and works with partners such as biometrics providers, says he receives calls on a bi-weekly basis from identity management agencies in Africa that are interested in adopting the system. Six or seven new countries are already in the pipeline.

He says that version 1.2, the first long-term release is not a simple tech update as it incorporates learnings from the six countries, and industry expert consultation and will allow countries to work on a long-term basis as they can be confident they will receive all future upgrades, patches, and retooling.

Ramesh Narayanan, the project’s CTO, says the latest version is easier to manage and deploy and is even more interoperable, a key feature of the system which aims to avoid vendor lock-in.

Implanted digital ID will push digital payment revenue higher

An analyst firm this week predicted global digital payment revenue of $204.1 billion by 2028. The same day, a digital-payments infrastructure firm claimed it had sold its 500th implanted payment chip.

The two items may not precisely intersect today, but that is changing.

Perhaps the only place that mobile, contactless payments can go after smart watches is electronics embedded in consumers’ skins. They can make that jump (dive?) only because digital payments continue to gain acceptance.

Digital payments, meanwhile, logically must become more intimate, convenient, secure, and exclusive.

The BBC published an article about implanted digital payment chips. The piece centers on a Dutch security guard who had had one of the chips placed under the skin of his left hand.

Reportedly, the augmentation means he pulls out his debit card or phone less often.

(The author waits until the end to disclose that the implanted man from The Netherlands says he has 32 implants, including magnets in his fingertips. Suddenly he sounds less like a work-a-day Joe and more like a tech obsessive.)

Executives from two-implant makers exude confidence about their futures. Wojtek Paprota, CEO of Walletmor, says his firm has made more than 500 capsules jammed with a chip and a near-field communication radio antenna.

Steven Northam, another entrepreneur quoted in the story, founded BioTeq, and has been making similar devices since 2017.

Although not mentioned in the article, DSruptive Subdermals, in Sweden, has seen its chips imbedded in several thousand people.

If they are lucky, the two executives will get caught in the growth slipstream of the overall digital-payments market. The idea is gaining traction, according to surveys on digital payments.

Vantage Market Research predicts that revenue in the sector will grow to $204.1 billion by 2028, a six-year compounded annual growth of 15 percent.

That expansion will be made possible in part by biometric authentication, a feature of most contactless, mobile payment services.

Ex-employee accuses Apple of training iPhone biometrics by violating staff privacy

Apple was questioned about where it collected the 1 billion images it trained the Face ID biometric algorithm with by a member of U.S. Congress back in 2017, but no direct answer was offered. Now, an ex-employee of the company is taking it to court in Europe over sourcing those training images from its staff, The Telegraph reports.

Minnesota Senator Al Franken requested information on a range of points when Apple first introduced face biometrics to the iPhone X, some but not all of which were provided in the company’s response.

Former Apple employee Ashley Gjøvik was placed on administrative leave after complaining to the company about a sexist work environment, and then was fired, she says for raising concerns about violations of staff privacy. She has also filed a complaint with the National Labor Relations Board in the U.S.

The company invited its employees to participate in product testing, and sometimes to have their biometrics collected, but Gjøvik says the testing and collection seemed to be mandatory. She describes the use of Apple’s internal Gobbler app (later called Glimmer) to upload personal data employees had collected to company servers, and directly claims that employee data is the source of the billion images used to train Face ID.

France’s data protection authority CNIL and the UK’s Information Commissioner’s Office have each confirmed that they are investigating the allegations, according to TechCrunch, and other regulators are listed in the complaint but have not confirmed investigations.

Ultimately, Gjøvik is alleging non-disclosure agreements and employee privacy policies that do not meet legal standards.

Aviation pins hopes on digital identity, super apps, biometrics to turn around revenues

The aviation sector took a significant hit throughout the COVID-19 pandemic. As it struggles to recover, different elements are looking to digital identity and biometric technologies to claim greater market share and improve passenger experiences. The aviation sector could create its own digital identity trust framework. Meanwhile, Dallas Love Field deploys two robots to use AI behavior monitoring to shout at its passengers.

  • IATA: digital identities trust framework to make airlines retailers

Better ways to identify and authenticate passengers — i.e. customers — and other partners such as travel agents could allow airlines to tackle fraud and use their position to improve passenger experience and sell more goods and services, according to an article by IATA.

Digital identity could significantly upgrade the way airlines operate with a truly global approach rather than a patchwork of systems:

“Traditionally, global distribution systems (GDS) sit at the center of an EDIFACT (Electronic Data Interchange for Administration, Commerce and Transport)-based ecosystem.

“When a travel agency uses a GDS, it logs in using a seven-digit, human-readable code. The closed environment means it is the GDS that authenticates the identity of an airline’s business partner. Despite existing safeguards around authenticating travel sellers and credit cards, it is estimated that fraudulent transactions cost the industry $1 billion per year.”

The IATA article states that in the new system, the GDS does not have to be the centralized gatekeeper. This means authenticating all the parties in a transaction is more complex, but also gives airlines an opportunity. It could give them greater control over their offer when it can authenticate the identity of a travel agency rather than the GDS.

The whole system could be transformed via existing open standards for a decentralized digital identity for entities.

“Adapting the existing EDIFACT system to a world in which the offer is controlled by the airline would require the partner (an agency or aggregator, for example) to have a login for each airline with which it does business. The idea, therefore, is for each agency to establish a single unique digital identity that can be used with every airline.”

Every entity in the ticketing chain would need a unique identifier. Yet a standardized authentication approach would replace the proprietary systems used by each GDS while still being of value to all partners, according to IATA, which could become a trusted organization issuing accreditation for a new trust framework.

It would make the whole system more efficient and tackle fraud and, according to IATA, is almost in reach. A proof of concept handled by New Zealand digital identity firm MATTR is just a few months away.

  • AirAsia turns to Google help for a ‘super app’ to cover more of the passenger journey

Low-cost airline AirAsia is hoping to continue its pandemic endeavor into new areas such as ride-hailing and meal delivery via its “Super App” with a new five-year partnership with Google Cloud, reports Bloomberg.

The app covers travel bookings, a loyalty program as well as a host of additional services such as e-wallets and chatbots across Southeast Asia. The company hopes for AirAsia Super App to grow organically and become profitable in 2023.

The AirAsia Super App includes biometrics for user identification such as the Faces app for facial recognition scanners for passengers.

  • TechUK: biometric and digital identity solutions to UK’s tougher travel trough

UK tech promotion agency TechUK held a panel on digital identity in the travel and tourism sector where speakers described biometrically and SSI approaches to improving passenger and customer experiences. The UK has created an even more troubling travel landscape with Brexit as the EU brings in its biometric Entry/Exit System this year.

iProov’s CEO Andrew Bud reported success for the SmartCheck project at London’s St Pancras International Station, the capital’s terminus for Eurostar rail services to Europe. Working with Entrust and the Department for Transport, iProov deployed facial biometrics for identity verification.

Bud said that large amounts of data will need to be collected prior to travel to avoid bottlenecks. Face capture needs to shift to mobile devices used by passengers at home. Data and biometrics could be stored as a digital travel credential for the journey, on a device or in the cloud.

Eighty-six percent of SmartCheck users were likely or very likely to use it in the future.

  • AWS launches the first Joint Innovation Center for aviation at Bengaluru International Airport

Bangalore International Airport Ltd, an operator of Kempegowda International Airport in the Indian city of Bengaluru, is collaborating with AWS (Amazon Web Service) to establish the Amazon company’s first Joint Innovation Center outside China and also the first dedicated to the aviation industry.

It is expected to have an emphasis on digital innovation when it opens later in 2022. Improvements to passenger journey as well as within the community where the airport is located should be achieved via AI, robotics, blockchain, and AR/VR.

  • Orlando International Airport automates new terminal with digital technology

When the new US$2.8 billion Terminal C opens at Orlando International, passengers will undergo automated screening via facial recognition at the 15 gates, reports Click Orlando.

Twelve million passengers per year are expected and four more gates will be added.

Meanwhile, in a potential customer experience damaging development, Dallas Love Field airport is deploying two seven-foot-tall robots called SCOT (Security Control Observation Towers) to determine whether people are not wearing masks when boarding flights, loitering, or generally breaking rules, reports the Dallas News.

With the use of AI, the machines will monitor behavior, be instructed to recognize certain clothing, use license plate recognition to spot vehicles of concern and can issue audio warnings or call airport security or police.

These Weeks’ News by Categories

Access Control:

Consumer Electronics:

Mobile Biometrics:

Financial Services:

Civil / National ID:

Government Services & Elections:

Facial Recognition:

Fingerprint Recognition:

Iris / Eye Recognition:

Voice Biometrics:

Liveness Detection:

Wearables:

Biometrics Industry Events

DTX Manchester: Apr 27, 2022 — Apr 28, 2022

Global EmergeTech Summit 2022: May 10, 2022

IFSEC International: May 17, 2022 — May 19, 2022

Secure ID Forum: May 24, 2022 — May 26, 2022

Showcase Australia 2022: May 25, 2022

Africa Pay & ID Expo: May 26, 2022 — May 28, 2022

Critical Infrastructure Protection & Resilience Europe: Jun 14, 2022 — Jun 16, 2022

The Future of Data Protection: Effective Enforcement in the Digital World: Jun 16, 2022 — Jun 17, 2022

Identity Week Europe: Jun 28, 2022 — Jun 29, 2022

ICT Spring: Jun 30, 2022 — Jul 1, 2022

Identity India 2022: Jul 7, 2022 — Jul 8, 2022

Identity Week Asia: Sep 6, 2022 — Sep 7, 2022

Future Tech Expo & Summit: Sep 12, 2022 — Sep 13, 2022

MISC

Subscribe to Paradigm!

Medium. Twitter. Telegram. Telegram Chat. Reddit. LinkedIn.

Main sources

Research articles

Biometric Update

Science Daily

Identity Week

Find Biometrics

--

--