BT/ iPhone 13 biometrics could work with masks

Paradigm
Paradigm
Published in
21 min readAug 30, 2021

Biometrics biweekly vol. 19, 16th August — 30th August

TL;DR

  • Apple has reportedly unveiled new Face ID hardware designed to biometrically identify people wearing masks and glasses on upcoming iPhone devices
  • Apple launched a new iOS app this month, ‘Siri Speech Study’, designed to collect speech data and improve the speech recognition capabilities of its virtual assistant Siri
  • Apple’s Machine Learning Research team has published a paper, spotted by Patently Apple, that hints at the integration of biometric health sensors within sports-focused headphones
  • Researchers have demonstrated a method to create “master faces,” computer-generated faces that act like master keys for facial recognition systems, and can impersonate several identities with what the researchers claim is a high probability of success
  • Swiss entrepreneurs and researchers have announced an effort to create a mobile contactless scanner that reads hand veins as a biometric identifier
  • Face gesture recognition feature unveiled in Android 12 beta
  • Imprivata and Microsoft renew digital ID collaboration on healthcare tools
  • Healthcare digital identity immature? Imprivata can answer that
  • Global ID unveils miniaturized vein biometrics scanner
  • BIO-key touts improved performance in new USB biometric fingerprint scanner
  • The first deployment of pressure-based gait biometrics for access control unveiled by Stepscan
  • Oppo patents vein biometric security for its wearables
  • RAIsonance biometric app makes coughing a tool for societal recovery
  • OCR Labs, HyperVerge, NEC each recognized for biometrics reliability
  • I3 patents international biometric verification without personal data exchange
  • Tool for explainable face biometrics, neural networks open-sourced by TruEra
  • AuthID launches on Nasdaq, signs credit union biometrics deal: shares up
  • Vouched secures $4.5M for selfie biometrics in hot remote onboarding market
  • TikTok draws the ire of senators for collecting biometrics
  • Nvidia voices optimism about biometrics, edge AI for financial services
  • Facebook joins ID2020, fined $5.5M for facial recognition violations by South Korea
  • World Bank official proposes digital identity steps to drive inclusion in West, Central Africa
  • India’s COVID vaccination management system ‘issued over 110M unique health IDs’
  • Samsung smartphones and OpenTable prepare for COVID health passes
  • What are vaccine passports and how do they work?
  • Iris and face biometrics on the rise for access control worldwide
  • Biometrics industry events. And more!

Biometrics Market

The Biometric system market size is projected to grow from USD 36.6 billion in 2020 to USD 68.6 billion by 2025; it is estimated to grow at a CAGR of 13.4% during the forecast period. Increasing use of biometrics in consumer electronic devices for authentication and identification purposes, the growing need for surveillance and security with the heightened threat of terrorist attacks, and the surging adoption of biometric technology in automotive applications are the major factor propelling the growth of the biometric system market.

Biometric Research & Development

Latest Research:

Apple’s Machine Learning Research Team have Published a Paper on using Specialized Health Sensors in Future AirPods

Apple’s Machine Learning Research team has published a paper, spotted by Patently Apple, that hints at the integration of biometric health sensors within sports-focused headphones.

In particular, the paper highlights the benefits of headphone-based sensors and the intrusiveness of traditional sensors like thermistors, respiratory gauge transducers, and acoustic sensors.

“While [they] provide the most accurate estimation of a person’s breathing patterns, they are intrusive and may not be comfortable for everyday use,” the research paper reads.

On the other hand, Apple explains, wearable headphones are relatively cheap, as well as substantially more accessible, comfortable, and aesthetically acceptable.

As part of the new research, the Cupertino-based firm managed to obtain a variety of biometric data simply using microphone-enabled, near-range headphones, and AirPods in particular.

“These particular wearables were selected because they are owned by millions and utilized in a wide array of contexts, from speaking on the phone to listening to music during exercise,” the paper explains.

According to the researchers, the findings “show promise for further development of a respiratory health tool with a larger study cohort.”

Researchers Create ‘Master Faces’ to Bypass Facial Recognition

Researchers have demonstrated a method to create “master faces,” computer-generated faces that act like master keys for facial recognition systems, and can impersonate several identities with what the researchers claim is a high probability of success.

In their paper, researchers at the Blavatnik School of Computer Science and the School of Electrical Engineering in Tel Aviv detail how they successfully created nine “master key” faces that are able to impersonate almost half the faces in a dataset of three leading face recognition systems. The researchers say their results show these master faces can successfully impersonate over 40 percent of the population in these systems without any additional information or data of the person they are identifying.

The paper cites previous research which showed a similar method for creating master fingerprints. According to the paper, their findings imply that facial recognition systems are “extremely vulnerable.”

The “master key” faces tended to be older, and didn’t have glasses or facial hair.

The researchers tested their methods against three deep face recognition systems–Dlib, FaceNet, and SphereFace. Lead author Ron Shmelkin told Motherboard that they used these systems because they are capable of recognizing “high-level semantic features” of the faces that are more sophisticated than just skin color or lighting effects.

The researchers used a StyleGAN to generate the faces and then used an evolutionary algorithm and neural network to optimize and predict their success. The evolutionary strategy then creates iterations, or generations, of candidates of varying success rates. The researchers then used the algorithm to train a neural network, to classify the best candidates as the most promising ones. This is what teaches it to predict candidates’ success and, in turn, direct the algorithm to generate better candidates with a higher probability of passing.

Swiss researchers hunt for contactless palm vein biometric scanners for hospitals

Swiss entrepreneurs and researchers have announced an effort to create a mobile contactless scanner that reads hand veins as a biometric identifier.

The groups involved are startup Global ID S.A. and the Idiap Research Institute. The impetus for the two-year, $1.1 million Candy project is to reliably identify people in medical settings without having to clean scanners of potential COVID contamination.

The pair say they will build on a multi-spectral, high-definition sensor. An early version of the biometric device reportedly can read IDs through surgical gloves. Whole hands are captured, making it harder for criminals to spoof the system.

Global ID CEO Lambert Sonna says in a press release that the entities’ ultimate goal is to ensure security and data privacy while addressing central biometrics issues around reliability, robustness and cost. They have already developed a scanner capable of scanning veins through a surgical glove and now hope to make the scanner fast and touchless.

Sébastien Marcel, head of Idiap’s group researching security and privacy in biometrics, emphasizes the importance of presentation attack detection for vein recognition. Idiap researchers have also developed a biohashing technique to protect vein biometric templates.

A similar, though retail-focused, biometric project is ongoing at Amazon. The company is deploying contactless palmprint scanners at some of its physical stores, and attracting the attention of privacy advocates.

Main News:

Iris and face biometrics on the rise for access control worldwide

Two separate market studies have highlighted the emerging relevance of biometrics for access control applications worldwide.

The first one comes from Future Market Insights and suggests the access control market will experience a compound annual growth rate of 12.6 percent in the next decade, with estimated revenues set to reach a value of over $15 billion.

According to the research firm, this growth will be spurred by the adoption of flagship technologies, including biometrics.

Iris recognition, in particular, will reportedly experience the most substantial growth in access control applications, with an estimated growth rate expected to reach over 16 percent by 2031.

The second report about biometrics in access control this month comes from Global Industry Analysts and foresees the iris biometrics market reaching a value of $4.3 billion by 2026.

Echoing the findings of the Future Market Insights report, the new document mentions the pandemic as the single main reason for the upcoming growth of iris biometrics around the globe.

The Global Iris Biometrics Market report examines figures by 40 different iris recognition solutions providers, including Anviz, HID Global, and Thales.

The results show a definite trend of the market towards advanced security systems across government organizations and industries for authentication and identification purposes.

iPhone 13 biometrics could work with masks, may drop Touch ID

Apple has reportedly unveiled new Face ID hardware designed to biometrically identify people wearing masks and glasses on upcoming iPhone devices.

The Cupertino-based firm is currently testing the technology via a prototype case for the iPhone 12 that includes a separate array of cameras.

According to FTP, the face biometrics technology would scan a user’s face without any obstruction first, and then be able to identify them even with portions of their face occluded by a face mask or glasses.

If brought to market, the technology would remove the need for an Apple Watch, which is currently needed to authenticate and unlock iPhone devices if the user is wearing a mask.

‘Siri Speech Study’ app to improve Apple speech recognition

Apple launched a new iOS app this month, ‘Siri Speech Study’, designed to collect speech data and improve the speech recognition capabilities of its virtual assistant Siri, reports TechCrunch.

A product of a research study, the app allows participants who have opted in to share voice requests and other feedback with Apple, though the documentation does not elaborate on the study’s specific goals. Apple has meanwhile said that the app is being used for Siri improvements via a focus group-like study using human feedback. For example, if Siri misheard a question, users could explain what they were trying to ask, or if Siri on Apple’s HomePod misidentified the speaker in a multi-person household, the participant could note that as well.

Face gesture recognition feature unveiled in Android 12 beta

The latest beta version of the Accessibility Suite app in Android 12 will include a new face biometrics-based feature dubbed ‘Camera Switches,’ XDA reports.

The face gesture recognition option was introduced in the fourth Android 12 beta recently released on Pixel phones and allows users to control their devices using face gestures.

Actions available through Camera Switches can be reportedly customized and associated with specific face gestures like smiling or raising eyebrows.

In addition, opening and closing your mouth will also be considered valid commands, as well as looking left, right, or up.

According to XDA, the new features allow for the mapping of these six face gestures, together with a few extra accessibility options.

These include enhanced visual feedback to show how long you have held a gesture, enhanced audio feedback to play a sound when something on-screen changes in response to a gesture, and keeping the screen on when Camera Switches is enabled.

The new set of gesture recognition features also include an option to ignore repeated Camera Switches triggers with a specific time delay.

According to XDA, Switch Access will support the connection of an external device via USB or Bluetooth to allow item selection, scrolling, typing, and more.

A persistent notification icon will reportedly show on the screen whenever the camera is being used by Accessibility Suite (in addition to Android 12’s privacy dashboard status camera indicator.)

Imprivata and Microsoft renew digital ID collaboration on healthcare tools

Imprivata has renewed its collaboration with Microsoft to include two of its flagship digital identity solutions, OneSign and Confirm ID, on the Microsoft Azure platform.

The move will reportedly strengthen Imprivata’s focus on advancing digital transformation efforts for healthcare.

It builds on an existing partnership with Microsoft, which saw the healthcare digital ID firm collaborate with the tech giant on biometric SSO and digital identity for clinical mobility.

Healthcare digital identity immature? Imprivata can answer that

Imprivata has developed a new tool for healthcare delivery organizations to assess the maturity of their digital identity systems and identify critical protections absent from their digital identity strategy.

Healthcare ecosystems are becoming more complex as the numbers of users, roles, locations, devices and applications being managed increases, and decentralized workforces and evolving network perimeters create new challenges for digital healthcare ecosystems.

The tool, along with an intelligent roadmap for mature identity enhances identity and access management (IAM) strategies to ensure healthcare environments have robust security, compliance and efficiency, according to the company announcement.

The new digital identity maturity assessment tool identifies gaps using ten specific questions related to the areas of governance and administration, identity management, authorization, and authentication and access.

Global ID unveils miniaturized vein biometrics scanner

Lausanne-based Global ID has announced a new, miniaturized vein biometrics scanner designed to provide firms and organizations with a portable form of a more secure authentication approach.

Named VenoScanner, the device was developed in collaboration with CSEM, a Swiss non-profit organization known for its support of advanced technology developments across Europe.

According to Global ID, VenoScanner is not only smaller than most vein biometrics scanners today, but also fully portable, since it runs on a battery and a Wi-Fi connection.

In addition, the device would be more effective in preventing presentation attacks, thanks to its ability to take multiple scans of the vein pattern in a user’s finger and generate a unique vein map, also known as a biometric key, that is reportedly extremely hard to replicate.

Oppo patents vein biometric security for its wearables

Chinese smartphone manufacturer Oppo has been granted a new patent for a hand vein biometric-based unlocking system for wearable applications, Gizmochina reports.

The novel technology, which was reportedly first filed in 2019 has a patent number CN110298944B.

The document describes a “Venous Unlocking Method and Vein Unlocking Device” similar to the Hand ID system developed by LG for its smartphones.

For context, vein biometrics systems work through mapping and recording of users’ vein thickness to then verify their identity.

BIO-key touts improved performance in new USB biometric fingerprint scanner

BIO-key International has incorporated new biometric scanning technology for the next generation of its compact USB fingerprint scanners, the EcoID II. The device also uses the identity and access firm’s latest NIST-tested algorithms to offer improved scanning and more reliable image capture.

The EcoID II is also smaller than its predecessor and offers the firm’s Identity Bound Biometrics to allow relying parties to be absolutely certain of the identity of someone logging into a system remotely. It can be plugged into devices running Windows 10 to offer the Windows Hello sign in experience without the costly upgrade.

The device has been submitted to Microsoft for testing for Windows Hello and Hello for Business and inclusion in the Windows Update catalog.

The release follows BIO-key’s recent launch of a mobile biometric POS device with built-in fingerprint scanner. The firm’s MobileAuth recently won the Lucintel 2021 Technology Innovation Award in the Biometric Market sector.

The first deployment of pressure-based gait biometrics for access control unveiled by Stepscan

Stepscan Technologies has announced the deployment of a new pressure-based gait biometric access control system.

Dubbed Stepscan Secure, the solution can reportedly capture the movement of multiple subjects as well as analyze their unique under-foot and gait features for biometric identification purposes.

“Stepscan technology has been commercially available in the medical market supporting the rehabilitation of injured and weakened patients for some time,” explained the company’s CEO Crystal Trevors.

The gait biometric system has now been deployed in the new $39 million Cyber Centre in Fredericton, Canada.

Stepscan Secure represents a world-first in that it is a multi-tile, expandable pressure-sensitive flooring system that also features tracking and identification capabilities.

Tool for explainable face biometrics, neural networks open-sourced by TruEra

TruEra has made its tool for explainability in machine learning models based on neural networks, like many biometric systems, available as open-source software, according to a company announcement.

The new TruLens provides a uniform API for explaining models built with Tensorflow, Pytorch and Keras, with a uniform abstraction layer. The library provides a coherent and consistent approach to explaining deep neural networks, the company says, based on public research. TruLens also natively supports internal explanations, such as what visual concepts a facial recognition model is drawing on to identify people from images.

The tool is inspired in significant part by the paper ‘Influence-Directed Explanations for Deep Convolutional Networks’ by the creators of Carnegie Mellon University’s library, TruEra says.

Use cases for TruLens include explanations for computer vision models like object recognition and face biometrics, natural language processing like identifying malicious speech or smart assistants, forecasting and personalized recommendations.

“Image recognition and text recognition machine learning models are both highly in demand and have a lot of consumer wariness about them, due to highly publicized stories about error or possible misuse,” says Shayak Sen, co-founder and CTO, TruEra. “The recent European Commission regulations specifically listed cautions around machine learning models and how they deal with personal data or images. So there is a huge need for explainability for these types of models, to ensure that they are effective, but also compliant and easily explained to a concerned society. We feel strongly about the ethical use of AI, and wanted to make TruLens freely available to the world to help ensure responsible adoption of AI for uses like image recognition.”

RAIsonance biometric app makes coughing a tool for societal recovery

RAIsonance, a group of AI-focused companies working on health, wellness, safety and natural language processing have announced the release of a trio of biometric applications which learn the unique sounds of a forced cough.

Originally developed for educational and workplace recovery following the need for efficient virus transmission control measures, SoundPass will create a security bubble with a biometric perimeter around certain areas to support in-person safety in the coming autumn.

Since the beginning of the pandemic, a multitude of voice-based biometric systems has proliferated, including ones designed to detect the virus.

The cough signature is stored as that user’s baseline for future comparison. If the signature is the same, the user gets an ‘authenticated’ message. Illness, however, prevents biometric authentication. SoundPass users can conduct a self-check at any time to identify possible changes.

“We see a significant opportunity going forward for many different players, some of which we’re actively working to partner with. For ourselves, given the approach we take to using AI/ML for security and health purposes, the opportunities are wide open,” said Kitty Kolding, CEO of RAIsonance.

The company recently joined Microsoft for Startups program, giving RAIsonance access to the tech giant’s technologies, as well as a streamlined path to selling alongside Microsoft and its global partner ecosystem.

OCR Labs, HyperVerge, NEC are each recognized for biometrics reliability

OCR Labs says it is the first private Australian company to be accredited to the country’s Trusted Digital Identity Framework (TDIF), confirming its biometrics and digital identity services for private sector applications meet the government’s standards for privacy protections, security, risk management and technical integrity.

The accreditation was announced by Australia’s Minister for Employment, Workforce, Skills, Small and Family Business, Stuart Robert.

OCR Labs will now undergo annual assessments to maintain its accreditation. The company’s automated remote identity verification and fraud protection service can be used to complete interactions with banks, financial and telecommunications companies without visiting branches or producing multiple ID credentials.

HyperVerge has passed testing by iBeta confirming its conformance to the ISO/IEC 30107–3 standard for biometric presentation attack detection (PAD).

The company says is one of only three in the world to be found compliant to the biometric liveness standard with a single-image solution, with its HyperVerge Onboard and HyperVerge Liveness products passing the test.

Meanwhile in the National Institute of Standards and Technology’s (NIST’s) Face Recognition Vendor Test (FRVT) for 1:1 algorithms, HyperVerge has cracked the top 15 percent of 331 submitted algorithms for biometric accuracy, according to the announcement. The Hyperverge-002 algorithm ranked between 21st and 58th across all six categories in the August 2 update.

NEC is touting its first place rankings in the NIST FRVT for biometric accuracy in the mugshot identification and border security identification categories.

The 1:N results published by NIST on August 5 show the NEC-004 algorithm had a false negative identification rate (FNIR) of 0.0022 for mugshots and 0.0345 for border photos at a false positive identification rate (FPIR) of 0.003.

The mugshot and border categories are the most important for many NEC customers, the company says, as its biometric technology is utilized in law enforcement, immigration, border security, and access control for aviation and military installations.

I3 patents international biometric verification without personal data exchange

The U.S. Patent and Trademark Office (USPTO) has granted Ideal Innovations, Inc.’s (I3’s) CEO Bob Kocher a patent for a method of biometric identity verification by one country against another’s information, without any exchange of biometric data between the countries, which could particularly useful for verifying the identity of armed forces personnel.

I3 says in the patent that countries typically do not share biometrics collected from soldiers with other nations, leaving the soldiers’ uniform and ID card as primary means of verification.

The patent for an ‘International Biometric Identification System (IBIS)’ describes a system held by each country which includes technologies to convert biometric data into templates which cannot be reconstructed, at least one “national group biometric database(s)” containing “non-sensitive information,” a connection to a repository of templates, and a verification system. The latter would be made up of a biometric scanner, a biometric matching engine, and access to the stored templates.

These Weeks’ News by Categories

Access Control:

Consumer Electronics:

Financial Services:

Civil / National ID:

Government Services & Elections:

Facial Recognition:

Fingerprint Recognition:

Voice Biometrics:

Behavioral Biometrics:

Wearables:

Mobile Biometrics:

Biometrics Industry Events

The Security Event: Sep 7, 2021 — Sep 9, 2021

ICT Spring Europe 2021: Sep 14, 2021 — Sep 15, 2021

Forensics Europe Expo: Sep 14, 2021 — Sep 16, 2021

European Biometrics Max Snijder, Research, and Industry Awards 2021: Sep 15, 2021

BIOSIG 2021–20th International Conference of the Biometrics Special Interest Group: Sep 15, 2021 — Sep 17, 2021

The Biometrics Institute’s calendar of events for 2021:

MISC

  • What Are Vaccine Passports and How Do They Work?
  • ID Talk Podcast: Understanding Biometric Security With IDEMIA’s JJ Baird:

Subscribe to Paradigm!

Medium. Twitter. Telegram. Telegram Chat. Reddit. LinkedIn.

Main sources

Research articles

Biometric Update

Science Daily

Find Biometrics

Planet biometrics

--

--