Pilot tests

The aim of the HUMABIO project is to develop a novel, multimodal biometrics system in order to improve security in sensitive environments and safety during critical operations. The HUMABIO project will be able to protect high security areas, resources and equipment. In addition, it will able to monitor the physiological state of critical process operators for the early detection of abnormal situations that might lead to human errors and potential disasters.

One of HUMABIOís novelties is the use of new and emerging types of biometrics, such as EEG, ECG and anthropometric profiles using "sensing seats". The authentication potential of various physiological modalities will be investigated and prototypes that integrate these new biometrics will be installed in three different sites for testing and validation.

Other, conventional biometric modalities, namely face, voice and gait recognition will be combined with the new biometrics in order to increase the robustness, reliability and accuracy of the final system.

Unobtrusiveness is one of the main requirements for the HUMABIO prototypes. Novel, miniaturized and unobtrusive sensors for physiological measurements that are being developed in the SENSATION IP are to be integrated in the HUMABIO prototype, while face recognition, free speech analysis and gait recognition will allow the transparent to the subject operation of the system.

Three pilot applications are considered in order to demonstrate the modularity and test the applicability of the HUMABIO system in various environments:

The Truck pilot

The system authenticates the driver of a vehicle in order to prevent unauthorized operation and also monitors the condition of the drivers in order to prevent accidents due to hypovigilance or other causes.

The main aims of the truck pilot were to assess the technical performance as well as the user acceptance when using the HUMABIO system in a truck environment.

pilotpilot

The pilot was performed in the Volvo truck simulator with 14 attending respondents, both HMI and security system experts and professional truck drivers.

The included modalities were:

  • EEG/ ECG
  • Face recognition
  • Voice recognition
  • Sensing seat

For the face recognition a camera was installed on the dashboard of the truck and a stereo microphone was positioned on top of the camera for the voice recognition. The sensing seat was integrated into the existing driverís seat with customized seat cover, for both back seat and bottom seat. An important objective of the truck pilot was to focus on making the HUMABIO system as unobtrusive as possible. The sensing seat modality was therefore particularly suitable to be used in the truck pilot.

pilotpilot

To be able to start the truck simulator (with ignition key) the user needs to go through the authentication procedure:

  • Registration of authorized truck driver.
  • Enrolment of each modality.
  • Use of HUMABIO system to give access to start the vehicle and start driving (initial authentication).
  • Re-authentication after the driver has left the seat for a short period of time.
  • Intruder making an attempt for re-authentication.

The re-authentication is used to prevent an authorized user to go through the initial authentication and then hand over to an unauthorized driver. As soon as the driver has left the seat the HUMABIO system will notice this and activate the system.

The Truck pilot - Results

The user acceptance was overall positive to the HUMABIO system. They found the system appealing and good as long as it helps to increase safety on the roads. Though one common opinion was that it is important to consider the personal integrity and handle the personal information with care.

To include the main stakeholders a questionnaire was sent out to seven Swedish haulage contractors. Replies from three companies were received and the responses were quite similar to the answers received during the truck pilot. Concerning the advantages they found the system contributing to make it harder to steal the vehicle and the HUMABIO system design gives also security with different levels, layer on layer. An issue seems to be that it takes a longer time to start the vehicle depending on how often you need to run the procedure and also that there might be a risk that the driver can be threatened to start the vehicle. However, the system sounds very interesting for companies and they are also willing to pay for the system.

The Airport pilot

The aim was to assess the technical performance along with the user acceptance when using the HUMABIO prototype system in an airport environment with the purpose of authenticating the identity of employees working at the airport.

pilotThe HUMABIO Airport pilot took place in a controlled area in the Euroairport in Basel, Switzerland

Specifically, the HUMABIO system was integrated in a separate room in the Euroairport without public access and the pilot was performed in two days with 14 attending respondents, both professional pilots and airport employees.

pilotpilot

The included modules of the HUMABIO system were the following:

  • Gait recognition module
  • Voice recognition module
  • Face recognition module and the automatic height positioning system

For the face recognition a camera was installed on the height positioning system and a stereo microphone was positioned also on the top of the face camera for the voice recognition module.

Additionally, the stereoscopic camera for the gait recognition was also integrated in the room to capture the gait signal during the tests. An important objective of this pilot was to focus on the on-the-move authentication using unobtrusive sensors.

The following scenarios/use cases of HUMABIO were evaluated in the airport pilot:

  • System administration
    • Enrolment of a new System user (authorized employee)
    • Activation/Deactivation of biometric modalities
  • User token identification
  • User authentication
  • Voice recognition module

The Airport pilot - Results

In comparison to other security means used in the airport (e.g. passport) the authentication procedure was rated as acceptable, few participants voted for a faster access but nobody reported problems or reservations on behalf of the behavioural sensors used in this application scenario. The whole system was rated as useful and they found it also easy to use. As time is essential when people want to enter their working place, there was a common opinion from the employees that the authentication procedure from each modality and essential for the gait modality could be more effective and shortened as much as possible.

The Lab/Office pilot

The aims of the laboratory test were to request experiences and user acceptance when using the HUMABIO prototype system as well as testing the technical performance of the prototype.

pilotThe HUMABIO Lab/Office pilot took place in the Lab Innovation Centre (LIC) of Fraunhofer IAO and Fraunhofer IGB in Stuttgart, Germany.

The LIC has been founded in order to realize and test modern and innovative laboratory working environments. The personnel working in the lab is used to receive new technology at their work place and to test it by integration to their daily work processes.

pilotpilot

Cleanliness and security are highest demands in this environment, as misuse and contamination are the biggest threads for the biologic research material. Access to various materials, probes and equipment like the FACS cell sorter is strictly restricted to the responsible or specially trained persons.

Due to these facts the HUMABIO authentication system is a highly interesting approach to make work in the laboratory safer for data, equipment and bioprobes.

The following modules of the HUMABIO system have been applied:

  • Face and voice biometric measures.
  • Enobio EEG and ECG physiological measures.

A camera was installed below the PC monitor for the face recognition. For the voice recognition a stereo microphone was placed on the top of the monitor. EEG and ECG measures were taken by wearing the ENOBIO sensor during the authentication procedure.

15 employees of the laboratory took part in the tests. Every employee took part twice on two different days. The task for the lab employee was to get access to a protected PC that would drive a specific laboratory device like the FACS laser cell sorter.
The user had to indicate his or her person with a RFID chip, according to this information a user profile was loaded and the user was automatically asked to go trough the HUMABIO authentication procedure.

Face, voice, EEG and ECG data of each participant was compaired to the stored data profile. After a successful authentication the test participant left the camera scope and the system was automatically blocked. Following either a re-authentication of face and voince modality was performed with the same user (successful in almost all cases) or an intruder or imposter tried to enter the blocked system. In this case the HUMABIO system kept the access to the PC blocked in all trials.

The Lab/Office pilot - Results

In comparison to other security means used in the laboratory the authentication procedure was rated as totally acceptable, few participants voted for a faster access but nobody reported problems or reservations on behalf of the sensors. This might also be a result of the very reliable results and performance of the complete HUMABIO system during the laboratory test pilot.

European Framework

  • European Commission
  • IST logo
  • Sixth Framework Programme (FP6)

Related Projects

  • BIOSEC
    Biometrics and Security
  • BIOSECURE
    Biometrics for Secure Authentication
  • BITE
    Biometric Identification Technology Ethics
  • COST 275
    Biometrics-Based Recognition of People over the Internet
  • ERMIS
    Emotionally Rich Man-machine Intelligent System
  • HUMAINE
    Human-Machine Interaction Network on Emotion
  • ICT for Trust and Security
    Security and dependability of Information and Communication Technology
  • SENSATION
    Advanced Sensor Development for Attention, Stress, Vigilance & Sleep/ Wakefulness Monitoring

Other useful links