Intel RealSense ID is your trusted facial authentication on-device solution.
Intel RealSense ID combines an active depth sensor with a specialized neural network designed to deliver an intuitive, secure and accurate facial authentication solution that adapts over time. This solution offers user privacy and is activated by user awareness. Built-in anti spoofing technology protects against attacks using photographs, videos or masks.
Intel RealSense ID is a natural solution simplifying secure entry for everyone, everywhere. Supports children to tall adults and designed for Smart Locks, Access Control, PoS, ATMs, and Kiosks.
For high-level architecture, see Intel RealSense ID F450 / F455 Architecture Diagram.
Note: Device = Intel RealSense ID F450 / F455
- Linux (tested on ubuntu 18, gcc 7.5+)
- Windows (tested on windows 10, msvc 2019)
Use CMake version 3.13 or above:
$ cd <project_dir>
$ mkdir build && cd build
$ cmake .. // in case preview is required run: cmake .. -D RSID_PREVIEW=1
$ make -jThis snippet shows the basic usage of our library, it shows how to enroll a user, authenticate a user, and remove a user from the device's storage:
// Create face authenticator instance and connect to the device on COM9
RealSenseID::FaceAuthenticator auth {&sig_clbk};
auto connect_status = authenticator.Connect({RealSenseID::SerialType::USB, "COM9"}); // RealSenseID::SerialType::UART can be used in case UART I/F is required
// Enroll a user
const char* user_id = "John";
my_enroll_clbk enroll_clbk;
auto enroll_status = authenticator.Enroll(enroll_clbk, user_id);
// Authenticate a user
my_auth_clbk auth_clbk;
auto auth_status = authenticator.Authenticate(auth_clbk);
// Remove the user from device
bool success = authenticator.RemoveUser(user_id);
// Disconnect from the device
authenticator.Disconnect();For additional languages,build instruction and detailed code please see our examples.
C, C++ and C# API wrappers are provided as part of the library. Java and python API under development. All APIs are synchronous and assuming a new operation will not be activated till previous is completed.
C++ API.
C/C# API.
Connects host to device using USB (RealSenseID::SerialType::USB) or UART interfaces (RealSenseID::SerialType::UART).
// Create face authenticator instance and connect to the device on COM9
RealSenseID::FaceAuthenticator authenticator(&sig_clbk);
// connect to device using USB interface
auto connect_status = authenticator.Connect({RealSenseID::SerialType::USB, "COM9"});
// Connect to device using UART interface
auto connect_status = authenticator.Connect({RealSenseID::SerialType::UART, "COM9"});Starts device, runs neural network algorithm and stores encrypted faceprints on database. A faceprint is a set number of points which is represented as mathematical transformation of the user’s face. saves encrypted facial features to secured flash on Intel RealSense ID F450 / F455, Stored encrypted faceprints are matched with enrolled faceprints later during authentication. For best performance, enroll under normal lighting conditions and look directly at the device. During the enrollment process, device will send a status hint to the callback provided by application.
Full list of the hint can be found in EnrollStatus.h.
// Enroll a user with user id - "John"
const char* user_id = "John";
my_enroll_clbk enroll_clbk; // callback function will be invoked in case of a failure (e.g face not detected) or success
auto enroll_status = authenticator.Enroll(enroll_clbk, user_id); Single authentication attempt: Starts device, runs neural network algorithm, generates faceprints and compares them to all enrolled faceprints in database. Finally, returns whether the authentication was forbidden or allowed with enrolled user id. During the authentication process, device will send a status hint to the callback provided by application. Full list of the hint can be found in AuthenticationStatus.h.
class MyAuthClbk : public RealSenseID::AuthenticationCallback
{
public:
void OnResult(const RealSenseID::AuthenticateStatus status, const char* user_id) override
{
if (status == RealSenseID::AuthenticateStatus::Success)
{
std::cout << "******* Authenticate success. user_id: " << user_id << " *******" << std::endl;
}
else
{
std::cout << "on_result: status: " << status << std::endl;
}
}
void OnHint(const RealSenseID::AuthenticateStatus hint) override
{
std::cout << "on_hint: hint: " << hint << std::endl;
}
};
my_auth_clbk auth_clbk; // callback function will be invoked in case of a failure (e.g face not detected) or success
// Authenticate a user
auto auth_status = authenticator.Authenticate(auth_clbk); Starts device, runs authentication in a loop until Cancel() API is invoked. Starts camera and running loop of
- NN algo(s) pipeline
- Facial features extraction
- Matches them to all previously stored features in database.
- Returns result whether the authentication was forbidden or allowed with pre-enrolled user id. During the authentication process hint statuses might be sent to the callback provided by application. Full list of the hints can be found in AuthenticationStatus.h.
class MyAuthClbk : public RealSenseID::AuthenticationCallback
{
public:
void OnResult(const RealSenseID::AuthenticateStatus status, const char* user_id) override
{
if (status == RealSenseID::AuthenticateStatus::Success)
{
std::cout << "******* Authenticate success. user_id: " << user_id << " *******" << std::endl;
}
else
{
std::cout << "on_result: status: " << status << std::endl;
}
}
void OnHint(const RealSenseID::AuthenticateStatus hint) override
{
std::cout << "on_hint: hint: " << hint << std::endl;
}
};
my_auth_clbk auth_clbk; // callback function will be invoked in case of a failure (e.g face not detected) or a successful authentication of an user.
// start continuous authentication
auto auth_status = authenticator.AuthenticateLoop(auth_clbk); Stops authentication. Authenticate or AuthenticateLoop calls supposed to return.
authenticator.Cancel(); Removes all enrolled users in the device database.
bool success = authenticator.RemoveAll();Removes a specific user from the device database.
// Enroll a user
const char* user_id = "John";
// Remove the user "John" from device
bool success = authenticator.RemoveUser(user_id);The communication with the device is encrypted, using the ECDH protocol for the initial key exchange.
Signature callbacks enables to sign and validate communication with the device using host public/private keys.
RealSenseID::Examples::SignClbk sig_clbk;
RealSenseID::FaceAuthenticator auth {&sig_clbk};Here, the FaceAuthenicator is constructed with an example callback object to verify and generate signatures.
Please see the signature callback example for a detailed example.
Host needs to have OpenCV installed. Currently 640x352 YUV format is available.
Starts preview. Callback function that is provided as parameter will be invoked for a newly arrived image and can be rendered by your application.
class PreviewRender : public RealSenseID::PreviewImageReadyCallback
{
public:
void OnPreviewImageReady(const Image image){
{
// render image
}
};
PreviewRender image_clbk; // callback function will be invoked once new image arrived from the device.
// start continuous authenticatio
Preview preview;
auto status = preview.StartPreview(image_clbk);
...
status = preview.StopPreview(); Pause preview.
status = preview.PausePreview(); Resumes the preview.
status = preview.ResumePreview(); Stops preview.
status = preview.StopPreview(); Connects host to device using USB (RealSenseID::SerialType::USB) or UART interfaces (RealSenseID::SerialType::UART).
Resets and reboots device.
This project is licensed under Apache 2.0 license. Relevant license info can be found in "License Notices" folder
