Skip to content

qqizhao/Awesome-rPPG-Method-List

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

17 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Awesome-rPPG-Method-List

This repository is a collection of awesome rPPG methods. I will update it gradually, if you have any suggestions or questions, please feel free to contact me. If you know any other methods, please create a issue or pull request. If you find this repository helpful, please give me a star.

Table of Contents

The classification of the paper references the paper

Awesome Papers

Survey

Title Publication Code
Remote photoplethysmography for heart rate measurement: A review Biomedical Signal Processing and Control 2023 -
Camera Measurement of Physiological Vital Signs ACM Computing Surveys 2021 -
Video-Based Heart Rate Measurement: Recent Advances and Future Prospects TIM 2019 -

Traditional Methods

Title Publication Code
Face2PPG: An Unsupervised Pipeline for Blood Volume Pulse Extraction From Faces (OMIT) IEEE JBHI 2023 -
Local Group Invariance for Heart Rate Estimation from Face Videos in the Wild (LGI) CVPR Workshop 2018 -
Algorithmic Principles of Remote PPG (POS) IEEE TBME 2016 -
A Novel Algorithm for Remote Photoplethysmography: Spatial Subspace Rotation (2SR) IEEE TBME 2015 -
Improved motion robustness of remote-PPG by using the blood volume pulse signature (PBV) Physiological Measurement 2014 -
Robust Pulse Rate From Chrominance-Based rPPG (CHROM) IEEE TBME 2013 -
Measuring pulse rate with a webcam—a non-contact method for evaluating cardiac activity (PCA) FedCSIS 2011 -
Remote plethysmographic imaging using ambient light Optics Express 2008

Supervised Learning

2D CNN

Title Publication Code
Visual heart rate estimation with convolutional neural network (NAS-HR) Virtual Reality & Intelligent Hardware 2021 github
Multi-Task Temporal Shift Attention Networks for On-Device Contactless Vitals Measurement (MTTS-CAN) NeurIPS 2020 github
RhythmNet: End-to-End Heart Rate Estimation From Face via Spatial-Temporal Representation (RhythmNet) IEEE TIP 2020 github
Video-Based Remote Physiological Measurement via Cross-Verified Feature Disentangling (CVD) ECCV 2020 oral github
SynRhythm: Learning a Deep Heart Rate Estimator from General to Specificn(SynRhythm) ICPR 2018 -
EVM-CNN: Real-Time Contactless Heart Rate Estimation From Facial Video (EVM-CNN) IEEE TMM 2018 -
DeepPhys: Video-Based Physiological Measurement Using Convolutional Attention Networks (DeepPhys) ECCV 2018 github
Visual heart rate estimation with convolutional neural network (HR-CNN) BMVC 2018 github

3D CNN

Title Publication Code
FactorizePhys: Matrix Factorization for Multidimensional Attention in Remote Physiological Sensing(FactorizePhys) NeurIPS 2024 github
Augmentation of rPPG Benchmark Datasets: Learning to Remove and Embed rPPG Signals via Double Cycle Consistent Learning from Unpaired Facial Videos(RErPPGNet) ECCV 2022 github
ETA-rPPGNet: Effective Time-Domain Attention Network for Remote Heart Rate Measurement (ETA-rPPGNet) IEEE TIM 2021 -
Deep Super-Resolution Network for rPPG Information Recovery and Noncontact Heart Rate Estimation IEEE TIM 2021 -
Siamese-rPPG network: remote photoplethysmography signal estimation from face videos (Siamese-rPPG) ACM SAC 2020 -
AutoHR: A Strong End-to-End Baseline for Remote Heart Rate Measurement With Neural Searching (AutoHR) IEEE SPL 2020 -
HeartTrack: Convolutional neural network for remote video-based heart rate monitoring (HeartTrack) CVPR Workshop 2020 -
Remote Heart Rate Measurement from Highly Compressed Facial Videos: an End-to-end Deep Learning Solution with Video Enhancement (rPPGNet) ICCV 2019 github
Remote Photoplethysmograph Signal Measurement from Facial Videos Using Spatio-Temporal Networks (PhysNet) BMCV 2019 github
3D Convolutional Neural Networks for Remote Pulse Rate Measurement and Mapping from Facial Video(rppg-3dcnn) Applied Science 2019 github

RNN

Title Publication Code
Meta-rPPG: Remote Heart Rate Estimation Using a Transductive Meta-learner (Meta-rPPG) ECCV 2020 github
Long short-term memory deep-filter in remote photoplethysmography CVPR Workshop 2020 -
Vision-Based Heart Rate Estimation Via A Two-Stream CNN ICIP 2019 -
An Accurate LSTM Based Video Heart Rate Estimation Method PRCV 2019 -

GAN

Title Publication Code
Dual-bridging with Adversarial Noise Generation for Domain Adaptive rPPG Estimation CVPR 2023 -
Dual-GAN: Joint BVP and Noise Modeling for Remote Physiological Measurement (Dual-GAN) CVPR 2021 -
PulseGAN: Learning to Generate Realistic Pulse Waveforms in Remote Photoplethysmography (PulseGAN) IEEE JBHI 2021 github
Deep-HR: Fast heart rate estimation from face video under realistic conditions (Deep-HR) Expert Systems with Applications 2021 github

Transformer

Title Publication Code
PhysFormer++: Facial Video-Based Physiological Measurement with SlowFast Temporal Difference Transformer (PhysFormer++) IJCV 2023 -
EfficientPhys: Enabling Simple, Fast and Accurate Camera-Based Cardiac Measurement (EfficientPhys) WACV 2023 github
RADIANT: Better rPPG estimation using signal embeddings and Transformer (RADIANT) WACV 2023 github
PhysFormer: Facial Video-based Physiological Measurement with Temporal Difference Transformer (PhysFormer) CVPR 2022 github
Instantaneous Physiological Estimation Using Video Transformers (instantaneous_transformer) - github

Unsupervised Learning

Title Publication Code
RS-rPPG: Robust Self-Supervised Learning for rPPG (RS-rPPG) IEEE FG 2024 github
rPPG-MAE: Self-supervised Pre-training with Masked Autoencoders for Remote Physiological Measurement (rPPG-MAE) arXiv 2023 github
Non-Contrastive Unsupervised Learning of Physiological Signals from Video (SiNC-rPPG) CVPR 2023 Highlight github
SimPer: Simple Self-Supervised Learning of Periodic Targets (SimPer) ICLR 2023 Oral github
Facial Video-based Remote Physiological Measurement via Self-supervised Learning IEEE TPAMI 2023 github
Contrast-Phys: Unsupervised Video-Based Remote Physiological Measurement via Spatiotemporal Contrast(Contrast-Phys) ECCV 2022 github
Self-Supervised RGB-NIR Fusion Video Vision Transformer Framework for rPPG Estimation IEEE TIM 2022 -
Self-supervised Representation Learning Framework for Remote Physiological Measurement Using Spatiotemporal Augmentation Loss(SLF-RPM) AAAI 2022 github
The Way to my Heart is through Contrastive Learning: Remote Photoplethysmography from Unlabelled Video ICCV 2021 github

Other Methods

Title Publication Code
Continual Learning for Remote Physiological Measurement: Minimize Forgetting and Simplify Inference ECCV 2024 github
Bi-TTA: Bidirectional Test-Time Adapter for Remote Physiological Measurement(Bi-TTA) ECCV 2024 -
Resolve Domain Conflicts for Generalizable Remote Physiological Measurement (DOHA-rPPG) ACM MM 2023 github

Benchmark

Title Publication Code
rPPG-Toolbox: Deep Remote PPG Toolbox (rPPG-Toolbox) NeurIPS 2023 github
Remote Bio-Sensing: Open Source Benchmark Framework for Fair Evaluation of rPPG arXiv 2023 github
pyVHR: a Python framework for remote photoplethysmography(pyVHR) Computer Science 2022 github
Evaluation of biases in remote photoplethysmography methods(matlab) npj Digital Medicine 2021 github
iPhys: An Open Non-Contact Imaging-Based Physiological Measurement Toolbox(matlab) arXiv, 2019 github

Dataset

Title Publication Url
iBVP Dataset: RGB-Thermal rPPG Dataset with High Resolution Signal Quality Labels(iBVP) Electronics 2024 download
ReactioNet: Learning High-order Facial Behavior from Universal Stimulus-Reaction by Dyadic Relation Reasoning(BP4D+) ICCV 2023 download
MMPD: Multi-Domain Mobile Video Physiology Dataset(MMPD) EMBC 2023 download
SCAMPS: Synthetics for Camera Measurement of Physiological Signals(SCAMPS) NeurIPS 2022 download
Synthetic Generation of Face Videos with Plethysmograph Physiology (UCLA-rPPG) CVPR 2022 download
Deception Detection and Remote Physiological Monitoring: A Dataset and Baseline Experimental Results (DDPM) IEEE TBIOM 2021 download
UBFC-Phys: A Multimodal Database For Psychophysiological Studies Of Social Stress (UBFC-Phys) IEEE TAFFC 2021 download
VIPL-HR: A Multi-modal Database for Pulse Estimation from Less-constrained Face Video (VIPL-HR) ACCV 2018 download
A Reproducible Study on Remote Heart Rate Measurement (COHFACE) arXiv 2017 download
Unsupervised skin tissue segmentation for remote photoplethysmography (UBFC-rPPG) Pattern Recognition Letters 2017 download
Multimodal Spontaneous Emotion Corpus for Human Behavior Analysis (MMSE-HR) CVPR 2016 download
Non-contact Video-based Pulse Rate Measurement on a Mobile Service Robot (PURE) 2014 download
DEAP: A Database for Emotion Analysis Using Physiological Signals (DEAP) IEEE TAFFC 2011 download

Acknowledgments