Skip to content

A computational explanation for face-learning behaviors by using deep artificial neural networks

License

Notifications You must be signed in to change notification settings

JingeW/Critical-Period-Analysis

Repository files navigation

Critical Period Analysis on Face Recognition

License: MIT

We provide a full computational account for face-learning behaviors by using deep artificial neural networks and show that impaired face-learning can be restored when providing information within a critical period.

📃 Read the Full Paper

Requirements

  1. numpy
  2. pandas
  3. scipy
  4. pickle
  5. matplotlib
  6. sklearn
  7. torchvision

Data

The dataset used in this project is CASIA-WebFace.
You can download all the data used in this project with the link.

Here are some examples of the data:

Data Exp

Disclaimer

This project is for academic research purposes only. The code in this repository is released under the MIT License. If you use the data provided, please cite Yi, Dong, et al. "Learning face representation from scratch." arXiv preprint arXiv:1411.7923 (2014).

Data Preprocessing

We applied foveate blurring to generate the data using different eye fixations.

Data Prep

Observations

We found the critical period played an important role in the learning phase of face recognition.

The Grad-CAM for an example face The Grad-CAM group average across faces

Recovery

We also proposed a method to recover the impairments caused during the Critical Period with an extremely low learning rate.

KL-AT

With Knowledge Distillation and Attention Transfer, we recovered the accuracy of the impaired model.

The recovery is also confirmed by statistical metrics

Citation

@article{wang2024critical, title={A critical period for developing face recognition}, author={Wang, Jinge and Cao, Runnan and Chakravarthula, Puneeth N and Li, Xin and Wang, Shuo}, journal={Patterns}, volume={5}, number={2}, year={2024}, publisher={Elsevier} }