I am a final-year Master’s student at New Laboratory of Pattern Recognition (NLPR) in Institute of Automation, Chinese Academy of Sciences (CASIA). Before this, I obtained my Bachelor Degree of Automation Engineering in Nanjing University of Aeronautics and Astronautics with Honors Distinction. I am fortunate to have internships at serveral leading research institutions, including MicroSoft Research Asia and SenseTime Research. I have extensive experience in studying the NeRF-based motion transfer and diffusion-based human-centric generation. Also, I am conducting cutting-edge research in 3D Human-Object Interaction Tracking for my possible PhD program.
My previous research mainly focused on three aspects:- Face Neural Rendering: Talking-Head Video Generation, Face Reenactment, and Facial Attribute Editing
- Text-to-Image Face Analysis: Personalization and Identity Erasure
- Robust Face Recognition System: De-Identification, Anti-Spoofing, and Deepfake Detection
🔈JOIN US!
I embrace Richard Feynman’s dictum, “What I can not create, I do not understand,” as it aligns with my research goal, which is generating human-centric visual content to understand ourselves. I will continue to conduct research at the intersection of computer vision and graphics. Specifically, I plan to employ generative models to enhance human-computer interaction, based on technical expertise accumulated through my collaboration with 3D human-related scientists and engineers. Let’s embark on our journey towards a technologically-advanced era of immersive human-object/scene interaction!
Do not hesitate to drop me an email for any possible collaboration if you are interested in these directions:- Generative Models
- 3D Human Motion and Human-Object-Scene Interaction
- Face Synthesis and Analysis
- Neural Rendering
- Physics-Aware Content Generation
- Robotics and Embodied Intelligence
🔥 News
- 2024/03: One paper is accepted by ICME 2024.
- 2024/01: I am invited by AI TIME to give a talk (in Chinese) about PlaneDict (AAAI 2024).
- 2023/12: One paper is accepted by AAAI 2024.
- 2023/10: I am granted by National Scholarship (Graduate). What a fierce competition!
- 2023/07: One paper is accepted by MM 2023.
- 2023/04: One paper is accepted by CVPR 2023 Biometrics Workshop.
- 2023/02: One paper is accepted by ICASSP 2023.
- 2021/10: One paper is accepted by CCBR 2021.
📖 Education
-
M.S. in Pattern Recognition and Intelligent Systems, NLPR Department, CASIA Institute
Sep. 2021 - Jun. 2024
Supervisor: Prof. Wei Wang (Co-Supervised by Prof. Jing Dong and Prof. Bo Peng)
Thesis: Dynamic Facial Editing based on Neural Radiance Fields
GPA: 3.82/4.0 (National Scholarship) -
B.E. in Automation Engineering, Nanjing University of Aeronautics and Astronautics
Sep. 2017 - Jun. 2021
Thesis: Face De-Identification based on Generative Adversarial Networks (Province Award)
GPA: 4.4/5.0 (Rank: 1/204, Honors Distinction)
💻 Work Experience
-
Research Intern, Content Generation Group, SenseTime Research
Sep. 2022 - Aug. 2023
Supervised by Xiangyu Fan and Lei Yang. -
Research Intern, Machine Learning Group, MicroSoft Research Asia
Mar. 2022 - Aug. 2022
Supervised by Xu Tan and Jun Ling. -
Research Intern, Identity Verification Group, SenseTime Research
Jun. 2021 - Sep. 2021
Supervised by Chenye Xu and Yichao Wu.
📝 Publications
Learning Dense Correspondence for NeRF-Based Face Reenactment
Songlin Yang, Wei Wang, Yushi Lan, Xiangyu Fan, Bo Peng, Lei Yang, Jing Dong
Proceedings of the AAAI Conference on Artificial Intelligence, 2024
Paper Project
Is It Possible to Backdoor Face Forgery Detection with Natural Triggers?
Xiaoxuan Han, Songlin Yang, Wei Wang, Ziwen He, Jing Dong
Designing a 3D-Aware StyleNeRF Encoder for Face Editing
Songlin Yang, Wei Wang, Bo Peng, Jing Dong
IEEE International Conference on Acoustics, Speech, and Signal Processing, 2023
A Systematical Solution for Face De-Identification
Songlin Yang, Wei Wang, Yuehua Cheng, Jing Dong
🎖️ Awards
- National Scholarship (Graduate). 2023
- National Scholarship (Bachelor). 2018
- Provincial Outstanding Graduate. 2021
- Provincial Outstanding Bachelor Thesis Award. 2021
- President Scholarship of Nanjing University of Aeronautics and Astronautics. 2020
- Outstanding Graduate of Nanjing University of Aeronautics and Astronautics. 2021
- Outstanding Student of University of Chinese Academy of Sciences. 2022, 2023, 2024
- Scholarship of Aviation Industry Corporation of China. 2019, 2020
- First Class Scholarship for Academic Excellence. 2017, 2018, 2019, 2020
🕴️ Professional Services
- Publicity Chair for IEEE Beijing Biometrics Council Chapter (2021-Now).
- IEEE Student Member (2021-Now).
- Conference Reviewer
- AAAI (2023, 2024)
- CVPR (2022, 2023, 2024)
- MM (2024)
- ECCV (2022, 2024)
- ICME (2024)
- IJCB (2022)
- ICASSP (2024)
- Journal Reviewer
- IEEE Transactions on Multimedia (TMM)
- IEEE Transactions on Circuits and Systems for Video Technology (TCSVT)
- ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM)