Sergey Tulyakov

Welcome! I am a Senior Research Scientist at Snap Research. My research focuses on 2D and 3D computer vision, including face tracking, 3D reconstruction, and analysis and generation. I am interested in both discriminative and generative modelling techniques.

In 2016, I was a research intern at Microsoft Research, Cambridge, UK, and worked with Sebastian Nowozin and Andrew Fitzgibbon on improving generative models. In 2017, I interned at NVIDIA with Ming-Yu Liu, Xiaodong Yang and Jan Kautz and worked on video generation.

I got my PhD from the University of Trento, Italy, working with Nicu Sebe at the Multimedia and Human Understanding Group MHUG

Before joining the MHUG group, I worked as a software engineer for six years.

I am looking for prospective interns and collaborators. If you are interested send me an email.


Download CV

My research focuses on various computer vision and machine learning problems, ranging from discriminative tasks in face analysis to generative modelling techniques.

  • Face detection, tracking, head pose estimation
  • 2D and 3D face alignment
  • Unconstrained heart rate recognition from videos, facial expression recognition
  • Image and video generative methods
I like creating things that work. Checkout my GitHub profile and projects below.

Nov 2012 - Apr 2017:

PhD Canditate at The Univesity of Trento, Italy

Sept 2014 - Feb 2015:

Research intern at the Robotics Institute, Carnegie-Mellon University

Sept 2009 - July 2010:

MSc at the Belarusian State University of Intormatics and Radioelectronics

Sept 2004 - July 2009:

B.Eng at the Belarusian State University of Intormatics and Radioelectronics

Jul 2017 - Present:

Senior Research Scientist at SNAP Research, Venice, CA

Jan 2017 - Apr 2017:

Research Intern at NVIDIA Research, Santa Clara, CA

Aug 2016 - Nov 2016:

Research Intern at Microsoft Research, Cambridge, UK

July 2010 - Sept 2012:

Team and Project Lead at HiQo-Solutions, Minsk, Belarus

June 2006 - June 2010:

Software Engineer at Todes Ltd, Minsk, Belarus is an augmented reality technology, based on 3D face tracking & reconstruction. It features more than 100 fps 3D tracking on an iPhone 5. It tracks 804 3D face points. The app is avilable on App Store. I am planning to release the tracking code soon. Stay tuned!


FaceCept3D is a flexible open-source technology for 3D face analysis and recognition, available on GitHub. It allows for head pose estimation and facial expression recognition from extreme head poses. Key advantages of the technology include: flexible architecture that decouples scientific algorithms from technical components and real-time processing pipeline.


FaceCept technology is a set of components that allows real-time analysis of people's faces. It includes gender, age, facial expression, new/returning and attention time recognition. The technology is cross-platform: it works even in a browser. The project took first place in ITJUMP 2012.

MoCoGAN: Decomposing Motion and Content for Video Generation

Sergey Tulyakov, Ming-Yu Liu, Xiaodong Yang, Jan Kautz

Computer Vision and Pattern Recognition, 2018

Paper Code

Recurrent Convoltutional Shape Regression

Wei Wang, Sergey Tulyakov and Nicu Sebe

IEEE Transactions on Pattern Analysis and Machine Intelligence, 2018


Hybrid VAE: Improving Deep Generative Models using Partial Observations

Sergey Tulyakov, Andrew Fitzgibbon, Sebastian Nowozin

Neural Information Processing Systems Workshops, 2017


Viewpoint-consistent 3D Face Alignment

Sergey Tulyakov, Laszlo A. Jeni, Jeffrey F. Cohn and Nicu Sebe

IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017


[Oral] Recurrent Convolutional Face Alignment

Wei Wang, Sergey Tulyakov and Nicu Sebe

Asian Conference on Computer Vision, 2016


[Oral] Self-Adaptive Matrix Completion for Heart Rate Estimation from Face Videos under Realistic Conditions

Sergey Tulyakov, Xavier Alameda Pineda, Elisa Ricci, Jijun Yin, Jeffrey Cohn and Nicu Sebe

Computer Vision and Pattern Recognition, 2016

Read more

Regressing a 3D Face Shape from a Single Image

Sergey Tulyakov and Nicu Sebe

International Conference on Computer Vision, 2015

Read more

FaceCept3D: Real Time 3D Face Tracking and Analysis

Sergey Tulyakov, Radu Vieriu, Enver Sangineto and Nicu Sebe

International Conference on Computer Vision Workshops, 2015


Facial Expression Recognition under a Wide Range of Head Poses

Radu Vieriu, Sergey Tulyakov, Stas Semeniuta, Enver Sangineto and Nicu Sebe

Automatic Face and Gesture Recognition, 2015

Code Paper

Robust Real-Time Extreme Head Pose Estimation

Sergey Tulyakov, Radu Vieriu, Stas Semeniuta and Nicu Sebe

International Conference on Pattern Recognition, 2014

Code Data Paper