Sergey Tulyakov

Welcome! I am a Senior Research Scientist at Snap Research. My research focuses on 2D and 3D computer vision, including face tracking, 3D reconstruction, and analysis and generation. I am interested in both discriminative and generative modelling techniques.

In 2016, I was a research intern at Microsoft Research, Cambridge, UK, and worked with Sebastian Nowozin and Andrew Fitzgibbon on improving generative models. In 2017, I interned at NVIDIA with Ming-Yu Liu, Xiaodong Yang and Jan Kautz and worked on video generation.

I got my PhD from the University of Trento, Italy, working with Nicu Sebe at the Multimedia and Human Understanding Group MHUG

Before joining the MHUG group, I worked as a software engineer for six years.

I am looking for prospective interns and collaborators. If you are interested send me an email.

Contact: stulyakov@snap.com

Download CV

My research focuses on various computer vision and machine learning problems, ranging from discriminative tasks in face analysis to generative modelling techniques.

Face detection, tracking, head pose estimation
2D and 3D face alignment
Unconstrained heart rate recognition from videos, facial expression recognition
Image and video generative methods

I like creating things that work. Checkout my GitHub profile and projects below.

Nov 2012 - Apr 2017:

PhD Canditate at The Univesity of Trento, Italy

Sept 2014 - Feb 2015:

Research intern at the Robotics Institute, Carnegie-Mellon University

Sept 2009 - July 2010:

MSc at the Belarusian State University of Intormatics and Radioelectronics

Sept 2004 - July 2009:

B.Eng at the Belarusian State University of Intormatics and Radioelectronics

Jul 2017 - Present:

Senior Research Scientist at SNAP Research, Venice, CA

Jan 2017 - Apr 2017:

Research Intern at NVIDIA Research, Santa Clara, CA

Aug 2016 - Nov 2016:

Research Intern at Microsoft Research, Cambridge, UK

July 2010 - Sept 2012:

Team and Project Lead at HiQo-Solutions, Minsk, Belarus

June 2006 - June 2010:

Software Engineer at Todes Ltd, Minsk, Belarus

Facify.me

Facify.me is an augmented reality technology, based on 3D face tracking & reconstruction. It features more than 100 fps 3D tracking on an iPhone 5. It tracks 804 3D face points. The app is avilable on App Store. I am planning to release the tracking code soon. Stay tuned!

FaceCept3D

FaceCept3D is a flexible open-source technology for 3D face analysis and recognition, available on GitHub. It allows for head pose estimation and facial expression recognition from extreme head poses. Key advantages of the technology include: flexible architecture that decouples scientific algorithms from technical components and real-time processing pipeline.

FaceCept

FaceCept technology is a set of components that allows real-time analysis of people's faces. It includes gender, age, facial expression, new/returning and attention time recognition. The technology is cross-platform: it works even in a browser. The project took first place in ITJUMP 2012.