Welcome! I am a Lead Research Scientist heading the Creative Vision team at Snap Research. My work focuses on creating methods for manipulating the world via computer vision and machine learning. This includes style transfer, photorealistic object manipulation and animation, video synthesis, prediction and retargeting. My work has been published as 20+ top conference papers, journals and patents resulting in multiple tech transfers, including Snapchat Pet Tracking and Real-time Neural Lenses (gender swap, baby face).
Before joining Snap Inc., I built the real-time face tracking and reconstruction engine behind facify.me. 2016, I was a research intern at Microsoft Research, Cambridge, UK, and worked with Sebastian Nowozin and Andrew Fitzgibbon on improving generative models. In 2017, I interned at NVIDIA with Ming-Yu Liu, Xiaodong Yang and Jan Kautz and worked on video generation.
I am a PhD graduate from the University of Trento, Italy, where I worked with Nicu Sebe at the Multimedia and Human Understanding Group MHUG. Before joining the MHUG group, I worked as a software engineer for six years.
I am looking for prospective interns and collaborators. If you are interested send me an email.
Media coverage:
Contact: stulyakov@snap.com
The ultimate goal of the Creative Vision group is to develop cutting edge computer vision, machine learning, and graphics technology to unlock creativity of users and creators in a variety of products at Snap. Our work enables machines to see, understand and manipulate the world. We focus on the following broad directions:
July 2017 - Present:
Lead Research Scientist at SNAP Research, Venice, CA
Jan 2017 - Apr 2017:
Research Intern at NVIDIA Research, Santa Clara, CA
Aug 2016 - Nov 2016:
Research Intern at Microsoft Research, Cambridge, UK
July 2010 - Sept 2012:
Team and Project Lead at HiQo-Solutions, Minsk, Belarus
June 2006 - June 2010:
Software Engineer at Todes Ltd, Minsk, Belarus
Nov 2012 - Apr 2017:
PhD Canditate at The Univesity of Trento, Italy
Sept 2014 - Feb 2015:
Research intern at the Robotics Institute, Carnegie-Mellon University
Sept 2009 - July 2010:
MSc at the Belarusian State University of Intormatics and Radioelectronics
Sept 2004 - July 2009:
B.Eng at the Belarusian State University of Intormatics and Radioelectronics
Teaching Computers to Imagine with Deep Generative Models
Sergey Tulyakov, Stéphane Lathuilière
University of Trento, Italy. November 19-26, 2019
Course material
Human Motion Transfer from Poses in the Wild
Jian Ren, Menglei Chai, Sergey Tulyakov, Chen Fang, Xiaohui Shen, Jianchao Yang.
arXiv preprint
Paper
Laplace Landmark Localization
Joseph P Robinson, Yuncheng Li, Ning Zhang, Yun Fu, and Sergey Tulyakov
International Conference on Computer Vision, 2019
Paper
3D Guided Fine-Grained Face Manipulation
Zhenglin Geng, Chen Cao, Sergey Tulyakov
Computer Vision and Pattern Recognition, 2019
Paper
Train One Get One Free: Partially Supervised Neural Network for Bug Report Duplicate Detection and Clustering
Lahari Poddar, Leonardo Neves, William Brendel, Luis Marujo, Sergey Tulyakov, Pradeep Karuturi
North American Chapter of the Association for Computational Linguistics, 2019
Paper
Recurrent Convoltutional Shape Regression
Wei Wang, Sergey Tulyakov and Nicu Sebe
IEEE Transactions on Pattern Analysis and Machine Intelligence, 2018
Paper
Hybrid VAE: Improving Deep Generative Models using Partial Observations
Sergey Tulyakov, Andrew Fitzgibbon, Sebastian Nowozin
Neural Information Processing Systems Workshops, 2017
Paper
Viewpoint-consistent 3D Face Alignment
Sergey Tulyakov, Laszlo A. Jeni, Jeffrey F. Cohn and Nicu Sebe
IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
Paper
[Oral] Recurrent Convolutional Face Alignment
Wei Wang, Sergey Tulyakov and Nicu Sebe
Asian Conference on Computer Vision, 2016
PaperSergey Tulyakov, Xavier Alameda Pineda, Elisa Ricci, Jijun Yin, Jeffrey Cohn and Nicu Sebe
Computer Vision and Pattern Recognition, 2016
Read moreRegressing a 3D Face Shape from a Single Image
Sergey Tulyakov and Nicu Sebe
International Conference on Computer Vision, 2015
Read moreFaceCept3D: Real Time 3D Face Tracking and Analysis
Sergey Tulyakov, Radu Vieriu, Enver Sangineto and Nicu Sebe
International Conference on Computer Vision Workshops, 2015
Paper