I am a Senior Research Scientist at the Sunnyvale lab of Baidu Research, where I conduct research on Artificial Intelligence and Machine Learning. I'm particularly interested in computational models for narrative structures, including visual and textual information.

Story is a powerful tool for communication, an exhibit of creativity, and a timeless form of entertainment. Computational Narrative Intelligence (CNI) aims to create intelligent machines that can understand and create stories, manage interactive narratives, and respond appropriately to stories told to them. I have made contributions to all major areas of CNI, ranging from story generation and interactive narratives to human cognition, from learning story knowledge to story understanding. [My Google Scholar Page]

From 2015 to 2017, I was a Research Scientist at Disney Research, leading a group of postdocs and interns. Prior to that, I worked as a postdoc with Leon Sigal and Jill Lehman. In 2014, I obtained my Ph.D. degree from Georgia Institute of Technology, working with Mark Riedl.

[What's New]
May 2019: Our paper on emotion recognition and attribution from video was accepted by the IEEE Transactions on Multimedia.
Nov 2018: Our paper on generating dense video captions was accepted at WACV 2019.
Nov 2018: Our paper on learning Gaussian embeddings for actors and persona was accepted at AAAI 2019 (~16.2% acceptance rate).
Feb 2018: Released the LREC 2018 paper, the annotation dataset, the talk on YouTube, and the annotation guidelines (v1.0).
Feb 2018: One paper accepted at CVPR 2018 as a spotlight presentation (~6.8% acceptance rate). Camera-ready and supplemental materials.

moc.udiab@ilgnayob :liamE

Research Areas

Multimodal Reasoning

Story Understanding

Acquiring Story Knowledge

Story Generation