Current Projects
- Robust Multimodal Interpretation in Conversation Systems - Multimodal systems allow users to interact with computers through multiple modalities such as speech, gesture, and gaze. These systems are designed to support...
- Eye Gaze in Salience Modeling for Spoken Language Processing - Previous psycholinguistic work has shown that eye gaze is tightly linked to human language processing. Almost immediately after hearing a word, the eyes move ...
Past Projects
- Discourse Processing in Conversational QA - Question answering (QA) systems take users' natural language questions and automatically locate answers from large collections of documents. During the...
- Interactive Multimedia Retrieval - Text queries are natural and intuitive for users to describe their information needs. However, text-based image retrieval faces many challenges. Traditional text retrieval...
