- Nichola Lubold is presenting our paper on Voice-Adaptation and Social Dialogue with a Robotic Learning Companion at HRI 2016
- Going to SIGCSE 2016 to talk about the MaGE Program
CS 201 Advanced Object-Oriented Programming
Megas and Gigas Educate
Megas and Gigas Educate (MaGE) is a new inclusive peer mentoring program for computer science that we are developing at Mount Holyoke.
Research interests: spoken language processing, human-robot interaction, and computer science education. I am the director of the Interactive Computing Research Lab at Mount Holyoke College where we are studying spoken language processing in the context of human-robot interaction.
While speech is a natural way to communicate with robots, most robots are not able to recognize or respond to the subtleties of spoken language. Our spoken interactions with robots, dialogue systems (e.g., Siri), and other devices are not as natural as conversing with another human.
Sometimes, it's not what you say, but how you say it: in everyday communication, people use intonation, loudness, and timing to convey emphasis and emotion — a layer of meaning beyond the semantic content of the words that are spoken. For example, questions are frequently signaled by rising intonation. Affective and cognitive states such as annoyance, engagement, confidence and uncertainty might conveyed through a combination of signals.
In the Interactive Computing Research Lab, we address basic scientific questions about how humans use spoken natural language when communicating (i) with other humans, (ii) with computers, and (iii) with robots. We study human-human conversation to understand phenomena such as acoustic-prosodic entrainment. We develop algorithms to automatically find patterns in speech data, which enable affect recognition. And we explore how these methods can inform the design of intelligent, adaptive human-robot interactions.
Watch the video below to see some of the recent projects with Nico, a humanoid robot. We are in the process of creating a physical testbed for conducting human-robot natural language interaction experiments.
Take a look at my publications page to see past projects I have worked on in spoken dialogue systems, intelligent tutoring systems, recognition of uncertainty in speech, and analysis of acoustic-prosodic entrainment.
- My Trinh
- Ngoc Vu
- Sophey Dong
- Yavneeka Patel
- Nichola Lubold (ASU, Ph.D. student, co-advised with Erin Walker)
- Arun Reddy Nelakurthi (ASU, M.S. 2014)
Links For Students
|Chart of MHC Computer Science Courses|
|Instructions for requesting letters of recommendation|
|Map of Clapp Laboratory/where to park|
- 3/11/15, MHC News, Google funds new computer science initiative
- 2/12/15, MHC News, MassMutual partnership propels women in data science
- 10/17/14, MHC News, "Gigas and Megas" mentor program launched
- 10/5/14, Mount Hoyloke News, Faculty Profile: Professor Heather Pon-Barry and College collaborate to bring robots to life
Other Activities and Affiliations
I'm a member of Mount Holyoke's Committee on Data Science.
I'm an Adjunct Assistant Professor in the College of Information and Computer Sciences at UMass Amherst.
Computer Science Department
Mount Holyoke College
50 College Street
South Hadley, MA 01075