Heather Pon-Barry

Clare Boothe Luce Assistant Professor of Computer Science
Mount Holyoke College

Email: 
Office: Clapp 226 
Office Hours:  Th 11:15 AM-12 PM
  Fri 2:30 PM-4:00 PM
  and via google cal appointments

Photo: Heather Pon-Barry Photo: Heather Pon-Barry

News

Teaching

Fall 2016
CS 201 Advanced Object-Oriented Programming
CUSP 216 MaGE Training

Past Courses
CS 341 Natural Language Processing
CS 334 Artificial Intelligence

Megas and Gigas Educate

At Mount Holyoke College, we are developing a new technical peer mentoring program: Megas and Gigas Educate (MaGE). The goals of MaGE are to grow enrollment capacity in introductory computer science courses while maintaining close interaction and quality feedback, to increase enrollment and retention for women and other underrepresented groups, and to train students to educate, mentor, and support others in inclusive ways.

As part of the Megas and Gigas Educate program, the MaGE Training Course prepares students for the task of educating, mentoring, and supporting others in inclusive ways. This training course raises awareness of the role of social identity in learning, emphasizes active learning within computer science, and provides preparation for being technical peer mentors. We are excited to share our curriculum materials with the community, in hopes that other educators and students might consider adopting similar peer mentor training at their institutions.

Research

Research interests: spoken language processing, human-robot interaction, and computer science education. I am the director of the Interactive Computing Research Lab at Mount Holyoke College where we are studying spoken language processing in the context of human-robot interaction.

While speech is a natural way to communicate with robots, most robots are not able to recognize or respond to the subtleties of spoken language. Our spoken interactions with robots, dialogue systems (e.g., Siri), and other devices are not as natural as conversing with another human.

Sometimes, it's not what you say, but how you say it: in everyday communication, people use intonation, loudness, and timing to convey emphasis and emotion — a layer of meaning beyond the semantic content of the words that are spoken. For example, questions are frequently signaled by rising intonation. Affective and cognitive states such as annoyance, engagement, confidence and uncertainty might conveyed through a combination of signals.

In the Interactive Computing Research Lab, we address basic scientific questions about how humans use spoken natural language when communicating (i) with other humans, (ii) with computers, and (iii) with robots. We study human-human conversation to understand phenomena such as acoustic-prosodic entrainment. We develop algorithms to automatically find patterns in speech data, which enable affect recognition. And we explore how these methods can inform the design of intelligent, adaptive human-robot interactions.

Watch the video below to see some of the recent projects with Nico, a humanoid robot. We are in the process of creating a physical testbed for conducting human-robot natural language interaction experiments.

Take a look at my publications page to see past projects I have worked on in spoken dialogue systems, intelligent tutoring systems, recognition of uncertainty in speech, and analysis of acoustic-prosodic entrainment.

Students

Undergraduate Students

  • My Trinh
  • Ngoc Vu
  • Sophey Dong
  • Yavneeka Patel

Graduate Students

  • Nichola Lubold (ASU, Ph.D. student, co-advised with Erin Walker)
  • Arun Reddy Nelakurthi (ASU, M.S. 2014)

Links For Students

Chart of MHC Computer Science Courses

Instructions for requesting letters of recommendation

For Visitors

Map of Clapp Laboratory/where to park

Press

Other Activities and Affiliations

I'm a member of Mount Holyoke's Committee on Data Science.

I'm an Adjunct Assistant Professor in the College of Information and Computer Sciences at UMass Amherst.

Contact Information

Heather Pon-Barry
Computer Science Department
Mount Holyoke College
50 College Street
South Hadley, MA 01075

(413) 538-2241