Now, computer software to respond to students' emotions and boredom

   Mar 3, 3:05 pm

Washington, Mar 3 (ANI): Scientists have developed an emotion-sensing computer software that models and responds to students' cognitive and emotional states including frustration and boredom.

The new technology, developed by University of Notre Dame's Sidney D'Mello, Art Graesser from the University of Memphis and a colleague from Massachusetts Institute of Technology, not only offers tremendous learning possibilities for students, but also redefines human-computer interaction.

"AutoTutor" and "Affective AutoTutor" can gauge the student's level of knowledge by asking probing questions, analysing the student's responses to those questions, proactively identifying and correcting misconceptions, responding to the student's own questions, gripes and comments, and even sensing a student's frustration or boredom through facial expression and body posture and dynamically changing its strategies to help the student conquer those negative emotions.

"Most of the 20th-century systems required humans to communicate with computers through windows, icons, menus and pointing devices," Science Daily quoted D'Mello as saying.

"But humans have always communicated with each other through speech and a host of nonverbal cues such as facial expressions, eye contact, posture and gesture. In addition to enhancing the content of the message, the new technology provides information regarding the cognitive states, motivation levels and social dynamics of the students," D'Mello said.

AutoTutor is an Intelligent Tutoring System (ITS) that helps students learn complex technical content in Newtonian physics, computer literacy and critical thinking by holding a conversation in natural language, simulating teaching and motivational strategies of human tutors, modelling students' cognitive states, using its student model to dynamically tailor the interaction to individual students, answering students' questions, identifying and correcting misconceptions, and keeping students engaged with images, animations and simulations.

In addition to these capabilities, Affective AutoTutor adds emotion-sensitive capabilities by monitoring facial features, body language and conversational cues, regulating negative states such as frustration and boredom, and synthesizing emotions via the content of its verbal responses, speech intonation and facial expressions of an animated teacher.

"Much like a gifted human tutor, AutoTutor and Affective AutoTutor attempt to keep the student balanced between the extremes of boredom and bewilderment by subtly modulating the pace, direction and complexity of the learning task," D'Mello said.

Considerable empirical evidence has shown that one-on-one human tutoring is extremely effective when compared to typical classroom environments, and AutoTutor and Affective AutoTutor closely model the pedagogical styles, dialogue patterns, language and gestures of human tutors.

They are also one of the few ITSs that help learning by engaging students in natural language dialogues that closely mirror human-human tutorial dialogues.

Tested on more than 1,000 students, AutoTutor produces learning gains of approximately one letter grade-gains that have proven to outperform novice human tutors and almost reach the bar of expert human tutors.

The study will be published in the special edition of ACM Transactions on Interactive Intelligent Systems. (ANI)

Chinese institute to develop facial recognition payment system by 2015 Sep 1, 3:43 pm
Beijing, Sep 1 (ANI): Chongqing Institute of Green and Intelligent Technology has announced that it is developing a facial recognition payment system in China whereby users can show a photo for authentication purposes while doing online transactions.
Full Story
Now, view and share videos, photos of live events on Snapchat with 'Our Story' Sep 1, 3:42 pm
Washington, Sep 01 (ANI): Snapchat is now poised to go beyond its capacity to allow users to share slices of their lives with friends by adding a new feature to its app called "Our story."
Full Story
Apple iWatch won't be on 'sale' from Sep 9, only announced Sep 1, 11:51 am
Washington, Sep 1 (ANI): New reports suggest that Apple would announce the iWatch in September, but it won't be on sale.
Full Story
Apple set to enter wearables market with multiple models Aug 31, 5:26 pm
Washington, Aug 31 (ANI): Apple is reportedly planning to mark its foray into the wearables market with multiple models, priced differently.
Full Story
Comments

LATEST STORIES
TOP VIDEO STORIES
PHOTO GALLERY