Home   >   CSC-OpenAccess Library   >    Manuscript Information
Affect Sensing and Contextual Affect Modeling from Improvisational Interaction
Li Zhang
Pages - 45 - 60     |    Revised - 31-01-2011     |    Published - 08-02-2011
Volume - 1   Issue - 4    |    Publication Date - January / February  Table of Contents
MORE INFORMATION
KEYWORDS
Affect Detection, Context Profiles, An Intelligent Conversational Agent
ABSTRACT
We report work on adding an improvisational AI actor to an existing virtual improvisational environment, a text-based software system for dramatic improvisation in simple virtual scenarios, for use primarily in learning contexts. The improvisational AI actor has an affect-detection component, which is aimed at detecting affective aspects (concerning emotions, moods, value judgments, etc.) of human-controlled characters’ textual “speeches”. The AI actor will also make an appropriate response based on this affective understanding, which intends to stimulate the improvisation. The work also accompanies basic research into how affect is conveyed linguistically. A distinctive feature of the project is a focus on the metaphorical ways in which affect is conveyed. Moreover, we have also introduced affect detection using context profiles. Finally, we have reported user testing conducted for the improvisational AI actor and evaluation results of the affect detection component. Our work contributes to the journal themes on affective user interfaces, affect sensing and improvisational or dramatic natural language interaction.
CITED BY (2)  
1 Ptaszynski, M., Dybala, P., Mazur, M., Rzepka, R., Araki, K., & Momouchi, Y. (2013). Towards Computational Fronesis: Verifying Contextual Appropriateness of Emotions. International Journal of Distance Education Technologies (IJDET), 11(2), 16-47.
2 Ptaszynski, M. Taking Affect Analysis One Step Higher: The Idea of Contextual Appropriateness of Emotions and Its Perspectives.
1 Google Scholar 
2 CiteSeerX 
3 Scribd 
4 SlideShare 
5 PdfSR 
A. Egges, S. Kshirsagar & N. Magnenat-Thalmann. “A Model for Personality and Emotion Simulation”, In Proceedings of Knowledge-Based Intelligent Information & Engineering Systems (KES2003), Lecture Notes in AI. Springer-Verlag: Berlin. 2003
A. Ortony, G.L. Clore & A. Collins. “The Cognitive Structure of Emotions”. Cambridge U.Press. 1998
C. Fellbaum. “WordNet, an Electronic Lexical Database”. The MIT press. 1998
C. Strapparava and A. Valitutti. “WordNet-Affect: An Affective Extension of WordNet”, In Proceedings of the 4th International Conference on Language Resources and Evaluation (LREC 2004), Lisbon, Portugal, 1083-1086. 2004
D. Sperber & D. Wilson. “Relevance: Communication and cognition (2nd ed.)”. Oxford, UK:Blackwell. 1995.
D. Watson & A. Tellegen. “Toward a Consensual Structure of Mood”. Psychological Bulletin,98, 219-235. 1985
D. Wilson & D. Sperber. “Relevance Theory”. In G.Ward & L. Horn (Eds.), Handbook of Pragmatics (pp. 607–632). Oxford, UK: Blackwell. 2003.
D.R. Heise. “Semantic Differential Profiles for 1,000 Most Frequent English Words”.Psychological Monographs. 70 8:(Whole 601). 1965
E. Briscoe and J. Carroll. “Robust Accurate Statistical Annotation of General Text”. In Proceedings of the 3rd International Conference on Language Resources and Evaluation, Las Palmas, Gran Canaria. 1499-1504. 2002
J. Barnden, S. Glasbey, M. Lee & A. Wallington. “Varieties and Directions of Inter-Domain Influence in Metaphor”. Metaphor and Symbol, 19(1), 1-30. 2004
J. Carletta. “Assessing Agreement on Classification Tasks: The Kappa statistic.”Computational Linguistics, 22 (2), pp.249-254. 1996
J.A. Barnden. “Metaphor, Semantic Preferences and Context-sensitivity”. Invited chapter for a Festschrifft volume. Kluwer. 2006
J.M. Lopez, R. Gil, R., Garcia, I. Cearreta and N. Garay. “Towards an Ontology for Describing Emotions”. In WSKS '08 Proceedings of the 1st world summit on The Knowledge Society:Emerging Technologies and Information Systems for the Knowledge Society. 2008.
L. Zhang, J.A. Barnden, R.J. Hendley & A.M. Wallington. “Developments in Affect Detection in E-drama”. In Proceedings of EACL 2006, 11th Conference of the European Chapter of the Association for Computational Linguistics, 2006, Trento, Italy. pp. 203-206. 2006
L. Zhang, M. Gillies, K. Dhaliwal, A. Gower, D. Robertson & B. Crabtree. “E-drama:Facilitating Online Role-play using an AI Actor and Emotionally Expressive Characters”.International Journal of Artificial Intelligence in Education. Vol 19(1), pp.5-38. 2009
M. Gillies, I.B. Crabtree and D. Ballin. “Individuality and Contextual Variation of Character Behaviour for Interactive Narrative”. In Proceedings of the AISB Workshop on Narrative AI and Games. 2006
M. Mateas. Ph.D. Thesis. “Interactive Drama, Art and Artificial Intelligence”. School of Computer Science, Carnegie Mellon University. 2002
M. Pantic, A. Pentland, A. Nijholt and T. Huang. “Human Computing and Machine Understanding of Human Behavior: A Survey”. In Proc. Int’l Conf. Multimodal Interfaces, pp.239-248. 2006
Nogueiras et al. “Speech emotion recognition using hidden Markov models”. In Proceedings of Eurospeech 2001, Denmark. 2001.
P. Ekman. “An Argument for Basic Emotions”. In Cognition and Emotion, 6, 169-200. 1992
P. Rayson. “Matrix: A statistical method and software tool for linguistic analysis through corpus comparison”. Ph.D. thesis, Lancaster University. 2003
R.S. Aylett, J. Dias and A. Paiva. “An affectively-driven planner for synthetic characters”. In Proceedings of ICAPS. 2006
R.W. Picard. “Affective Computing”. The MIT Press. Cambridge MA. 2000
S. Fussell & M. Moss. “Figurative Language in Descriptions of Emotional States”. In S. R.Fussell and R. J. Kreuz (Eds.), Social and cognitive approaches to interpersonal communication. Lawrence Erlbaum. 1998
X. Zhe & A.C. Boucouvalas. “Text-to-Emotion Engine for Real Time Internet Communication”.In Proceedings of International Symposium on Communication Systems, Networks and DSPs,Staffordshire University, UK, pp 164-168. 2002
Z. Kövecses. “Are There Any Emotion-Specific Metaphors?” In Speaking of Emotions:Conceptualization and Expression. Athanasiadou, A. and Tabakowska, E. (eds.), Berlin and New York: Mouton de Gruyter, 127-151. 1998
Dr. Li Zhang
Teesside University - United Kingdom
l.zhang@tees.ac.uk


CREATE AUTHOR ACCOUNT
 
LAUNCH YOUR SPECIAL ISSUE
View all special issues >>
 
PUBLICATION VIDEOS