This article is available free of charge.
Table of contents
Forewordxiii
Prologue
1. The Structure of Dialogue3 2. Give us the tools: a personal view of multimodal computer-human dialogue25 3. Integrating Multimodal Information: Evidence for Cognitive Integrality63 Part I: Models and Strategies
4. Toward Multimodal Support of Interpreted Telephone Dialogues85 5. Human Factors and Error-Handling in Speech Interfaces109 6. Cross-linked modalities make speech drift in rapid dialogue: Global multimedia dialogue, language shifts, and emotion125 7. Dynamic Interpretation and Dialogue Theory139 8. Dialgoue Acts are Rational Plans167 9. An approach to oral dialogue modelling189 10. A Dynamic Dialogue Model for Human-Machine Communication207 11. Standia: a pragmatically driven man-machine system223 13. Designing Intelligence: A Case of Explicit Models and Layered Protocols249 14. SPRUCE: Speech Synthesis271 Part 2: Architectures and Experiences
15. Multimedia & Multimodal Interaction Structure295 16. Robustness and cooperative multimodal humanmachine communication applications309 17. Iconicity of Sign Languages321 18. A Taxonomy for Users’ Behaviour in Human Computer Interaction335 19. Multimodal Interaction Interface using Voice and Gesture349 20. Implementing an Oral and Geographic Multimodal Application: The Géoral Project367 21. Communicative Acts for Multimedia and Multimodal Dialogue375 22. Graphical Modes of Human Multimodal Dialogue393 23. Graphics and Natural Language in Multi-Modal Dialogues407 24. Referring in a Multimodal Environment: from NL to designation421 25. Multiplexing, Diviplexing, and the Control of Multimodal Dialogue439 26. Multimodal Approach to Concept Formation: and Example in Speech and Sketch Mode457 27. Processing Facial Images to Enhance Speech Communication465 28. The Intrinsic Bimodality of Speech Communication and the Synthesis of Talking Faces485 Index503
