Multimodal Interfaces using Parallel Distributed Agents
Competition and cooperation among agents at many levels
- Pen input: gesture recognizer vs. handwriting recognizer
- Natural language: multiple NL systems (multilingual, diff. capabilities)
- Reference Resolution
-
Multiple modalities for resolving ambiguities
- e.g. arrow + “scroll map” vs. arrow + “photo of this hotel”