1. MACHINE-MEDIATED COMMUNICATION 3D environments, (sensors, projectors: sight, sound, touch, other sensory modes) information capture, display personal agents multimodal fusion storage media conversion, multilingual translation information representation computation management architectures, protocols agents dB’s libraries storage Web pages grid-based computation Other Sites Human Interface Global Network Communication Mediator security

2. Multimodal Human-Machine Interface

3. Force Feedback Glove Gaze Tracker Microphone Array Multimodal Human-Machine Interface Real-world trial with NJ National Guard

4. Portable Interactive Command Console (PICC) Steerable microphone array element Stereo face tracking cameras Gaze tracker Source locator microphone Loudspeakers Light pen Flatpanel display Sensors HQ/VEHICLE Robotic Vehicles Emergency Responder in the Field Internet

5. User interface for interaction and collaboration with robots and humans NSF Equipment Grant EIA#98-18313 Center for Advanced Information Processing, Rutgers University, Piscataway, NJ 08854. PI: J.L. Flanagan, co-PIs: J. Wilder, I. Marsic, M. Krane

6. “Move this to there.”