Learnware Network description Project concerns and components Remote Sign Language Interpretation Questions Technical Details (Jeremy) Music teaching and recording Intelligent Classroom Questions Project Overview (John)

Learnware Network Description Educational network on CA*net 3 Production and distribution of educational materials and tools Materials and tools use high-quality digital audio and video

Project Main Concerns Engineering, networking and streaming technology issues Optimization of hardware and software for high quality audio and video Broadcast studio SMPTE 259M uncompressed SDI video (200+ Mbps) Recording studio quality uncompressed multichannel 96kHz, 24 bit audio

Learnware Components Music and Audio Negotiation Simulation Classroom Teaching in Engineering Related project: Remote Sign Language Interpretation

Music and Audio multi-channel surround sound studio sharing composition collaboration master classes shared performances shared recording sessions

Montreal Los Angeles 12 channels, 96kHz, 24 bits/channel Music and Audio Sept. 2000: McGill – USC Shared Recording

Music and Audio Nov. 2001: McGill – HEC Violin Duet

Music and Audio Mar. 2002: Pinchas Zukerman Master Class

Negotiation Simulation teach negotiation skills existing CD-ROM application conversion to Java for web delivery video delivery creates heavy system load

Negotiation Simulation

Classroom Teaching augmented videoconference teaching automatic recording and indexing of lecture for later retrieval instructor tracking automatic far-end camera control

Remote Sign Language Interpretation Related project Physician and deaf patient in hospital Interpreter in another city DV video and audio 3 compressed video streams Software decompression

Sign Language

Technical issues Social factors Intelligent Classroom Overview Questions Part II

Music Video Recorded via Internet2 Palo Alto, CA (Nov. 6)--To demonstrate the broadband capabilities of Internet2, a network technologies development program being led by over 180 universities, musicians and engineers at college campuses throughout the United States recently collaborated on a music video recording session via the network. But…

Where were going same idea, but no cheating -- real interaction –remote instruction, master classes –distributed rehearsal and performance –studio sharing, recording sessions –remote sign-language interpretation –collaborative engineering design all at high-resolution, low-latency

27.6 Mbps Recording Studio that Spans a Continent AES 109th demo, Sept. 23, 2000

The Frères Jacques experiment RISQ 2000: low-latency MPEG-2 videoconferencing

Playing Together experiment MPEG-2 Remote Master Class, Dec. 8, 2000 Pinchas Zukerman, Columbia U, NYC Wu Ji, Canarie ARDNOC, Ottawa

Tolerated Synchronicity compress transmit ms speed of light: Mtl-LA net latency Mtl-LA networks small ensemble large ensemble lip synch musical activity * This figure is a theoretical best-case scenario. Actual performance may vary based on local hardware. The manufacturer makes no warranties, either express or implied, and cannot be held liable for any damages resulting from use of the product. Certain restrictions may apply. Offer void where prohibited by law. Batteries not included. MPEG* acquire

Size *does* matter: The Big Picture high-res* video high-fidelity audio multi-channel surround large (life-size?) picture

Starting to feel more like being there?

Intelligent Classroom Want to benefit from educational technology But dont want the distraction

Objectives Leave behind confusing user interfaces Automatically generate web-capture of lecture Automatically send appropriate view to remote end

What is she doing and how can we help? obtain input from background sensors select most appropriate configuration of equipment in response Computer as assistant

Remote Classroom Teaching

Robust Person Tracking

Detecting Raised Arms

Questions? McGill Advanced Learnware: – Remote Sign Language Interpretation – Network Audio Streaming: – Intelligent Classroom: –