1. Accessible Video in a Diverging Web Environment CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 David Klein K. Fritz Thompson

2. Overview Introduction Introduction Web-based video players Web-based video players The technology The technology Creating accessible video Creating accessible video Flash video Flash video Our Flash player Our Flash player Future of Web-based video Future of Web-based video

3. Introduction Law, Health Policy & Disability Center Law, Health Policy & Disability Center Training Training Work Incentive Grantees Work Incentive Grantees Disability Program Navigators Disability Program Navigators Standup training at conferences Standup training at conferences Accessible video of talking heads for further training Accessible video of talking heads for further training

4. Our Needs Provide accessible Web-based training Provide accessible Web-based training High quality video with quality audio High quality video with quality audio Closed captions Closed captions Transcripts Transcripts Supporting documents Supporting documents Different formats (QuickTime, Windows Media Player) Different formats (QuickTime, Windows Media Player) Efficient development and deployment Efficient development and deployment

5. Players QuickTime QuickTime Windows Media Player Windows Media Player Real Player Real Player Others Others Flash Flash Java Java ?

6. Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Capable of High Quality audio/video Free plugin/player (may auto- install/update) Free plugin/player (may auto- install/update) Streaming or progressive download Streaming or progressive download Cross platform availability (with caveats) Cross platform availability (with caveats) Ability to protect content from download Ability to protect content from download Large installed base Large installed base

7. Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can handle captioning All can use component-based captioning All can use component-based captioning Multiple files used Multiple files used text-track captioning also available in QT text-track captioning also available in QT All supported by existing captioning tools All supported by existing captioning tools

8. Players Comparison QuickTime Advantages Pro version available ($30) Pro version available ($30) Ability to "scrub" while viewing Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Ability to have multiple videos playing simultaneously Free multi-platform streaming server software Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Free player bugs you to upgrade to pro Some useful features limited to pro version Some useful features limited to pro version iTunes may be bundled with player (Windows version) iTunes may be bundled with player (Windows version)

9. Players Comparison Windows Media Player Advantages Feature rich Feature rich Pre-installed (on Windows Platform) Pre-installed (on Windows Platform) Easy, automatic upgrades Easy, automatic upgrades Free streaming server software (Windows server only) Free streaming server software (Windows server only) Windows Media Player Disadvantages Windows Media Player Disadvantages No ability to scrub No ability to scrub One movie at a time One movie at a time Inconsistent feature implementation Inconsistent feature implementation

10. Players Comparison Real Player Advantages Feature rich Feature rich Large content providers vested Large content providers vested Real Player Disadvantages May be difficult to find free download May be difficult to find free download Pro version promoted heavily Pro version promoted heavily Not typically pre-installed Not typically pre-installed One movie at a time One movie at a time Streaming server costs Streaming server costs

11. Flash Player Advantages Installed base – 98% Installed base – 98% Arguably easier to upgrade Arguably easier to upgrade Loads quickly Loads quickly New version – MX 2004 New version – MX 2004 Incorporates QuickTime Incorporates QuickTime Simulates a stream Simulates a stream Includes Controls component Includes Controls component Can build in compatibility with other players Can build in compatibility with other players Possible to add features Possible to add features

12. Flash Player Disadvantages Not highly accessible, though getting better Not highly accessible, though getting better Cost (Flash MX 2004) Cost (Flash MX 2004) Initial development time Initial development time Expertise required Expertise required Upgrading plugin Upgrading plugin Manually added accessible text to video controls Manually added accessible text to video controls

13. The Technology Clients and servers Clients and servers Plugins or whatever Plugins or whatever Downloading Downloading Embedding video in Web pages Embedding video in Web pages Captioning Captioning Flash Flash Understanding how the pieces fit together helps for producing accessible video

14. Clients vs. Servers Server Clients

15. Clients vs. Servers Server Server Stores HTML, video, caption text, other files Stores HTML, video, caption text, other files Files can be stored on different servers Files can be stored on different servers Client Client Displays HTML in browser Displays HTML in browser Launches players Launches players Assembles/packages the pieces Assembles/packages the pieces Video Video Caption Caption Video Player Video Player HTML HTML

16. Client View Browser Window Embedded Player Video Captions

17. The Player / Plug-in Embeds the player in the browser Embeds the player in the browser ActiveX ActiveX Internet Explorer Internet Explorer Plug-ins Plug-ins Netscape Netscape Firefox Firefox Opera Opera Need to account for both in the HTML Need to account for both in the HTML User must install if not available User must install if not available

18. Web-based Video Delivery Download Download Streaming Streaming Progressive download Progressive download

19. Download Provide a link Provide a link Entire movie on client hard drive Entire movie on client hard drive Benefits Benefits Minimizes low bandwidth Minimizes low bandwidth Multiple views from same download Multiple views from same download Distribute to others Distribute to others Disadvantages Disadvantages Usability Usability Requires hard drive space Requires hard drive space Captioning not always possible Captioning not always possible Distribute to others Distribute to others

20. Streaming Server controls content Server controls content Active client-server connection Active client-server connection Benefits Benefits Live broadcasts Live broadcasts Low client hard drive space usage Low client hard drive space usage Disadvantages Disadvantages High bandwidth needed High bandwidth needed Troubleshooting Troubleshooting May require local network setup (firewalls) May require local network setup (firewalls)

21. Progressive Download Play video while downloading Play video while downloading Benefits Benefits Maximizes experience – bandwidth vs. wait time Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be saved and redistributed Can be protected from saving by users Can be protected from saving by users Easiest for users Easiest for users Disadvantages Disadvantages Uses hard drive space (but temporarily) Uses hard drive space (but temporarily) Starts and stops Starts and stops Still a problem for captioning when downloaded Still a problem for captioning when downloaded

22. Accessible Video and Web Pages See www.warp.webaim.org See www.warp.webaim.orgwww.warp.webaim.org Standalone players Standalone players Real Real Windows Media Player Windows Media Player Embedded Embedded QuickTime QuickTime Flash Flash

23. Embedded Captioned Video HTML File ServerClient Video File Caption File Combining File

24. Embedded Players Different technologies among browsers Different technologies among browsers versus versus Control user experience Control user experience Player size Player size Automatic startup Automatic startup Surround video with supporting information Surround video with supporting informationsupporting informationsupporting information Difficult to implement when players are not up to date Difficult to implement when players are not up to date Valid HTML? Valid HTML?

25. Captioning – Technologies XML XML Extensible Markup Language Extensible Markup Language SMIL SMIL Synchronized Multimedia Integration Language Synchronized Multimedia Integration Language SAMI SAMI Microsoft® Synchronized Accessible Media Interchange Microsoft® Synchronized Accessible Media Interchange QuickTime caption file QuickTime caption file Apple Apple Flash Flash Macromedia Macromedia

26. Web-based Video Formats QuickTime (.mov) QuickTime (.mov) Windows Media Video (.wmv) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Windows video (.avi) – as intermediary format Flash video (.flv) Flash video (.flv)

27. Caption Files Caption text Caption text Time codes for synchronization with video Time codes for synchronization with video Text Formatting Text Formatting Font and font size Font and font size Carriage returns Carriage returns Bolding, colors, etc. Bolding, colors, etc. Speakers Speakers Language support Language support

28. Captioning – QuickTime Video Video.mov file and others.mov file and others Caption file Caption file Caption file Caption file.txt.txt QuickTime caption file QuickTime caption file SMIL SMIL SMIL.smi or.mov.smi or.mov Integrates video and caption files Integrates video and caption files

29. Captioning – Media Player Video Video.wmv.wmv Caption file Caption file Caption file Caption file.smi (XML / SAMI).smi (XML / SAMI) Integration file Integration file Integration file Integration file.asx.asx Integrates video and caption files Integrates video and caption files

30. Captioning – Flash Flash code Flash code.fla.fla Video Video.flv.flv Caption file Caption file Whatever (.txt,.xml,.smi) Whatever (.txt,.xml,.smi) XML configuration file XML configuration fileconfiguration fileconfiguration file Flash application (Shockwave) Flash application (Shockwave).swf compiled from Flash code.swf compiled from Flash code Integrates video and caption files Integrates video and caption files

31. Creating a Video Shoot (or acquire) video/audio of highest possible quality Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Acquire secondary audio source and/or CART file if possible Capture, edit and compress video Capture, edit and compress video 3 output formats:.mov,.wmv, and.flv 3 output formats:.mov,.wmv, and.flv Make audio tapes for transcription Make audio tapes for transcription

32. Transcribing Audio or Video High quality audio makes better movies and better transcripts High quality audio makes better movies and better transcripts Staff or student workers transcribe using in- house guidelines Staff or student workers transcribe using in- house guidelines Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) Transcript saved in 3 formats Transcript saved in 3 formats MSWord.doc MSWord.doc accessible.pdf accessible.pdf plain.txt for caption file plain.txt for caption file Proof and correct Proof and correct

33. Pre-Captioning Steps Text is broken up into caption-sized chunks Text is broken up into caption-sized chunks Special characters eliminated (smart quotes, em-dashes, etc.) Special characters eliminated (smart quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Caption timing software (MAGpie or HiCaptionMAGpie HiCaptionMAGpie HiCaption Both let you transcribe directly or import prepared text files Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Proof and Correct

34. Final QuickTime Assembly The movie - moviename.mov The movie - moviename.mov The caption file - moviename_captions.txt The caption file - moviename_captions.txt Includes captions and timing info Includes captions and timing info The SMIL file - moviename_smil.mov The SMIL file - moviename_smil.mov Combines movie and captions on the fly Combines movie and captions on the fly Includes URL pointers to movie & caption files Includes URL pointers to movie & caption files.mov extension forces QT playback.mov extension forces QT playback Captions display automatically as part of SMIL standard

35. Final Windows Media Player Assembly The movie - moviename.wmv The movie - moviename.wmv The SAMI file - moviename.smi The SAMI file - moviename.smi Includes captions and timing info Includes captions and timing info The ASX file - moviename.asx The ASX file - moviename.asx Includes URL pointers to movie & caption files Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player View menu

36. Final Flash Player Assembly The Flash playback engine - moviename.swf The Flash playback engine - moviename.swf The movie - moviename.flv The movie - moviename.flv The caption file - moviename_captions.txt The caption file - moviename_captions.txt Includes captions and timing info Includes captions and timing info Same file as QT Same file as QT The caption control file - captions.xml The caption control file - captions.xml Includes URL pointers to movie & caption files Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default)

37. Files on the Server (For each movie) 1. Transcript in Word.doc 2. Transcript in Acrobat.pdf 3. Movie in QT.mov 4. Movie in Windows Media Player.wmv 5. Movie in Flash.flv 6. Caption file.txt 7. SAMI file.smi 8. SMIL file.smi (or.mov) 9. Windows integration file.asx 10. Flash integration file.xml 11. Flash video player engine.swf 12. Resizable Flash page.htm

38. Flash Video Becoming more accessible by version 6 Becoming more accessible by version 6 More integration with video More integration with video Frustrated with player wars Frustrated with player wars Lack of standards compliance Lack of standards compliance Continual, relentless upgrades Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Hijacking of media types / file extensions

39. Flash – Compress Video Create.flv file from movie (.mov,.avi) Create.flv file from movie (.mov,.avi) Method 1 Method 1 Import into Flash library and compress Import into Flash library and compress Sorenson Spark within Flash Sorenson Spark within Flash Export to external file or drag to timeline Export to external file or drag to timeline Method 2 Method 2 Or compress using non-Flash application Or compress using non-Flash application Sorenson Squeeze Sorenson Squeeze

40. Create XML Configuration Open configuration file (XML) Open configuration file (XML)configuration fileconfiguration file Add settings Add settings Video location Video location Caption file location Caption file location Video size and width in pixels Video size and width in pixels Video total time in seconds Video total time in seconds

41. Combine Files Upload Upload Video (.flv) Video (.flv) Caption file Caption file Caption configuration (caption.xml) Caption configuration (caption.xml) Flash file (.swf) Flash file (.swf) Incorporate embedding tags in HTML Incorporate embedding tags in HTMLHTML

42. Flash Security Keep files in same folder Keep files in same folder Use BASE attribute Use BASE attribute </object And And Test thoroughly, especially among browsers and browser versions Test thoroughly, especially among browsers and browser versions

43. Future Our Flash video player development Our Flash video player development Customized controls Customized controls More configuration options in external XML file More configuration options in external XML file Embedded formatting in captions Embedded formatting in captions Speech recognition Speech recognition Real-time voice recognition Real-time voice recognition Automatic time codes (real-time) Automatic time codes (real-time) Searchable / Linkable video Searchable / Linkable video

44. Resources WebAIM WebAIM http://www.webaim.org/techniques/captions/ http://www.webaim.org/techniques/captions/ http://www.webaim.org/techniques/captions/ World Wide Web Consortium Web Video Standards World Wide Web Consortium Web Video Standards http://www.w3.org/AudioVideo/ http://www.w3.org/AudioVideo/ http://www.w3.org/AudioVideo/ Hi Software (HiCaption) Hi Software (HiCaption) http://www.hisoftware.com/hmcc/acc4mcc.html http://www.hisoftware.com/hmcc/acc4mcc.html http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) National Consortium on Accessible Media (MAGpie) http://ncam.wgbh.org/webaccess/magpie/ http://ncam.wgbh.org/webaccess/magpie/ http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program Captioned Media Program http://www.cfv.org http://www.cfv.org http://www.cfv.org National Association of the Deaf National Association of the Deaf http://www.nad.org/ http://www.nad.org/ http://www.nad.org/

45. Contact Law, Health Policy & Disability Center Law, Health Policy & Disability Center http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/ This presentation This presentation http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748 david-klein@uiowa.edu K. Fritz Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748 kenneth-d-thompson@uiowa.edu