Technology to make Scientific Documents Accessible Masakazu SUZUKI, Kyushu University (Professor emeritus) Katsuhito YAMAGUCHI, Nihon University InftyProject ( Science Accessibility Net ( International UNESCO Conference From Exclusion to Empowerment: Role of ICTs for Persons with Disabilities New Delhi, India, November 2014

What are scientific documents? It includes: Texts Math formulas, chemical formulas Tables Diagrams (Flow charts, chemical diagrams, etc) Figures and graphs 2 Target documents

Typical inaccessible documents: Books in print Scan Images PDF : Online journals, Materials by teachers, Papers exchanged between researchers, etc. Includes text information, but not math expressions. Order of texts are often confusing. 3 Target documents

Typical inaccessible documents: Books in print Scan Images PDF : Online journals, Materials by teachers, Papers exchanged between researchers, etc. Includes text information, but not math expressions. Order of texts are often confusing. 4 Target documents Math expressions in PDF Texts extracted: The mean squared error e for a data window is defined by: N i g i e T T N (29)

Typical inaccessible documents: Books in print Scan Images PDF : Online journals, Materials by teachers, Papers exchanged between researchers, etc. Includes text information, but not math expressions. Order of texts are often confusing. 5 Target documents

Simple-layout documents Sample Sample Automatic conversion to accessible format is available with InftyReader : Sample (AudioHTML) Sample (AudioHTML) Sample (Word)Sample (Word) Complex-layout documents Automatic conversion is difficult ! Combination with manual operation is necessary. (Manual selection of areas, etc.) 6 Classification by complexity

Complex-layout sample 7

Simple-layout documents Sample Sample Automatic conversion to accessible format is available with InftyReader : Sample (AudioHTML) Sample (AudioHTML) Sample (Word)Sample (Word) Complex-layout documents Automatic conversion is difficult ! Combination with manual operation is necessary. (Manual selection of areas, etc.) 8 Classification by complexity

For blind university students and specialists: LaTeX source are widely used. 9 Output format (1)

For blind university students and specialists: LaTeX source are widly used. Sample Sample 10 Output format {\bf 1.1 Triangle} Area $A=\displaystyle \frac{1}{2}ah=\frac{1}{2}ac\sin\theta.$ For the equilateral triangle in which $a=b=c,$ $$ A=\frac{a^{2}\sqrt{3}}{4},\ h=\frac{a\sqrt{3}}{2}. $$ The centroid $C$ is located on the median $RM$ (the line drawn from $R$ to the midpoint $M$ of $PQ$) with $MC=\displaystyle \frac{1}{3}RM.$

For partially sighted or dyslexic students, and blind students unfamiliar with LaTeX: DAISY is recommended DAISY=Digital Accessible Information System International standard format of accessible e-content DAISY4 ⊂ EPUB Output format (2) Reading sentence is high-lighted Math high-lighted

For partially sighted or dyslexic students, and blind students unfamiliar with LaTeX: DAISY / accessible EPUB Flow to make DAISY PDF Word document Save as Daisy InftyReader ChattyInfty InftyReader Export

PDF to accessible document without OCR Efficient for recent colorful PDFs Accessibility of Graphical Objects Complicate Table Structure Analysis Diagrams (Flow chart, Chemical diagrams) Conversion of Figures to Tactile Graphics (Detect Characters and convert to Braille) 13 Development in progress

14Conclusion We are working long in this filed, but it remains many problems unsolved and we have still a long way to the Goal. Thank you! InftyProject: sAccessNet: Masakazu SUZUKI: Katsuhito YAMAGUCHI:

InftyReader & InftyEditor 15 Scan InftyReader InftyEditor Image File (TIF, PNG, etc. ） Editable Document (XML ） Output in various formats ・ LaTeX ・ HR-TeX ・ XHTML+MathML ・ MS Word ・ Braille ・ DAISY ・ EPUB3 InftyConverter PDF InftyReader

ChattyInfty & BrailleInfty 16 Braille Viewer/Editor for Math Text InftyEditor Automatic Braille Transcription Save as Braille ChattyInfty Speech output of Text and Math Formula Demo

DAISY Samples of DAISY players ・DAISY＝Digital Accessible Information System ・International standard format of accessible e-content ・DAISY4 ⊂ EPUB3 17

DAISY Custormizable to individuals with special needs ・DAISY＝Digital Accessible Information System ・International standard format of accessible e-content ・DAISY4 ⊂ EPUB DAISY on PC DAISY on mobile devices Reading sentence is high-lighted Samples of DAISY players