Presentation on theme: "Handwritten Mathematical Symbol Recognition for Computer Algebra Applications Xiaofang Xie, Stephen M. Watt Dept. of Computer Science, University of Western."— Presentation transcript:
Handwritten Mathematical Symbol Recognition for Computer Algebra Applications Xiaofang Xie, Stephen M. Watt Dept. of Computer Science, University of Western Ontario ECCAD 2005 Motivation Provide computer algebra applications a nice pen-based interface Attract more users to Maple, Mathematica. Handwriting recognition is the key to PDA Make mathematics easier input and edited
Math Editor Limitations: cannot cover all math symbols Slow comparing with hand writing
Literature Overview Pattern Matching: feature matching, element matching, elastic matching Neural Network Hidden Markov Model On-line vs. Off-line recognition
Recognizer Architecture Data Collection Preprocessing Feature Extraction Hidden M. Model Grouping Vector Quantization Elastic Matching Combined Classifier Context Info
Preprocessing Resampling Deslanting Smoothing Size Normalization Selectively Chop Head / Tail
Feature Extraction Number of Strokes; Pendown; Pen Pressure Position of end points; Distance to initial. Writing Angle; SgnX; End points directions Point Density; Aspect Ratio Number of Cusps Number of Intersections Number of Loops Velocity; Acceleration
Feature Extraction (Cont.)
Design Hidden Markov Model Decompose symbols into basic elements
Design Hidden Markov Model(Cont.) Multiple Path Hidden Markov Model
Allomorph Analysis Variance makes recognition hard Contribute to design Hmm
Combine Classifiers Classifiers complement each other Analyze the recognition results Detect Correlated Errors Develop Combination Scheme
Context Information Solve Ambiguity Build Dictionary
Partial Results ExperimentNo.of PrototypesRecog. Rate(%) P1:T1,2,3,422781.8 P1,2:T1,2,3,445490.1 P1,2,3:T1,2,3,468193.9 P1,2,3,4:T1,2,3,490894.8 Recog. Results on 227 mathematical symbols. P represents prototype, T represents test data.
Partial Results(Cont.) ExperimentNo.of Prototypes Candidate Prototypes Percentage Pruned(%) Recog. Rate(%) P1:T1-42272688.576.0 P1,2:T1-43663889.685.5 P1-3:T1-44955289.590.0 P1-4:T1-45756089.691.9 Using features to prune prototypes.