Presentation on theme: "1 A Haptic Multimedia Handwriting Learning System Mohamad A. Eid, Mohamed Mansour, Abdulmotaleb H. El Saddik, Rosa Iglesias Emme '07: Proceedings of the."— Presentation transcript:
1 A Haptic Multimedia Handwriting Learning System Mohamad A. Eid, Mohamed Mansour, Abdulmotaleb H. El Saddik, Rosa Iglesias Emme '07: Proceedings of the international workshop on Educational multimedia and multimedia education Speaker: Jacob.
2 Outline Introduction Haptic Learning System Algorithms Conclusion
3 Introduction Certain learning need physically interact. Handwriting, medical procedures, painting, sports, etc. Handwriting is a complex daily life task that needs attention, memory and cognition, motor skills. Haptics refers to the emerging that studies the sense of touch and human interaction via the sense touch. The authors are using haptic-audio-visual playback for learning handwriting.
4 Haptic Learning System
5 The Language Repository It contains study material, symbol images, pronunciation files and the haptic stimuli (position trajectory to draw character). Contents are made visible to the outside world using an XML-based description.
6 The audio-visual player Character symbol. Pronunciation. The students can review the character shape and sound as many times as they want.
7 The Haptic Player Three modes of operation Recording mode: retrieving, filtering, and storing the data sent from database. Full guidance playback mode: can be used with beginners to lead them through the writing of the alphabets. Partial guidance playback mode: check user’s movement and applies partial forces to correct the path.
10 Haptic Virtual Whiteboard The reaction force from the virtual whiteboard plane can be computed as: X=position coordinates of the haptic device. Xp=plane position along the same direction. g and K=stiffness and elasticity of the virtual paper.
11 Partial Guidance Playback The offset between the user’s startup position and the desired startup position eliminates translational errors. While user is drawing, the result is computed along the paper plane using MSE (Mean Square Error). Total accumulated error is calculated and compared to a threshold that reflects the level of guidance.
12 Partial Guidance Playback (X ip, Y ip )=current position (X id, Y id )=Desired position coordinate. n=number of points from the startup point up until the current point.
13 Move-to-Departure Algorithm This algorithm makes the device more smoothly from its current position to the startup position of the stimulus.
14 Conclusions Its very useful for Chinese, Thai, Japanese, Arab, Korea and the other countries which have their own character. We have to write often to remember a new character. So keep writing.