Hala Bezine IGS 2011 Cancun-Mexico 1 Presented by :M me Hala Bezine Republic of Tunisia Ministery of Higher Education and Scientific Research University of Sfax National Engineering School of Sfax Tunisia Re search G roup on I ntelligent M achines Towards an Ink-Enabled handwriting editor THE 15 th INTERNATIONAL GRAPHONOMICS SOCIETY CONFERENCE (IGS2011) (IGS2011) Live Aqua Cancun, MEXICO

2 Hala Bezine IGS 2011 Cancun-Mexico 2 Outline 1- Introduction 2- Technical specifications of the On-line database “Mayastroun” 4- Conclusions 3- Architecture of the developed handwriting editor interface

3 Hala Bezine IGS 2011 Cancun-Mexico 3 1- Introduction The human being wants to communicate with the computer in the simplest, fastest way in order to facilitate and accelerate the interaction and the exchange of information He seeks to make these machines, able to read, see, move, treat and quickly analyze the information received InkML provides cross-platforrm environement to support handwriting Ink-enabled handwriting editor InkML offers a common format for the excahnging data between component (handwriting, gesture recognition, signature verification…

4 Hala Bezine IGS 2011 Cancun-Mexico 4 2-Technical specifications of the On-line database “Mayastroun” The input of the handwriting editor are handwritten scripts drawn on digitizing tablet and stored in “Mayastroun” “Mayastroun” This dual handwriting database contains a variability of data : Arabic or Latin characters, digits, texts, signatures, mathematical expressions, etc.... All samples are stored in XML (eXtensible Markup Language) files Each sample has two complementary Files :.out extension for the on-line handwritten database.bmp extension for the off-line handwritten database. A graphic user interface (GUI) was developed in.Net language

5 Hala Bezine IGS 2011 Cancun-Mexico 5 MAYASTROUN database XML file Digital tablet Scripter identification 2-Technical specifications of the On-line database “Mayastroun” General Schema of the “ Maystroroun ” database

6 Hala Bezine IGS 2011 Cancun-Mexico 6 2-Technical specifications of the On-line database “Mayastroun” Each writer: has an identifier number ID which will be used when acceding to the database has a repertory is attributed to store all written samples fills an electronic coordinate's form to collect personal information such as first and last name, date of birth, country, sex and other informations “Mayastroun” contains: 5000 isolated digits >13036 isolated lower and upper case letters isolated words from a 500 word lexicon (English, French and Arabic)

7 Hala Bezine IGS 2011 Cancun-Mexico 7 2-Technical specifications of the On-line database “Mayastroun” Example of XML file from the database “Mayastroun”

8 Hala Bezine IGS 2011 Cancun-Mexico 8 3- Architecture of the developed handwriting editor interface Based on the XML, XSLT is the language used for the conversion of files that have the same or other extensions The original document is not changed, but a new document is created based on the content of the existing one The new document will be arranged by the processor in standard XML syntax or in another format, such as HTML or text (Microsoft Word, Latex,...)

9 Hala Bezine IGS 2011 Cancun-Mexico 9 3- Architecture of the developed handwriting editor interface The Interface designed for conversion of the samples from the database Mayastroun with.net language

10 Hala Bezine IGS 2011 Cancun-Mexico Architecture of the developed handwriting editor interface Handwriting recognition: the process by which software analyzes ink words to convert them to typed text This recognition stage is based on natural handwriting that is digitized by the system, then modified into digital writing which is in turn analysed by a recognition engine This conversion is applied via the menu "conversion" of the handwriting interface

11 Hala Bezine IGS 2011 Cancun-Mexico Architecture of the developed handwriting editor interface The Handwriting editor interface

12 Hala Bezine IGS 2011 Cancun-Mexico Architecture of the developed handwriting editor interface This editor is well suited for a broad range of applications and platforms It is not restricted to handwriting samples from “Mayastroun” database, but we can exploit others databases such us Unipen,etc... In practice and especially for pen-based mathematical interfaces, some improvements must be taken into account in order to recognize mathematical symbols and each component embedded in significant mathematical expression Good recognition rate are obtained for major editable texts

13 Hala Bezine IGS 2011 Cancun-Mexico Architecture of the developed handwriting editor interface An example of handwritten text edited by Microsoft Word Good recognition rate of 98,27 (228 among 232 characters after recognition)

14 Hala Bezine IGS 2011 Cancun-Mexico 14 A system for the real-time recognition of handwriting script 4- Conclusions “ An ink Enabled Handwriting Editor ” Recognition of every type of handwritten text expressed in Latin “ Satisfied recognition rates” Enhancement of the recognition performance of on- line Arabic script

15 Hala Bezine IGS 2011 Cancun-Mexico 15 Contacts : {hala.bezine, sourour.njah, adel.alimi REGIM: REsearch Group on Intelligent Machines, University of Sfax, National Engineering School of Sfax (ENIS), Tunisia