1. iLayout: Performance Evaluation

2. Dataset
Sample Images

3. Architecture Output Text Traditional OCR OCR using i-Layout
Document image
OCR
Output Text
Traditional OCR
Document Image
Page Segmentation by i-Layout
OCR
Combining output from blocks
Output Text
OCR using i-Layout

4. Evaluation Metrics Evaluation Metrics Intersection/Union based
Error wise
Reading Order Based Penalty
Goal oriented (OCR accuracy)
Goal:
Systematic and detailed analysis of layout performance at every stage
Error wise quantitative and qualitative analysis

5. Intersection/Union based measure

6. Error based evaluation
Can we quantify each errors individually?

7. Error based evaluation

8. Error based evaluation

9. Evaluation Measure Score Over-segmentation score 0.0984
Under-segmentation score
0.2923
False Alarm Score
0.5640
Missing Score
0.0045
Error based performance evaluation for i-Layout on 100 pages (Telugu book)

10. Such splits do no affect OCR accuracy, thus should be less penalized
Less Penalty
Such splits do no affect OCR accuracy, thus should be less penalized

11. Goal oriented evaluation
Language
#Pages
OCR Accuracy before iLayout
OCR Accuracy after iLayout
Char
Word
Telugu 50
45.98
4.84
70.14
46.97
Comparison of OCR accuracy before & after page-segmentation using i-Layout

12. OCR Accuracy after iLayout
Evaluation on failed pages
Evaluated on 130 images, previously reported as failures by CDAC-Noida.
Language
#Pages
OCR Accuracy after iLayout
Char
Word
Telugu
100
61.66
14.51
Hindi 30
68.87
46.07

13. Visual Results
Consortium OCR i-Layout

14. Visual Results
Consortium OCR i-Layout