Script Recognition – 03 Human reading process prof. dr. L. Schomaker KI RuG.

Slides:

Advertisements

Similar presentations

Abbas Cheddad, Joan Condell, Kevin Curran and Paul Mc Kevitt Intelligent Systems Research Centre Faculty of Computing and Engineering University of Ulster.

Advertisements

No matter your pedagogical choice, the act of educating is not something you do to students; its something you do with students. Dr. Ed Nuhfer Director,

Introduction to Eye Tracking

1 VLDB 2006, Seoul Mapping a Moving Landscape by Mining Mountains of Logs Automated Generation of a Dependency Model for HUG’s Clinical System Mirko Steinle,

Perception Chapter 9: Event Perception Event Perception: an event is defined as a change in both time and space. Thus far we have discussed how our visual.

Chapter 6: Visual Attention. Overview of Questions Why do we pay attention to some parts of a scene but not to others? Do we have to pay attention to.

2002/02/05PSYC , Term 2, Copyright Jason Harrison, Visual pathways from here to there to everywhere.

Electrical & Computer Engineering Dept. University of Patras, Patras, Greece Evangelos Skodras Nikolaos Fakotakis.

Range Imaging and Pose Estimation of Non-Cooperative Targets using Structured Light Dr Frank Pipitone, Head, Sensor Based Systems Group Navy Center for.

Transient Cortical Excitation at the onset of visual fixation Visual recognition is brain state dependent.

How General Is The Concept Of A Receptive Field? Gregg Rosenberg April 7, 2004 Towards A Science of Consciousness.

Control of Attention and Gaze in the Natural World.

Feature Vector Selection and Use With Hidden Markov Models to Identify Frequency-Modulated Bioacoustic Signals Amidst Noise T. Scott Brandes IEEE Transactions.

PS: Introduction to Psycholinguistics Winter Term 2005/06 Instructor: Daniel Wiechmann Office hours: Mon 2-3 pm Phone:

Current Trends in Image Quality Perception Mason Macklem Simon Fraser University

Robotics Simulator Intelligent Systems Lab. What is it ? Software framework - Simulating Robotics Algorithms.

Script Recognition – 02 Human handwriting process prof. dr. L. Schomaker KI RuG.

Treisman Visual Search Demo. Visual Search Tasks  Can detect features without applying attention  But detecting stimulus conjunctions requires attention.

Script Recognition – 01 History of scripts prof. dr. L. Schomaker KI RuG.

Prof. dr. Lambert Schomaker Bayes and continuous PDFs Kunstmatige Intelligentie / RuG.

Status of conjunctive neurons Read from p. 88. Are higher-order conjunctive neurons amodal symbols? What determines what they activate and how the results.

Chapter 11 The Stages of Learning.

Non-invasive Techniques for Human Fatigue Monitoring Qiang Ji Dept. of Electrical, Computer, and Systems Engineering Rensselaer Polytechnic Institute

Beyond the Striate Cortex. Extrastriate Pathways  Parallel processing of visual information from the striate cortex.  Three pathways: Color processing.

Visual Learning Instructor: Arnold Glass. Visual Processing Millions of computations are performed on the light patterns that fall on the retina before.

PRINCIPLES OF DESIGN PHOTOGRAPHY. BALANCE Visual center is above geometric center. Visual weight is determined by many variables Size Darkness – A strong.

Geoff Lacy. Outline  Definition  Technology  Types of biometrics Fingerprints Iris Retina Face Other ○ Voice, handwriting, DNA  As an SA.

ART PRINCIPLES OF DESIGN.

Studying Visual Attention with the Visual Search Paradigm Marc Pomplun Department of Computer Science University of Massachusetts at Boston

A Framework for Automated Web Application Security Evaluation

Dr. Neil H. Schwartz.  Visualization refer to the 2D and 3D static and animated visual displays that depict conditions, situations, processes, places.

Attention as a Limited Capacity Resource

Text Lecture 2 Schwartz.  The problem for the designer is to ensure all visual queries can be effectively and rapidly served.  Semantically meaningful.

A Photon Accurate Model Of The Human Eye Michael F. Deering.

Digital Image Fundamentals. What Makes a good image? Cameras (resolution, focus, aperture), Distance from object (field of view), Illumination (intensity.

Assessment of Computational Visual Attention Models on Medical Images Varun Jampani 1, Ujjwal 1, Jayanthi Sivaswamy 1 and Vivek Vaidya 2 1 CVIT, IIIT Hyderabad,

Change detection and occlusion modes in road-traffic scenarios Professor: Liu Student: Ruby.

Demonstration and Verbal Instructions

Photography Composition. What is Composition? The arrangement of visual elements within the frame of a photograph.

MURI: Integrated Fusion, Performance Prediction, and Sensor Management for Automatic Target Exploitation 1 Dynamic Sensor Resource Management for ATE MURI.

Interkulturelles Zentrum INTERCULTURAL DIALOG as a political process FRANJO STEINER.

Networked Audio Visual Systems and Home Platforms ADMIRE-P at Med-e-Tel 2005 April 6-8, Application of Video Technologies and Pattern Recognition.

KAMI KITT ASSISTIVE TECHNOLOGY Chapter 7 Human/ Assistive Technology Interface.

Visually guided attention during flying OR Pilots “do not like” fovea because they cannot pay attention to more than 1% of space at any one time.

The geometry of the system consisting of the hyperbolic mirror and the CCD camera is shown to the right. The points on the mirror surface can be expressed.

Counting How Many Words You Read

Computer Science Readings: Reinforcement Learning Presentation by: Arif OZGELEN.

Georgia Tech GVU Center Mobile Visualization in a Dynamic, Augmented Battlespace Mobile Visualization in a Dynamic, Augmented Battlespace William Ribarsky.

U SER I NTERFACE L ABORATORY Situation Awareness a state of knowledge, from the processes used to achieve that state (situation assessment) not encompass.

Depth Perception Kimberley A. Clow

Spatio-temporal saliency model to predict eye movements in video free viewing Gipsa-lab, Grenoble Département Images et Signal CNRS, UMR 5216 S. Marat,

Give examples of the way that virtual reality can be used in Psychology.

What are the advantages of using bar code scanner?  Fast  It is fast  It is fast for reading data  It is fast for data input  Accurate  The advantage.

Image Perception ‘Let there be light! ‘. “Let there be light”

Visual Perception CS4390/5390 Fall 2014 Shirley Moore, Instructor September 8,

Eye Movements – Target Selection & Control READING Schall JD (2002) The neural selection and control of saccades by frontal eye field. Philosophical Transactions.

Optimal Eye Movement Strategies In Visual Search.

7 - 1 © 2000 Pearson Education Canada Inc., Toronto, Ontario Perception 1.Brain Mechanisms of Visual Perception 2.Perception of Form 3.Perception of Space.

The Principles of Design: Movement Module 3: Designing for Communication LESSON 7.

Scientific Data Analysis via Statistical Learning Raquel Romano romano at hpcrd dot lbl dot gov November 2006.

By Kyle Bickel. Road Map Biometric Authentication Biometric Factors User Authentication Factors Biometric Techniques Conclusion.

ECE 8443 – Pattern Recognition ECE 8527 – Introduction to Machine Learning and Pattern Recognition Objectives: Bayes Rule Mutual Information Conditional.

Image Perception ‘Let there be light! ‘. “Let there be light”

Neurological Observations

Visual Attention (neural mechanisms) Arash Afraz.

Blink Is Not A Random Event In Reading Yu-Chi Tai, James Sheedy, & John Hayes Pacific University, College of Optometry.

Human Computer Interaction Lecture 2 The Human

Assist. Prof. Dr. Ilmiye Seçer Fall

Department of Computer Science and Engineering

Kazumichi Matsumiya, Satoshi Shioiri Current Biology

Presentation transcript:

Script Recognition – 03 Human reading process prof. dr. L. Schomaker KI RuG

KI RuG © Schomaker Human Reading Eyes are no flat-bed scanners!

KI RuG © Schomaker Human Reading Eyes are not flat-bed scanners! –Fast movements: saccades –Alternated with fixations: the high-resolution center of the retina is positioned to capture a limited area of the complete visual array

KI RuG © Schomaker Human Reading Eyes are not statically positioned cameras –Looking and reading involve an active process of selective attention, opportunistically jumping to the next area of visual interest –The illusion of a global and consistent view of the world is generated by the integrative processes in the visual cortex (not in the eyes):

KI RuG © Schomaker Human reading research (HRR) HRR is mostly guided by epistemologic dynamics intrinsic to the used experimental paradigms, less by fundamental questions concerning geometry and features of scripts influencing reading performance Findings are of little use to developers of reading systems Modeling efforts are limited, where models do exist, they concern toy problems (small dictionaries, oversimplified character shapes)

KI RuG © Schomaker Global word shape General framework: Merton’s “Logogen”: there exists a lexicon of words. Words get a score of likelihood on the basis of detected features. This example: word contour pattern.

KI RuG © Schomaker Tests with ascender/descender coding a = x h = lx o = x v = x b = lx I = x p = jx w = x c = x j = j q = xj x = x d = xl k = lx r = x y = xj e = x l = l s = x z = x f = l m = x t = l g = xj n = x u = x

KI RuG © Schomaker Code-length frequencies in 48k lexicon

KI RuG © Schomaker Code ‘collisions’ : amount of different words per code  Worst case: 1345 words for code ‘x’  2^16  2^10 alternatives

KI RuG © Schomaker However: humans do not seem to use word contour extensively, in the reading of machine-print words “case-mixing” experiments

KI RuG © Schomaker Experiment on reading handwriting

KI RuG © Schomaker Reaction times, common words

KI RuG © Schomaker Error rates, common words

KI RuG © Schomaker Reaction time, rare words

KI RuG © Schomaker Error rates, rare words