OBJECT RECOGNITION

The next step in Robot Vision is the Object Recognition. This problem is accomplished using the extracted feature information. The object recognition algorithm is to be powerful and fast so that the required object is uniquely recognized.

Image Features Image feature refers either to – a global property of an image or a part of it – for example: average grey level, area in pixels –recognition properties important or – part of image with some special properties –for example: line, circle, textured region – location important

Good Features ● Meaningful – associated to interesting scene elements typically sharp intensity variations (contours of objects), or –regions of uniform intensity (planar surfaces) ● Detectable – we must be able to locate the features algorithmically – different algorithms for different features ● We can not get perfect features

Feature types Geometrical entities – points for example: edge points, corner points, interest points regions lines circles, ellipses contours

Edge Detection – Problem

Edges Edge points are pixels where image values undergo a sharp variation

Corner Detection Corners are well defined in location – useful features to track in image sequences – should be understood as corner structures in image intensity, not corners of objects ● Image gradient tells us about changes – How to calculate the gradient? – How does gradient behave near corners?

There are mainly two methods for object recognition (a)Template matching technique A template is provided to computer and the computer is trained to match the object with the template irrespective of object orientation.

(b)Structural technique Several structural techniques are available. These may take the features also in to account. We discuss a common method known as CHAIN CODE. Here there are two approaches (a) 4-Directional Chain Code (b) 8 Directional Chain code We shall describe (a) first; (b) is an extension of (a). Each object is coded in terms of this 4-directional chain code

START Start with the start point and go along the arrows Comparing the contour of object with respect to 4-directional chain code converter, we get Chain code of Object: directional converter 8-directional converter OBJECT

CHAIN CODE : We then get the difference; Difference between 0 and 3 is 3 (ref 4 direc. converter) Difference between 3 and 0 is 1 Difference between 0 and 3 is 3 and so on Difference between 1 and 1 is 0 Difference between 1 and 0 is 3. Difference Code is : Take the minimum (decimal)value of Difference code as SHAPE NUMBER: This SHAPE number is for the object, uniquely recognized, independent of rotation (by 90 0 )

Another Object Verify: Chain Code: Difference code: Shape Number:

If the object edges are of slopes 45 0, 135 0, and , then we can use the 8-Directional converter. The procedure of getting the shape number is the same. This method of object recognition is fast and can be used for different shapes of objects to be recognized if they are coming in a random sequence.

Advantage of Chain Coding Reduce storage space as number and value of pixels are not required. It can be use to compute the values of some features of objects such as area, perimeter, width etc

FEATURE EXTRACTION: In robot vision, it is often necessary to distinguish one object from another. This is accomplished by mean of features that uniquely characterize the object. Some features of objects that can be used in Robot Vision are: (a) Area (b) Minimum Enclosing rectangle (c) Diameter (d) center of gravity (e)Perimeter (f) eccentricity (g) Aspect Ratio (h) Number of holes (i) Moments We shall illustrate the features through an example:

Image Area Center of Gravity (COG) Or centroid for x c and y c. The area and COG is used to identify the position of the object

Moments- A sequence of numbers characterzing the shape of an object The sum of power (j+k) is the order of the moment

If the COG is known we can determine the central of moment Because object is balanced at COG, the first order moment is zero

The second order moment give the moment inertia of the image

Orientation-the angle of inclination

Eccentricity- maximum chord length is along the principal axis or major axis of object and minimum chord length is perpendicular to major axis

Roundness, Aspect Ratio=Length of Rectangle enclosing object » Width of rectangle enclosing Object

EXAMPLE: Let an original image of an object undergone several image processing techniques and finally available to us as a pixel pattern shown below:

Some of features can be computed as: (a)Moment ( M 00 ) = = 24 (b)Eccentricity = (Max x-length) / (Max y-length) = 9/4 (c)Perimeter = 26 (d)Area = 24 (e)Diameter = 9 (f)Thinness = {Diameter / area } = ( 9 / 24 ) = (g) compactness = { (perimeter) 2 / area } = ( 26 2 /24 ) = (a)No: of holes = 0 Objects having these features belong to one category

Example

Matching Recognition techniques based on matching represent each class by a proto- type pattern vector. An unknown pattern is assigned to the class to which it is closest in terms of a predetermine metric. The common approach is by minimum distance classifier

Some of the edge identified products

Minimum distance classifier In image processing system, an object is described by a pattern vector Pattern recognition is to develop or use some techniques or algorithms to recognize objects in images. Minimum distance classifier is commonly used and based decision functions.

Decision Function The function is to determine decision boundary to separate different pattern classes.

Example:

Solution:

Optimum Statistical Classifier Probability consideration become important in pattern recognition under random pattern classes

For the above equation to hold we must know the probability function. Thus, the Gaussian probability density function is considered

Bayes Classifier for Gausssian pattern classes