Presentation on theme: "We are focusing our discussion within the luminance dimension. Note, however, that these discussions could also be directed towards the chromatic and/or."— Presentation transcript:
Can we develop a relationship between the screen & retinal image?
1. Principle of Homogeneity (intensity distribution). 1. Principle of Superposition (positional distribution). Need to first discuss two basic principles of linearity:
p is a vector that represents different positional intensities across the one-dimensional monitor image. Row vector: p=(0.0, 0.0, 1.0, 0.0, 0.0) r is the retinal image vector: r=(0.0, 0.05, 0.55, 0.05, 0.0) r=(0.0, 0.05, 0.55, 0.05, 0.0)
r is the retinal image vector: r=(0.07, 0.65, 0.07, 0.0, 0.0) r=(0.07, 0.65, 0.07, 0.0, 0.0) r is the retinal image vector: r=(0.00, 0.00, 0.07, 0.65, 0.07) r=(0.00, 0.00, 0.07, 0.65, 0.07) p is a vector that represents different positional intensities across the one-dimensional monitor image. Row vector: p=(0.0, 1.0, 0.0, 0.0, 0.0) p=(0.0, 0.0, 0.0, 1.0, 0.0) p=(0.0, 1.0, 0.0, 1.0, 0.0) r is the retinal image vector: r=(0.07, 0.65, 0.45, 0.65, 0.07) r=(0.07, 0.65, 0.45, 0.65, 0.07)
Grating sensitivity Grating sensitivity, as measured in psychophysical threshold experiments. The left-hand graph shows the luminance contrast required to detect the presence of a grating, as a function of its spatial frequency and mean luminance. The subject requires least contrast to detect gratings at medium spatial frequencies. The right-hand graph re-plots the data in terms of contrast sensitivity (1/contrast) as a function of spatial frequency. Data are taken from Campbell and Robson (1968).
To determine the modulation transfer function MTF of an optical system, you need to compare the magnitude of image contrast with that of the object contrast. This defines the spatial filtering properties of the system (amplitude energy loss through the system).
Fourier’s Theorem states that any wave form or distribution can be generated by summing the appropriate sine waves, and as a corollary, any complex distribution can be completely described by specifying some particular set of sine waves that which, when added together, will reproduce the given distribution.
The procedure for finding the particular set of sine waves that must be added in order to obtain some given complex waveform is called Fourier analysis. The sine wave components are the Fourier components of a complex wave. Each Fourier component has its own contributing amplitude (or energy state).
Now, back to the original question: What is amplitude energy loss? The spatial energy of an image is defined by its component sine waves and the component amplitudes. Specific energy can be characterized by the spatial spectrum (Energy as a function of Spatial Frequency)..
Spatial Spectrum: Amplitude as a function of spatial frequency.
Spatial scale and spatial frequency 1 [ Summation of 1-D spatial frequency components to create complex spatial waveforms. As a series of components are added progressively to the waveform, the resultant image approximates a square wave more closely.
Do a Fourier analysis to get spatial spectrum. Amplitude of modulation of object Modulation of image relative to object Amplitude of modulation of image Spatial Frequency cycles/inch MTF Filtered result:
F F -1 Parts of the spectrum are continuous because all the spatial frequencies are included in the object.
Note: Spatial spectra DO NOT represent position. They only represent the periodic energy content of the complex image across one dimension. E E f f f
Again, these analyses are based on 1-dimensional evaluations. Can have Fourier across multiple dimensions to best represent the components of an image. Also, the multiple dimensional Fourier is not always intuitive (e.g., checkerboard pattern): Energy of the spectrum conforms to 45° distribution with fundamental at the shorter √ 2 distance from edge-to-edge. fundamental
Human MTF is also the CSF. Includes optical degradation of the eye & neural spatial errors. Position (minutes of arc) Spectrum of Mach Band intensity distribution input Spatial Frequency Spatial Frequency cycles/degree Position (minutes of arc) intensity F -1 F
The Human MTF (i.e., the CSF) reinforces our perception of edges! This is what, in fact, the brain accomplishes.
F -1 F Theoretically, based on MTF analysis, there should be no difference in perceived image.
Problem: visual system also operates on the principles of image position as well as amplitude energy -- the latter of which is position irrelevant.
In fact, we already know there are spatially linear RFs that make up our visual substrate. So position is relevant. Our cells are not mere Fourier analyzers! Having said this, however, our concept of scale certainly has bearing on spatial frequency.
Images contain detail at many spatial scales. Fine-scale detail tells us about surface properties and texture. Coarse-scale detail tells us about general shape and structure.
Spatial scale 1 [ Left: A photograph of a face. Middle: A low-pass filtered version of the face, retaining only course-scale or low spatial-frequency information. Right: A high-pass filtered version of the face, retaining only fine-scale or high spatial frequency information.
Finally, multiple parallel processing streams in our spatial system. Each stream is made up of different frequency-tuned cells (i.e., the size of RF). Evidence for this comes from adaptation and masking studies..
Explaining the spatial contrast sensitivity function [ The shape of the spatial contrast sensitivity function reflects the properties of the receptive fields that mediate our perception of spatial detail. Neurons with small receptive fields respond to high spatial frequencies. Neurons with large receptive fields respond to low spatial frequencies. The shape of the contrast sensitivity function indicates that there are fewer, less responsive receptive fields at extreme sizes.
Spatial filters in the visual system C Contrast sensitivity functions of cells in the visual system. Top: Parvo (open symbols) and magno (filled symbols) LGN cells, re- plotted from Derrington and Lennie (1984, Figures 3A and 10A; curves are based on best-fitting difference-of-Gaussian functions). Bottom: Striate cortical cells (re- plotted from De Valois, Albrecht, & Thorell, 1982). Cortical cells have much narrower spatial frequency tuning than LGN cells. LGN: Two Broadband operators (PC and MC) V1 simple cells: More selective, narrowband operators..suggests intracortical operations involving flanking antagonistic responses (i.e., more than simply a linear aggregate of LGN cells).
NOTE: Behavioral evidence from adaptation and masking studies (superimposing gratings of slightly different spatial frequencies and measuring resultant changes in sensitivity) correlates well with cortical cell measurements!
Spatiotemporal contrast sensitivity We can examine spatial and temporal sensitivity together by measuring the visibility of flickering gratings. Spatial and temporal parameters interact, so there is a trade-off between spatial acuity and temporal acuity. At low temporal frequencies, sensitivity is highest at medium spatial frequencies; at high temporal frequencies, sensitivity is highest at low spatial frequencies. Spatiotemporal contrast sensitivity probably reflects the contribution of two parallel pathways or channels of processing. At low temporal frequencies contrast sensitivity reflects activity of cells in the parvo division; at high temporal frequencies contrast sensitivity reflects activity of cells in the magno division.
[ Top: Space–time plot of a spatial grating that repetitively reverses in contrast over time. The grating’s spatial frequency is defined by the rate of contrast alternation across space (horizontal slices through the panel). The grating’s flicker temporal frequency is defined by the rate of contrast alternation across time (vertical slices through the panel). B Bottom: Contrast sensitivity for flickering gratings as a function of their spatial frequency (horizontal axis) and temporal frequency (different curves), re-drawn from Robson (1966). Spatial sensitivity is band-pass at low temporal frequencies (filled squares), but low-pass at high temporal frequencies (filled circles). Spatiotemporal contrast sensitivity
Functional significance of multiple spatial filters The visual system uses spatial filters in several important tasks: Edge localization Texture analysis Stereo and motion analysis
Edge localization 1: Vernier acuity [ We can assign locations to (localise) luminance edges with very high precision. Vernier acuity is typically 1/6 th of the distance between adjacent photoreceptors.
Edge localization 2: Explaining Vernier acuity [ The retinal image of an edge is spread optically over a distance covered by 5 or 6 receptors (top graph). A very small (fine-scale) change in edge position causes the response of each receptor to change by up to 25% (middle and bottom graphs). A small center–surround receptive field computing the difference between adjacent receptor responses would detect the shift in position. Large receptive fields detect larger shifts in position. A number of computational theories have been proposed for how information about edge position is extracted from receptive field responses. (i.e., fovea)
David Marr (1980) Spatial scale & position (Edge Detection) The Raw Primal Sketch derived from a computational approach to images. dy/dx -- slope of function y [or f(x)]; d 2 y/dx 2 -- zero crossings of f(x).