Seeing Color

Visual Spectrum

Light varies in intensity and wavelength

The Spectral Power Distribution (SPD) of an object is the amount of light of each wavelength that an object reflects

“Rainbow” Spectrum Newton was the first to show this by passing sunlight through a prism. Light passed through a prism is broken down into a "rainbow" spectrum. Why is that?

Because lights of different wavelengths have different refractive properties. Long-wavelength (red) light is bent least by passing through a prism, while short-wavelength (blue) light is bent most.

There is an important difference between lights and pigments… Lights

Pigments

Are wavelengths colored? Newton wrote "The Rays to speak properly are not coloured. In them there is nothing else than a certain Power and Disposition to stir up a Sensation of this or that Colour... " What this means is that the colors we see associated with different wavelengths are not contained in the light itself Rather, they are created by our perceptual system in response to these wavelengths

Achromatic Color: Black, white, and the shades of gray in between are achromatic colors. Achromatic colors have approximately equal power across all the wavelengths in the visible range (check out the SPDs of white and black paper below). In dim light, we only see achromatic colors.

Chromatic Colors Blue, red, green, and yellow are all examples of chromatic colors These are the colors we see in good light using our cones For ease of reference, we’ll call blue, red, yellow, etc., "colors" and black, white and gray "achromatic colors”

How many colors are there? People can distinguish about 2 million different colors (200 colors in the visible spectrum X 500 steps in brightness X 20 steps in saturation) Brightness is our perception of the intensity of light And intensity, remember, is the amplitude of a sinusoidal wave Saturation is inversely related to the amount of whiteness in a color (the more saturated a color, the less whiteness it contains; for example, red is more saturated than pink)

The Crayola challenge

Add to this brightness and saturation, and you get a 3-dimensional color solid (or a "color spindle")

How do we see colors? Trichromacy theory - Young and Helmholtz Psychological observations: – Color Matching: Thomas Young noticed that just by combining 3 primary colors of light (and adjusting their relative intensities), one could reproduce all colors of the spectrum (while two colors are too few) –Based on this observation, the design of color televisions included only 3 color channels: red, green, and blue (RGB) –Only these three colors are needed to be able to reproduce all the colors of the spectrum for the human eye

How do we see colors? Physiology:

Our perception of color depends on the ratio of excitation in the three different cone classes

Summary so far There are three cone types that differ in their photopigments The three photopigments are each selective for a different range of wavelengths If two lights evoke the same responses in the three cone types, then the two lights will look the same Trichromacy is basis of color technology in the print industry and color TV

Trichromacy… is not the whole story Opponency theory – Hering Psychological observations: –Ewald Hering noticed how even though we see colors that are both yellow and green, or red and yellow, or blue and green, it's really hard to imagine a color that is both red and green, or both yellow and blue – If you stare at green, you get a red after-image, if you stare at yellow, you get a blue after-image

Opponency theory Physiology: –Hering proposed that blue and yellow, and red and green are opponent colors that are processed in two independent channels (one for blue-yellow and one for red-green). And he was right! –In the LGN, there are color-opponent cells –There are both yellow-blue opponent cells and red-green opponent cells –These opponent cells have center/surround receptive fields (just like the many cells we've talked about already)

Opponency theory (these red-green opponent cells respond best to a red spot of light surrounded by green)

Firing patterns of opponent cells in response to different wavelengths of light

Puzzle: We don't have a yellow receptor. So how can we have a blue-yellow opponent pathway? One solution. Since we know that green and red light together can make yellow, we can make a yellow receptor by making a cell that gets excitatory input from both red and green cones. The cell marked (A) in this figure acts as a yellow detector:

Color Constancy Puzzle: Sometimes lights of the same wavelength are perceived differently…

It turns out that in addition to simple opponent cells, we have double- opponent cells (DO)

Double-opponent cells reside in collections called blobs (I'm not making this up) in layer 4 of V1 Double-opponent cells have larger receptive fields than simple opponent cells, so they can "see" more of the ambient illumination –Most importantly, double-opponent cells are responsive most to the difference in wavelength between light in the center and light in the surround of its receptive field. This means that a DO cell would signal the same level of activity whether the center was illuminated by red and surround by gray, or the center by gray and surround by green. All the DO cell cares about is the difference between red and green (not the absolute amount of either). The double-opponent mechanism allows us to account for differences in ambient illumination

Overview of the color pathway through the brain

Deficits of color perception About 7% of males have some sort of color deficiency Color-deficiency often goes unnoticed until late in life In fact, one of the earliest reports of color- deficiency was in the 1800's by English chemist John Dalton –He was a Quaker and caused quite a stir by wearing a scarlet robe to his Ph.D. graduation. Later it became clear that scarlet, gray and dark green-blue appeared exactly the same to him.

The most common deficiency is a red-green colorblindness

Types of color deficiency Monochromats are missing all 3 cone types: –very rare –only have rods –don't see color at all, only different shades of gray –have to wear dark sunglasses during the daytime, otherwise their photoreceptors are fully bleached and they are effectively blind

Dichromats Protanopes: missing the long-wavelength visual pigment, only see blue and yellow, hereditary & sex-linked Deuteronopes: missing the middle- wavelength visual pigment, only see blue and yellow, hereditary & sex-linked Tritanopes: only see blue and red, very rare

Dichromats can see some color, but not as big a range as trichromats

Color Encoding as a Linear System

Light of different wavelengths is absorbed in different proportions by our cones Roughly, S-cones absorb blue light, M-cones absorb green light, and L-cones absorb red light The ratio of excitation of the three cone types predicts our perception of color There is an amazing correspondence between cone absorptions and color matching Suppose we shine a test light on a screen Now we sit you down with three primary lights (whose wavelengths match the peak absorption wavelengths of your cones) and ask you to adjust the brightness knobs on the three lights until you have matched the test light

Here's the amazing part: The ratio of brightness settings of the three knobs will match exactly the ratio of cone absorptions!

Final thought: Perception is a private experience So, by looking at your knob settings, we can predict not only the wavelength of light that you're looking at, but also the internal response (the cone absorptions)!