1. Beyond HD: Resolution, Frame Rate, & Dynamic Range
Mark Schubin
multiple Emmy-award-
winning SMPTE Fellow
SchubinCafe.com, Beyond HD, 2012 February 9

2. Why Go Beyond HD? Evolution resolution frame rate wider screen sound
started at 8 lines
frame rate
started at 8 fps
wider screen
started vertical
sound
color
surround sound
Baird 30-line TV 1932
SchubinCafe.com, Beyond HD, 2012 February 9

3. (Not) S3D extra gear extra signals extra work extra processes
prod. & view.
extra signals
extra work
extra processes
noticeable
good when it works well
bad when it doesn’t
Pace
S3D
rig
6 of 16
seats
SchubinCafe.com, Beyond HD, 2012 February 9
NEP SS-3D plans

4. Good & Bad S3D
Good
Bad
SchubinCafe.com, Beyond HD, 2012 February 9

5. Terminology Higher resolution Higher Frame Rate = HFR
4K: either 4096 or 3840 active pixels per line
nominally 2160 lines
8K: either 8192 or 7680 active pixels per line
nominally 4320 lines
7680 version also called UHDTV or Super Hi-Vision
Higher Frame Rate = HFR
includes 1080 lines at 60 fps progressive scan
Higher Dynamic Range = HDR
range from darkest to brightest in an image
SchubinCafe.com, Beyond HD, 2012 February 9

6. What Is HD? ?
SchubinCafe.com, Beyond HD, 2012 February 9

7. What Is HD?
"The exposition's opening on April 30 also marked the advent of this country's first regular schedule of high-definition broadcasts." ?
SchubinCafe.com, Beyond HD, 2012 February 9

8. What Is HD?
"The exposition's opening on April 30 also marked the advent of this country's first regular schedule of high-definition broadcasts."
- Broadcasting magazine ?
SchubinCafe.com, Beyond HD, 2012 February 9

9. What Is HD?
"The exposition's opening on April 30 also marked the advent of this country's first regular schedule of high-definition broadcasts."
- Broadcasting magazine,
reporting from the 1939
New York World’s Fair on
441-line (total) television
SchubinCafe.com, Beyond HD, 2012 February 9

10. “…this country’s…” ?
SchubinCafe.com, Beyond HD, 2012 February 9

11. TV D That Was More H Thousand-line Baird 600-line color 1940
systems tested
in the 1940s
French TV
819-line
SchubinCafe.com, Beyond HD, 2012 February 9

12. Human Resolution Theory - 1862
Snellen Chart
20/20 (6/6) optotype
SchubinCafe.com, Beyond HD, 2012 February 9

13. Resolution and Viewing Distance
Detail falls with distance
Too close can’t see picture due to visible pixels
Peak where pixels match visual acuity
20/20 = 30 cpd
NTSC ~ 480 lines
8°, 7.15x height
1080-line HD 3.16H r e z
viewing distance
cycle = white line & black line
SchubinCafe.com, Beyond HD, 2012 February 9

14. Lechner Distance: Flat-Panel Displays 9 feet Increase Distance (2.7 m)
SchubinCafe.com, Beyond HD, 2012 February 9

15. Seeming Lack of Need for HDTV
15.1
inches
(38 cm) 8°
9 feet (2.7 m)
CEA: 27-inch (69 cm) average
size sold to U.S. dealers in 2006
Dealer inventory one year
10 years to replace all TVs
1080 lines visible on 70-inch
(178 cm) 16:9 HDTV 15
inches
25-inch (64 cm) TV
SchubinCafe.com, Beyond HD, 2012 February 9

16. Home TV Screen Size Shipped
(their typo)
July 2011 Lawrence Berkeley National Laboratory Report
based on DisplaySearch data (actual & projected)
SchubinCafe.com, Beyond HD, 2012 February 9

17. One Heck of a Home TV 2006 August 16, Stan Glasgow, pres.
4096x2160
2006 August 16,
Stan Glasgow, pres.
Sony Electronics,
“next big leap” in HD
[beyond 1080-line]
could be 3-5 years
70-inch:1080-line::
140-inch:2160-line
Panasonic 150-inch/3.8-m plasma TV at
2008 Consumer Electronics Show
SchubinCafe.com, Beyond HD, 2012 February 9

18. Changing Theatrical Expectations
courtesy Warner Bros. Technical Operations
The tiny-screen
movie palace is
ancient history
Some people are six screen heights. Mid point is greater than three screen height.
SchubinCafe.com, Beyond HD, 2012 February 9

19. courtesy of ARRI, used with permission
based on 20/20 vision
HDTV ≈
“2K”
courtesy of ARRI, used with permission
SchubinCafe.com, Beyond HD, 2012 February 9

20. NHK – Ultra-Definition TV
NAB 2007
Super Hi-Vision 7680 x 4320 (8K) – 400-inch (10.2-m)
16x more pixels than 1920 x 1080 HDTV
SchubinCafe.com, Beyond HD, 2012 February 9

21. Problems with 30-cpd Theory
Edges
3 chart lines below 20/20
April 2008 SMPTE Motion Imaging Journal:
NHK “Research on Human Factors in UHDTV”
possible to distinguish between 78 and 156 cpd
156 cpd is more than five times the 20/20 criterion
“realness” is a function of image detail
rises rapidly to 50 cpd
continues rising through 156 cpd
SchubinCafe.com, Beyond HD, 2012 February 9

22. Beyond-HDTV Spatial Resolution
Cameras from:
ARRI, Astro, Canon, Dalsa, Hitachi, Ikegami, JVC, Lockheed-Martin, Meduza, NHK, Olympus, Red, Sony, Vision Research
Displays from:
CMO, JVC, LG, Panasonic, Samsung, Sharp, Sony, Toshiba
Other gear:
codecs, recorders, up- & down-convert, production switchers
But first…
SchubinCafe.com, Beyond HD, 2012 February 9

23. Higher Frame Rates 50 Hz 100 Hz BBC/EBU simulation from 300- fps video
Raw data rate same mult.
Compressed data rate TBD
less change between frames
sharper for easier estimation
SchubinCafe.com, Beyond HD, 2012 February 9

24. Also Motion Strobing
Panning-speed tables based on frame rate and viewing angle
If higher resolution means greater angle, then higher frame rate
S3D sometimes halves frame rate per eye
SchubinCafe.com, Beyond HD, 2012 February 9

25. Douglas Trumbull on HFR, New York Times, 2012 Feb 5
“There are really no words for it in English, but it’s a window onto reality”
Tree of Life, Fox Searchlight Pictures
SchubinCafe.com, Beyond HD, 2012 February 9

26. Douglas Trumbull on HFR, New York Times, 2012 Feb 5
“There are really no words for it in English, but it’s a window onto reality”
“Digital cinematography can effortlessly go to 1,000 frames a second”
??????
light
data
SchubinCafe.com, Beyond HD, 2012 February 9
Bill Huber

27. Alternative for Strobing/False Motion
SchubinCafe.com, Beyond HD, 2012 February 9

28. Back to Spatial Resolution
More detail
Reframing/stabilization
Single-sensor 3D
Increased
sharpness
Skewed HD
Resulting HD
Desired HD 4k
Zepar S3D lens on VR Phantom 65
SchubinCafe.com, Beyond HD, 2012 February 9

29. Which Person Looks Angrier?
“Angry Man/Neutral Woman,” 1997
copyright Aude Oliva, MIT and
Philippe G. Schyns, University of Glasgow
used with permission
in the experiments, LSF<2 cpd, HSF>6 cpd
SchubinCafe.com, Beyond HD, 2012 February 9

30. Do you see a curve along the bottom?
Introducing Contrast
contrast
resolution
Do you see a curve along the bottom?
SchubinCafe.com, Beyond HD, 2012 February 9

31. Contrast-Sensitivity Function
max.
contrast
sensitivity
1-8 cpd
curve varies
with retinal
angle and
observer
resolution
SchubinCafe.com, Beyond HD, 2012 February 9

32. Modulation Transfer Function
curve shape
varies due
to such factors
as filtering,
diffraction, imager
resolution, etc.
contrast
“sharpness” is
proportional to the
square of the area
under the curve
(ARRI paper differs)
resolution
SchubinCafe.com, Beyond HD, 2012 February 9

33. HDCAM/DVCPRO HD Compromise
contrast
loss of lots
of resolution
but very little
sharpness
resolution
SchubinCafe.com, Beyond HD, 2012 February 9

34. Combining Vision & Technology
contrast
not reproduced
available
& visible
invisible
resolution
SchubinCafe.com, Beyond HD, 2012 February 9

35. Why More Resolution Is Good
SchubinCafe.com, Beyond HD, 2012 February 9

36. Why More Resolution Is Good
If this is 1080 lines,
then the contrast ratio
at 1080 lines is zero
zero
contrast
SchubinCafe.com, Beyond HD, 2012 February 9

37. Why More Resolution Is Good
If this is 2160 lines,
then the contrast at
1080 lines is 64%
64%
contrast
SchubinCafe.com, Beyond HD, 2012 February 9

38. Real MTF Curves 14% linear increase in sensors
EOS 10D
3072 x 2048
EOS 20D
3504 x 2336
14% linear increase in sensors
courtesy Bob Atkins
used with permission
SchubinCafe.com, Beyond HD, 2012 February 9

39. Real-World Sharpness Change
EOS 20D
3504 x 2336
EOS 10D
3072 x 2048
courtesy Bob Atkins
used with permission
SchubinCafe.com, Beyond HD, 2012 February 9

40. What Is Resolution? Traditional video definition: Optical definition:
1920 x 1080, 1280 x 720, etc.
Optical definition:
line pairs per millimeter (lp/mm)
(video resolution ÷ 2) ÷ imager size in mm
Imager Width lp/mm S
1-inch
2/3-inch
1/2-inch
1/3-inch
1/4-inch
full-width
16:9
for 1920
pixels
per line
SchubinCafe.com, Beyond HD, 2012 February 9

41. Relative MTF of HDTV 2/3-Inch, 1/2-Inch, and 1/3-Inch Lens
Measured at Picture Center
(from Small Format HD Acquisition, Larry Thorpe, Canon,
2005 SMPTE Fall Technical Conference)
100
2/3-Inch
1/2-Inch
MTF %
1/3-Inch
LP/mm
Red One 4520 pels slightly easier than 1920
SchubinCafe.com, Beyond HD, 2012 February 9

42. But How Should It Be Measured?
traditional color video
Hitachi, Ikegami
Lockheed-Martin
NHK, Olympus (diff.)
ARRI
Astro
Canon
JVC
Red
Sony (different)
Vision Research
SchubinCafe.com, Beyond HD, 2012 February 9

43. Both hi-rez and HFR tend to need larger image sensors
Sensitivity
Both hi-rez and HFR tend to need larger image sensors
SchubinCafe.com, Beyond HD, 2012 February 9

44. Astro 4K products (more models plus coders & converters)
The Story So Far
Frame-rate increase = data & light increase
Linear rez increase = (data & light increase)2
Lenses to match optical rez increase
Single-camera ok; multi-camera not yet
downconversion useful
Astro 4K products (more models plus coders & converters)
SchubinCafe.com, Beyond HD, 2012 February 9

45. 500-watt halogen light
SchubinCafe.com, Beyond HD, 2012 February 9

46. High Dynamic Range 10,000,000:1 (>23-stop) contrast ratio
Grass Valley Xensium
(also ARRI, Fuji, Red, others)
SchubinCafe.com, Beyond HD, 2012 February 9

47. Different HDR-Capture Methods
Areal – Bigger Pixels
Fewer pixels (ARRI)
less resolution
Larger sensor (Vision Research)
cost, lens availability
Spatial – Multiple Sites
Fuji
Temporal – Multi-Readout
Red
short duration for highlights
old Fuji Super CCD
SchubinCafe.com, Beyond HD, 2012 February 9

48. Other Optical Solutions
Rosco View
SchubinCafe.com, Beyond HD, 2012 February 9
Live Technologies LiveLens

49. Dolby PRM-4200 monitor shot by Bill Bennett, ASC
HDR Good News & Bad
Good: No change after image sensing
Bad: HDR displays before content
(also wider color gamut)
Dolby PRM-4200 monitor shot by Bill Bennett, ASC
used with permission
SchubinCafe.com, Beyond HD, 2012 February 9

50. We’ve come a long way since 1888
Questions?
Comments?
SchubinCafe.com, Beyond HD, 2012 February 9