1. Moore’s Law Electronics 19 April 1965

2. Moore’s Original Data Gordon Moore Electronics 19 April 1965

3. Graph of Moore’s Law 11/01/2008EADS3

4. Graph of Moore’s Law – with MS 11/01/2008EADS4

5. Graph of Moore’s Law – with MS 11/01/2008EADS5 Human Intelligence

6. Memory bottleneck The CPU can add two numbers in less than one nanosecond. – If they are both in registers Putting a number from memory into a register takes about 100 nanoseconds. “Stall” – the CPU waits on memory. 11/01/2008EADS6

7. 11/01/2008EADS7 Intel Haswell Size/speed 1K / 1 ns 128Kb / 5 ns 1 Mb / 20 ns 4 Gb /125 ns 1 Tb / 1 ms

8. GPU architecture GPUs have much less space devoted to cache. GPUs have multiple (100-1000) cores, which are simpler, slower processing units. GPU cores all perform the same instructions, but on different data. Not all the cores can be active at once. When one stalls, another one starts up. 11/01/2008EADS8

9. GPU and CPU: The Differences DRAM Cache ALU Control ALU DRAM CPU GPU More transistors devoted to computation, instead of caching or flow control Suitable for data-intensive computation High arithmetic/memory operation ratio

10. Intel Core i5-3470 Ivy Bridge Processor:

11. 11/01/2008EADS11