1. CPSC 121: Models of Computation 2013W2
Revisiting Induction
Steve Wolfman, based on work by Patrice Belleville and others
TODO (future terms): update term

2. Outline Prereqs and Learning Goals Problems and Discussion
Introductions
Odd Numbers
Horse Colours
CS Induction: Duplicate Detection, Binary Search, MergeSort
More examples
Next Lecture Notes

3. Learning Goals: Pre-Class
By the start of class, you should be able to:
Given a theorem to prove and the insight into how to break the problem down in terms of smaller problems, write out the skeleton of an inductive proof including: the base case(s) that need to be proven, the induction hypothesis, and the inductive step that needs to be proven.
Discuss point of learning goals.

4. Learning Goals: In-Class
By the end of this unit, you should be able to:
Formally prove properties of the non-negative integers (or a subset like integers larger than 3) that have appropriate self-referential structure—including both equalities and inequalities—using either weak or strong induction as needed.
Critique formal inductive proofs to determine whether they are valid and where the error(s) lie if they are invalid.
Discuss point of learning goals.

5. Outline Prereqs and Learning Goals Problems and Discussion
Introductions
Odd Numbers
Horse Colours
CS Induction: Duplicate Detection, Binary Search, MergeSort
More examples
Next Lecture Notes

6. Worked Problem: How Many Introductions?
Problem: n people would like to introduce themselves to each other. How many introductions does it take?
For 2 people?
For 3 people?
For 4 people?
For 5 people? …
For n people?
Sound familiar?
Let’s prove it.

7. Worked Problem: How Many Introductions?
Def’n: When two people meet each other, that counts as two intros.
Let’s do a few steps concretely to find insight…
For 1 person?
Given the number for 1, for 2?
Given the number for 2, for 3?
Talk about use of mathematical techniques and notation to represent the problem and its solution and to prove the correctness of the solution.

8. Worked Problem: Self-referential structure?
It’s usually good to name things!
Let’s let I(n) be the number of introductions required for a group of n people…
I(1)? 0 introductions.
Given I(k-1), what’s I(k)?
a. I(k-1) + 1
b. I(k-1) * (k-1)
c. I(k-1) + 2(k – 1)
d. I(k-1) + 2k
e. None of these
My turn!
Talk about use of mathematical techniques and notation to represent the problem and its solution and to prove the correctness of the solution.
Once we have this, we’re ready for our pattern!

9. A Pattern for Induction
Identify the recursive structure in the problem.
Circle each recursive appearance of the structure inside its definition.
Divide the cases into: those without recursive appearances (“base cases”) and those with (“recursive” or “inductive” cases)
Write a predicate P(a) describing what you want to say about the structure.
Write your theorem a?,P(a)
Complete the proof template.

10. A Pattern for Induction
Identify the recursive structure in the problem.
Circle each recursive appearance of the structure inside its definition.
Divide the cases into: those without recursive appearances (“base cases”) and those with (“recursive” or “inductive” cases)
Write a predicate P(a) describing what you want to say about the structure.
Write your theorem a?,P(a)
Complete the proof template.
I(k)
I(k-1)
“0” base case, “> 0” inductive case
I(k) = k(k-1)

11. P(k) ≡ [fill in predicate definition]
Theorem: For all [recursive structure] a, P(a) holds.
Proof by structural induction:
Base case: [For each non-recursive case, prove the theorem holds for that case. End by showing your theorem true for the base case structure!]
Inductive Step: [For each recursive case…]
Consider an arbitrary [recursive case structure] a.
Induction Hypothesis: Assume the theorem holds for [each recursive appearance of the structure in this case].
We now show the theorem holds for a. [And then do so! You should:
END by showing that your theorem holds for a.
USE the “Induction Hypothesis” assumption(s) you made.
NEVER take a recursive appearance and use the recursive definition to break it down further, like this BAD example: “each subtree is a binary tree that can have subtrees and so on until we reach an empty tree.”]
It helps to write out what you want to prove rather than just “show the theorem holds for a”. (Even though neither one is strictly necessary.)

12. If the recursive structure is parameterized by something, we use that thing inside P(?).
P(k) ≡ I(k) = k(k-1) Theorem: For all natural numbers k, P(k) holds. Proof by structural induction: Base case: We know I(0) = 0. 0(0-1) = 0(-1) = 0, as expected.  Inductive Step: Consider an arbitrary non-zero natural number k. Induction Hypothesis: Assume the theorem holds for k-1; that is, I(k-1) = (k-1)((k-1)-1). We now show the theorem holds for k. That is, I(k) = k(k-1). I(k) = I(k-1) + 2(k-1) by definition = (k-1)((k-1)-1) + 2(k-1) by the IH = (k-1)(k-2) + 2k – 2 = k^2 – 3k k – 2 = k^2 – k = k(k-1) as expected  QED

13. Outline Prereqs and Learning Goals Induction as a Formal Argument Form
Problems and Discussion
Introductions
Odd Numbers
Horse Colours
CS Induction: Duplicate Detection, Binary Search, MergeSort
More examples
Next Lecture Notes

14. Historical Problem: Sum of Odd Numbers
Problem: What is the sum of the first n odd numbers?
First, find the pattern. Then, prove it’s correct.
The first 1 odd number?
The first 2 odd numbers?
The first 3 odd numbers?
The first n odd numbers?
Historical note: Francesco Maurolico made the first recorded use of induction in 1575 to prove this theorem!

15. Sum of Odd Numbers: Recursive Structure
Problem: Prove that the sum of the first n odd numbers is n2.
How can we break the sum of the first, second, …, nth odd number up in terms of a simpler sum of odd numbers?

16. Sum of Odd Numbers: Recursive Structure
Problem: Prove that the sum of the first n odd numbers is n2.
The sum of the first n odd numbers is the sum of the first n-1 odd numbers plus the nth odd number.
(See our recursive formulation of  from the last slides!)

17. A Pattern for Induction
Identify the recursive structure in the problem.
Circle each recursive appearance of the structure inside its definition.
Divide the cases into: those without recursive appearances (“base cases”) and those with (“recursive” or “inductive” cases)
Write a predicate P(a) describing what you want to say about the structure.
Write your theorem a?,P(a)
Complete the proof template.

18. P(k) ≡ [fill in predicate definition]
Theorem: For all [recursive structure] a, P(a) holds.
Proof by structural induction:
Base case: [For each non-recursive case, prove the theorem holds for that case. End by showing your theorem true for the base case structure!]
Inductive Step: [For each recursive case…]
Consider an arbitrary [recursive case structure] a.
Induction Hypothesis: Assume the theorem holds for [each recursive appearance of the structure in this case].
We now show the theorem holds for a. [And then do so! You should:
END by showing that your theorem holds for a.
USE the “Induction Hypothesis” assumption(s) you made.
NEVER take a recursive appearance and use the recursive definition to break it down further, like this BAD example: “each subtree is a binary tree that can have subtrees and so on until we reach an empty tree.”]
It helps to write out what you want to prove rather than just “show the theorem holds for a”. (Even though neither one is strictly necessary.)

19. Historical Problem: Sum of Odd Numbers
Theorem: For all positive integers n, the sum of the first n odd natural numbers is n2.
Base Case: Establish for n=1. The sum of the “first 1 odd natural numbers” is 1, which equals 12. 
Induction Hypothesis: Assume... ?
Inductive Step: To prove... ?

20. Historical Problem: Sum of Odd Numbers
(by the IH)

21. Outline Prereqs and Learning Goals Induction as a Formal Argument Form
Problems and Discussion
Introductions
Odd Numbers
Horse Colours
CS Induction: Duplicate Detection, Binary Search, MergeSort
More examples
Next Lecture Notes

22. Problem: Proof Critique
Theorem: All horses are the same colour. See handout. Problem: Critique the proof.

23. Problem: Proof Critique
Theorem: All horses are the same colour.
See handout.
Proof critique: Is the proof valid?
Yes, because each step follows irrefutably from the previous steps.
Yes, because the premises are false.
Yes, but not for the reasons listed here.
No, because the inductive step fails for n=2.
No, but not for the reasons listed here.

24. Problem: Proof Critique
Theorem: All horses are the same colour. See handout. Proof critique: Can the proof be fixed?
Ask yourself this question if you see a flaw in a proof… especially if it’s in your proof!

25. Outline Prereqs and Learning Goals Induction as a Formal Argument Form
Problems and Discussion
Introductions
Odd Numbers
Horse Colours
CS Induction: Duplicate Detection, Binary Search, MergeSort
More examples
Next Lecture Notes

26. Induction and Computer Science
How important is induction? Is it just for proving things about N?
Induction forms the basis of…
proofs of correctness and efficiency for many algorithms: e.g., How long does it take to detect duplicates in a list of n inputs? Does binary search work?
“recursive” algorithms: e.g., “merge sort”
“recursive data structures”: e.g., How big can a “tree” of height n be?

27. Problem: Detecting Duplicates
Problem: How long does it take to detect duplicates in a list of n Inputs?
Let’s assume the amount of “time” taken is proportional to the number of comparisons we make between numbers.
We could compare each element to each other element and see if they’re the same.
Sound familiar? We already know how long this takes!
Have each number “introduce” itself to each other number. If they’re the same, we have a duplicate.
Note: this isn’t the fastest algorithm!

28. Problem: Binary Search Works
Problem: Prove that binary search works. Binary search is when we search a sorted list by checking the middle element. If it’s what we’re looking for, we’re done. Otherwise, we “throw out” the part of the list we don’t need (e.g., the left half if the element we looked at was too small) and start over on what remains.

29. Sorting by “Merging” Problem: sort a list of names. Algorithm:
If the list is of length 1, it’s sorted.
Otherwise:
Divide the list in half (or as close as possible).
Sort each half using this algorithm.
Merge the sorted lists back together.

30. The Merge Step
Problem: given two lists of names in sorted order, merge them into a single sorted list.
Merge(a,b):
If a is empty, return b
If b is empty, return a
Otherwise, if the first element of b comes before the first element of a, return a list with the first element of b at the front and the result of Merge(a, rest of b) as the rest
Otherwise, return a list with the first element of a at the front and the result of Merge(rest of a, b) as the rest.
2011W1: used as midterm exam question in CPSC 110 just a few days ago.

31. Problem: Prove Merge works

32. A Pattern for Induction
Identify the recursive structure in the problem.
Circle each recursive appearance of the structure inside its definition.
Divide the cases into: those without recursive appearances (“base cases”) and those with (“recursive” or “inductive” cases)
Write a predicate P(a) describing what you want to say about the structure.
Write your theorem a?,P(a)
Complete the proof template.

33. P(k) ≡ [fill in predicate definition]
Theorem: For all [recursive structure] a, P(a) holds.
Proof by structural induction:
Base case: [For each non-recursive case, prove the theorem holds for that case. End by showing your theorem true for the base case structure!]
Inductive Step: [For each recursive case…]
Consider an arbitrary [recursive case structure] a.
Induction Hypothesis: Assume the theorem holds for [each recursive appearance of the structure in this case].
We now show the theorem holds for a. [And then do so! You should:
END by showing that your theorem holds for a.
USE the “Induction Hypothesis” assumption(s) you made.
NEVER take a recursive appearance and use the recursive definition to break it down further, like this BAD example: “each subtree is a binary tree that can have subtrees and so on until we reach an empty tree.”]
It helps to write out what you want to prove rather than just “show the theorem holds for a”. (Even though neither one is strictly necessary.)

34. Outline Prereqs and Learning Goals Induction as a Formal Argument Form
Problems and Discussion
Introductions
Odd Numbers
Horse Colours
CS Induction: Duplicate Detection, Binary Search, MergeSort
More examples
Next Lecture Notes

35. Problem: Prove that 2n < n!
Note: is 2n < n!?

36. A Pattern for Induction
Identify the recursive structure in the problem.
Circle each recursive appearance of the structure inside its definition.
Divide the cases into: those without recursive appearances (“base cases”) and those with (“recursive” or “inductive” cases)
Write a predicate P(a) describing what you want to say about the structure.
Write your theorem a?,P(a)
Complete the proof template.

37. P(k) ≡ [fill in predicate definition]
Theorem: For all [recursive structure] a, P(a) holds.
Proof by structural induction:
Base case: [For each non-recursive case, prove the theorem holds for that case. End by showing your theorem true for the base case structure!]
Inductive Step: [For each recursive case…]
Consider an arbitrary [recursive case structure] a.
Induction Hypothesis: Assume the theorem holds for [each recursive appearance of the structure in this case].
We now show the theorem holds for a. [And then do so! You should:
END by showing that your theorem holds for a.
USE the “Induction Hypothesis” assumption(s) you made.
NEVER take a recursive appearance and use the recursive definition to break it down further, like this BAD example: “each subtree is a binary tree that can have subtrees and so on until we reach an empty tree.”]
It helps to write out what you want to prove rather than just “show the theorem holds for a”. (Even though neither one is strictly necessary.)

38. Outline Prereqs and Learning Goals Induction as a Formal Argument Form
Problems and Discussion
Introductions
Odd Numbers
Horse Colours
CS Induction: Duplicate Detection, Binary Search, MergeSort
More examples
Next Lecture Notes

39. Learning Goals: In-Class
By the end of this unit, you should be able to:
Formally prove properties of the non-negative integers (or a subset like integers larger than 3) that have appropriate self-referential structure—including both equalities and inequalities—using either weak or strong induction as needed.
Critique formal inductive proofs to determine whether they are valid and where the error(s) lie if they are invalid.
TODO!!!
Next lecture stuff!
Discuss point of learning goals.

40. Extra Slides

41. Problem: Proof Critique
Theorem: All integers ≥ 2 are even. Problem: Critique the proof. Is it valid? If not, why not? Can it be fixed, and how?

42. Problem: Sum of a Geometric Series
Problem: What is the sum of the first n terms of the form ai, if a is a real number between 0 and 1? (Note: we mean terms 0 through n.)
Note: we’re looking for
It turns out the question about the reals is an incredibly deep one, tied up with the Axiom of Choice. If the Axiom of Choice holds, then the reals are well-ordered (and so we could use induction on them??). Else, they’re not. Unfortunately, even if the Axiom is true (which it provably isn’t NECESSARILY in our usual formalization of set theory), it doesn’t tell us what the well-ordering actually IS.
Short version: no.
Note: (a^(n+1) – 1)/(a – 1)
Can we use induction over the real numbers between 0 and 1?

43. Induction: a Domino Effect
A proof by induction is like toppling a chain of dominoes.
Let’s say I tell you:
the first domino in the chain toppled
for every domino in the chain, if the domino before it toppled, then the domino itself toppled
Did all the dominoes in the chain topple?

44. Formal (Weak) Induction
A formal induction proof follows the same pattern. To prove some property P(.) applies to all positive integers n, we prove:
The first domino topples. If one domino topples… Then the next one topples.
P(0) is true. [For arbitrary k] If P(k) is true... Then P(k+1) is also true.
Typically, we prove the second step by antecedent assumption/direct proof.

45. Form of an Induction Proof
Theorem: some property that depends on n Basis step: show that a small case works Induction Hypothesis: Assume your property holds for n=k where k ≥ your basis step. Inductive Step: Under this assumption, you need to prove that your property holds for n=k+1.

46. Side Note: Practical Induction
That’s how you formally write out the proof, but how do you figure out the proof? Start at the inductive step!

47. Side Note: Practical Induction
Look at a “big” problem (of size n). Figure out how to break it down into smaller pieces. Assume those smaller pieces work. That will end up as your Induction Hypothesis. Figure out which problems cannot be broken down (usually small ones!). Those will end up as your basis step(s).

48. Proof
Base case: A group of size 1 takes 0 intros. (Because there are no pairs.)
Note: we talked about induction to prove properties for the non-negative integers, but it can be more general.

49. Proof (Continued)
Inductive step, to prove: If a group of size k-1 takes (k-1)((k-1)-1) intros, then a group of size k takes k(k-1) intros. Assume size (k-1) takes (k-1)((k-1)-1) or (k-1)(k-2) intros (the Induction Hypothesis) ...
Split into several slides.

50. Proof (Continued)
Inductive step, continued: A group of size k, where k > 0, is a group of size k-1 plus one person. Imagine size k-1 group has completed introductions. That took (k-1)(k-2) intros by the IH. Add one more person to the group, and that person must greet all k-1 other people, for a total of (k-1)(k-2) + 2(k-1) introductions. (k-1)(k-2) + 2(k-1) = (k-1)[k-2 + 2] = (k-1)k
QED: if k-1 takes (k-1)(k-2), k takes k(k-1).
Split into several slides.

51. Proof (Completed)
Base case: A group of size 1 takes 0 intros. (See proof above.)
Inductive step: If a group of size k-1 takes (k-1)(k-2) intros, then a group of size k takes k(k-1) intros. (See proof above.)
QED.
From these two we could (but don’t have to) crank out a proof for any n that a group of size n requires n(n-1) introductions.

52. Form of a Strong Induction Proof
Theorem: some property that depends on n Basis step: show that one or more small cases (as needed) work Induction Hypothesis: Assume your property holds for any n = i where your basis step ≤ i < k and k is an integer > your basis step. Inductive Step: Under this assumption, you need to prove that your property holds for n = k.
Hint: there’s really no difference. Just assume what you need in order to break the problem into smaller pieces.

53. Side Note: “Strong Induction”
We’ve used weak induction: basis step (n = a) plus “if it works for n then it works for n+1”.
In strong induction, we use: basis step plus “if it works for all a  i < k then it works for k”.
Can we still build our individual proofs (for n = 1, n = 2, n = 3, ...) from that?

54. Online Quiz Notes: New Problem
Imagine that your country's postal system only issues 3 cent and 7 cent stamps. Prove by induction that it is possible to pay for postage using only these stamps for any amount n cents, where n is at least 12. We will use n=12 as one of our base cases. (“We pay 12 cents with four 3 cent stamps”.)

55. Extra Base Cases?
Our inductive step says that for “sufficiently large” n, we can make n cents of postage by making n-3 cents of postage and then using a three cent stamp. What additional base case (if any) do we need? a. n = 6 b. n = 13 c. n = n-3 d. no additional base cases e. more than one additional base case

56. n  ?
Our inductive step says that for “sufficiently large” n, we can make n cents of postage by making n-3 cents of postage and then using a three cent stamp. We use n=12, n=13, and n=14 as base cases. How large must n be for the inductive step? a. n  12 b. n  13 c. n  14 d. n  15 e. none of these

57. Extra Base Cases? Version 2
Our inductive step says that for “sufficiently large” n, we can make n cents of postage by making n-1 cents of postage and then doing one of: take out two 7c stamps and add five 3c stamps or (if there are fewer than two 7c stamps), take out two 3c stamps and add a 7c stamp. What additional base case (if any) do we need? a. n = 6 b. n = 13 c. n = n-1 d. no additional base cases e. more than one additional base case

58. n  ? Version 2
Our inductive step says that for “sufficiently large” n, we can make n cents of postage by making n-1 cents of postage and then doing one of: take out two 7c stamps and add five 3c stamps or (if there are fewer than two 7c stamps), take out two 3c stamps and add a 7c stamp. We use n=12 as our only base case. How large must n be for the inductive step? a. n  12 b. n  13 c. n  14 d. n  15 e. none of these