Download presentation

Presentation is loading. Please wait.

Published byErick Willette Modified over 3 years ago

1
Regret in the On-Line Decision Problem Dean Foster & Rakesh Vohara Presented by: Tom Whipple 2/7/2006

2
Outline Intuition Notation Definition of Regret –Internal Regret –No Regret –External Regret Theorem 2 How do we use Regret? –Stock market example

3
What is Regret? Informal: I wish I had decided x instead of y. Goal: Quantify this, accounting for: –“How bad?” (I could have made $1,000,000) –“How likely?” (But it wasn’t very likely)

4
Notation the set of possible decisions. Loss for decision i at time t. stochastic vector s.t. is chosen at time t with probability S denotes an arbitrary “scheme” for making decisions T is the total number of time steps t.

5
Definition: Regret Total Regret from using scheme S is: Weighted by probability of making decision j at time t. Difference in loss from deciding j instead of i. If < 0, i is better than j at time t. Regret cannot be negative for any decision.

6
No (Internal) Regret If the scheme S is asymptotically close to the number of time intervals T then S is said to have no internal regret. “Internal” refers to the regret of decisions within S.

7
No External Regret Uses Expected Loss Note that “External” refers to comparing scheme S to other schemes. Intuition: The expected loss from S is no more than the expected loss from the best P. Scheme S has no external regret if

8
Theorem 2 “Given any finite set of decision schemes F, there exists a (randomized) decision scheme S with no external regret w.r.t. F ” Intuition: There is some S, not in F that is at least as good (asymptotically) as the best scheme in F.

9
Application: Stock Selection Theorem 2 shows we can approach best constant portfolio. –Constant refers to relative allocation (BCRP). –This is the same result we saw in previous paper. In the context of this paper, is constant for

Similar presentations

OK

Continuous Random Variables. For discrete random variables, we required that Y was limited to a finite (or countably infinite) set of values. Now, for.

Continuous Random Variables. For discrete random variables, we required that Y was limited to a finite (or countably infinite) set of values. Now, for.

© 2018 SlidePlayer.com Inc.

All rights reserved.

Ads by Google

Ppt on australian continental drift Ppt on chapter 3 atoms and molecules for kids Ppt on steve jobs leadership style Ppt on management information systems Ppt on van de graaff generator demonstrations Ppt on vitamin deficiency diseases Ppt on combination of resistances to change Reliability of the bible ppt on how to treat Ppt on formal education definition Ppt on social contract theory john