Presentation is loading. Please wait.

Presentation is loading. Please wait.

AIC,BIC and the new CIC Carlos Rodriguez SUNY Albany. copyMEright by C. Rodriguez. Please copy me!

Similar presentations


Presentation on theme: "AIC,BIC and the new CIC Carlos Rodriguez SUNY Albany. copyMEright by C. Rodriguez. Please copy me!"— Presentation transcript:

1 AIC,BIC and the new CIC http://omega.albany.edu:8008/CIC Carlos Rodriguez SUNY Albany. copyMEright by C. Rodriguez. Please copy me!

2

3

4

5

6

7 t  Truth: t(x) Model: { p(x|  )} Geometrization of Inference

8 Embedding in Hilbert Space Fisher Information metric automagically induced on the tangent bundle !

9 The Volume Form as Prior A hypothesis space M is said to be regular when (M,g) is a smooth orientable riemannian manifold. A k-dim regular M has volume form: In arbitrary (orientation preserving) theta coordinates the volume of (M,g) is:

10 Volumes of Bitnets = dags of bits

11 Maple Module vTool http://omega.albany.edu:8008/bitnets

12 Complete Bitnets 1 2 t t t 1 2 3 x x x 1 2 3 p p p 1 2 3 33 3 + Constant Ricci Scalar

13 (

14 Ground 0 Where does it ALL come from?

15 42 (joke)

16 110 (funny but no joke)

17 MDL bold pragmatism Forget about the data being generated by a probability distribution. This is just a CODING GAME!! Best model is the one providing the shortest code for the observed data. Data is all there is!

18 Есть Проблема The shortest description length of a sequence is NON-COMPUTABLE!! And can only be approximated with MODELS.

19 Data and Theory are Entangled There is no data in the vacuum. Data is a logical proposition with truth values only relative to a given domain of discourse. A sequence 0110011110… is NOT DATA as the number 2.4 is not data unless is understood as “the result of such and such experiment is 2.4”. Data is theory laden. Theory is data laden. IMHO

20 NEED ignorance http://omega.albany.edu:8008/ ignorance

21 )

22 Model Selection from Data Naïve approach Given Data:iid Regular model: Most likely M is asymptotically given my minimizing the MDL score.

23 Model Selection Close to the Vacuum Choose among Complete bitnets: For given data sequence:

24 MLE,MDL,AIC,BIC and…

25

26 Worse < BIC < AIC < CIC < Best % of correct segmentations v/s N. Based on 100 reps for each N. Params at ramdom each time.

27 CIC movie Moving window of 640 bits over sound file.aiff

28 The Iliad: BOOK I Sing, O goddess, the anger of Achilles son of Peleus, that brought countless ills upon the Achaeans. Many a brave soul did it send hurrying down to Hades, and many a hero did it yield a prey to dogs and vultures, for so were the counsels of Jove fulfilled from the day on which the son of Atreus, king of men, and great Achilles, first fell out with one another………… + + + 01100…0.aiff.jpg.txt.gz CIC

29 . end


Download ppt "AIC,BIC and the new CIC Carlos Rodriguez SUNY Albany. copyMEright by C. Rodriguez. Please copy me!"

Similar presentations


Ads by Google