Presentation is loading. Please wait.

Presentation is loading. Please wait.

資訊理論 授課老師 : 陳建源 研究室 : 法 401 網站 Ch6: Differential entropy.

Similar presentations


Presentation on theme: "資訊理論 授課老師 : 陳建源 研究室 : 法 401 網站 Ch6: Differential entropy."— Presentation transcript:

1 資訊理論 授課老師 : 陳建源 Email:cychen07@nuk.edu.tw 研究室 : 法 401 網站 http://www.csie.nuk.edu.tw/~cychen/ Ch6: Differential entropy

2 Differential entropy whenever the integral exists. The differential entropy of f(x) is defined by NOTE: (1)The entropy of a continuous distribution need not exist. (2)Entropy may be negative

3 Ch 6: Differential entropy Differential entropy whenever the integral exists. Example: Consider a random variable distributed uniformly from 0 to a so that its density is 1/a from 0 to a and 0 elsewhere. Then its differential entropy is


Download ppt "資訊理論 授課老師 : 陳建源 研究室 : 法 401 網站 Ch6: Differential entropy."

Similar presentations


Ads by Google